+- The VG Resource (https://www.vg-resource.com)
+-- Forum: Archive (https://www.vg-resource.com/forum-65.html)
+--- Forum: July 2014 Archive (https://www.vg-resource.com/forum-139.html)
+---- Forum: Main Stuff (https://www.vg-resource.com/forum-1.html)
+----- Forum: News (https://www.vg-resource.com/forum-2.html)
+----- Thread: Rebuilding Process Information Thread (/thread-24401.html)
RE: Rebuilding Process Information Thread - Garamonde - 01-07-2014
(01-07-2014, 03:10 PM)Dazz Wrote: MJ it... Doesn't work like that. It's just clicking buttons.
I know it doesn't work the same way as the broken sheets, but there might be overlap right?
I guess it'll be clear how exactly it's going to work when we see it...
RE: Rebuilding Process Information Thread - DJane Coco - 01-07-2014
After all these years of using tSR as a resource, I felt inclined to donate a little 20GBP. I hope you guys can get the site working again soon, good luck!
RE: Rebuilding Process Information Thread - daemoth - 01-07-2014
I cant afford any donation but if theres anything else i can do to help, i would be glad to!
RE: Rebuilding Process Information Thread - puggsoy - 01-07-2014
Basically what Daemoth said. In any case good job with what you've guys done so far, and good luck with getting the rest back up!
RE: Rebuilding Process Information Thread - psychospacecow - 01-07-2014
I don't know how but if I can help you guys, I'm in to do so.
RE: Rebuilding Process Information Thread - Pik - 01-07-2014
Is there any way I can assist? I'm open to any task that needs additional manpower, just give me a ring.
RE: Rebuilding Process Information Thread - JosephSeraph - 01-07-2014
MAN THIS MADE ME SO SAD I'M ALMOST CRYING
I wish I could donate but I don't have a credit card
And I wish I could help but I don't know programming at all
All I can do is to send my sincerest good vibes. ):
Best of luck...
RE: Rebuilding Process Information Thread - Dazz - 01-07-2014
We're almost at a point that I can guarantee that our solution that's in the works will definitely work. We're almost ready to start refilling the data.
If this does end up working, we'll be looking at the site being up before the weekend.
RE: Rebuilding Process Information Thread - Phaze - 01-07-2014
(01-07-2014, 03:50 PM)Raz Wrote: I wrote a scraper but the IP address I was using got banned pretty quickly, even if I randomized the IP/interval between requests Google looks for patterns in the search requests and will block too many similar requests with a CAPTCHA. The funny thing is, the biggest web crawler in the world doesn't let you crawl their servers. Huh.
Good ol' Google. It would be nice if people could just ask them to pass along the cached pages in a handy archive file but I doubt they'd even notice such a request, much less respond to it.
RE: Rebuilding Process Information Thread - MadkaT - 01-07-2014
This can't be a great help, but you can consult the wayback machine too
http://web.archive.org/web/*/www.spriters-resource.com
I think this would be better than google
RE: Rebuilding Process Information Thread - Dazz - 01-07-2014
Sadly, no; they have seriously outdated pages. Severely, when compared to Google. The first game I checked the first game we have in Arcade:
http://web.archive.org/web/20120602115605/http://www.spriters-resource.com/arcade/1944loopmaster/
It's from just under 2 years ago, before the new system was even put in place.
RE: Rebuilding Process Information Thread - Raz - 01-07-2014
It appears that we now have a system in place that's going to let us grab all of the information we need to restore the DB - it'll take a little while for us to crawl through every single game page to pull the information but Petie has done a fantastic job writing a bookmarklet that'll make gathering the data from a page trivial.
Once it's all done if anyone is interested we can write up what we've done throughout this process.
RE: Rebuilding Process Information Thread - Deathbringer - 01-07-2014
Query: As far as you can tell at this point, what are the latest submissions you have to work with? Like up to what day?
RE: Rebuilding Process Information Thread - Petie - 01-07-2014
Most of the site should be available but each page has its own timestamp as Google re-caches them over time so I can't give a definitive answer.
RE: Rebuilding Process Information Thread - Palculator - 01-08-2014
Hello everyone,
I just found out about the news and registered to say that I created a local backup of the site roughly around the 07th of december. It contains all of the sprite files and the HTML pages generated by the website. So it's basically like the Google cache with the difference that I could provide the actual files. I'm also not sure how "complete" the Google cache is but regardless: If this would be of any help to you guys I could start preparing an upload (without the sprite files themselves, obviously.)
Cheers,
Palculator