Forum Settings
       
Reply To Thread

Site crawlers must dieFollow

#1 Oct 14 2005 at 9:25 AM Rating: Excellent
Code Monkey
Avatar
****
7,476 posts
Today's slowness brought to you by:
A WoW crawler
A FFXI crawler
A DAoC crawler
A EQ crawler
Some assnut who was downloading all 751,851 profile.html pages (yeah, that's really useful to archive, fu[/i]ckface)
____________________________
Do what now?
#2 Oct 14 2005 at 9:28 AM Rating: Decent
What is a Crawler? Is he building a character database from profiles? Whats the point of downloading all that info?
#3 Oct 14 2005 at 9:35 AM Rating: Excellent
Code Monkey
Avatar
****
7,476 posts
potential reasons:

1- someone's building a competetor to allakhazam, so crawls all our pages to copy it (a noteable chinese website comes to mind)
2- someone wants a personal copy of all of our pages
3- someone's a total idiot and sets their browser to get all of allakhazam.com for offline use
4- someone's trying to steal email addresses and contact info from anyone dumb enough to post it in a public place (this is why I get monumental amounts of spam since I have to here)
5- profit?
____________________________
Do what now?
#4 Oct 14 2005 at 9:40 AM Rating: Excellent
Liberal Conspiracy
*******
TILT
Ninjas.

Actually, it was me. I'm planning on self-publishing Allakhazam: the Novel.
____________________________
Belkira wrote:
Wow. Regular ol' Joph fan club in here.
#5 Oct 14 2005 at 9:41 AM Rating: Good
YAY! Canaduhian
*****
10,293 posts
Danalog the Vengeful Programmer wrote:
assnut


Smiley: lol

____________________________
What's bred in the bone will not out of the flesh.
#7 Oct 14 2005 at 9:42 AM Rating: Good
Code Monkey
Avatar
****
7,476 posts
I dunno, but banning Russia was one of the sweetist days of my live
____________________________
Do what now?
#8 Oct 14 2005 at 9:46 AM Rating: Good
****
6,760 posts
I'm betting it was #3

But then, I have little faith in human intelligence.
____________________________
Some people are like slinkies, they aren't really good for anything, but they still bring a smile to your face when you push them down the stairs.
#9 Oct 14 2005 at 9:48 AM Rating: Good
Liberal Conspiracy
*******
TILT
In America, you block the internet but, in Soviet Russia, internet blocks YOU!
____________________________
Belkira wrote:
Wow. Regular ol' Joph fan club in here.
#11 Oct 14 2005 at 9:49 AM Rating: Excellent
Code Monkey
Avatar
****
7,476 posts
only one of the crawlers was truly insane, at 50 requests at once, I'm assuming that one was an option 3

the rest were probably 1

if you look around, you'll see sites that steal everything from us, down to the expansion icons that we make
____________________________
Do what now?
#13 Oct 14 2005 at 9:53 AM Rating: Good
Gurue
*****
16,299 posts
Jophiel wrote:
Ninjas.

Actually, it was me. I'm planning on self-publishing Allakhazam: the Novel.


Smiley: lol
#14 Oct 14 2005 at 9:54 AM Rating: Decent
So, thats what that was.. Wow, that must suck for Alla when he has to pay for all that extra bandwidth usage :(
#16 Oct 14 2005 at 9:57 AM Rating: Excellent
Code Monkey
Avatar
****
7,476 posts
Well, we can't sue them since most are based in China, which doesn't have copyright/trademark laws.

____________________________
Do what now?
#17 Oct 14 2005 at 9:58 AM Rating: Good
Drama Nerdvana
******
20,674 posts
One can only hope that they would pick up that WoW virus/trojan that was in the banners or at the least the massively bad publicity that came with it.

someone from Mal'ganis wrote:
Allakhazams? That site is so unclean that I heard if you log on your mother gets herpes!
____________________________
Bode - 100 Holy Paladin - Lightbringer
#18 Oct 14 2005 at 10:10 AM Rating: Decent
*****
10,755 posts
Sometimes I open 5 windows and request my posting history on all of them at once!




Ya *******.
#19 Oct 14 2005 at 10:15 AM Rating: Good
****
4,596 posts
[quote]Some assnut who was downloading all 751,851 profile.html pages (yeah, that's really useful to archive, *****************

Aww now I'll never finish my bathroom wallpaper collage of Crappy Allakhazam posters to punch the clown too Smiley: cry
____________________________
Nicroll 65 Assassin
Teltorid 52 Druid
Aude Sapere

Oh hell camp me all you want f**kers. I own this site and thus I own you. - Allakhazam
#20 Oct 14 2005 at 10:58 AM Rating: Good
*****
12,735 posts
Danalog the Vengeful Programmer wrote:
only one of the crawlers was truly insane, at 50 requests at once, I'm assuming that one was an option 3

the rest were probably 1

if you look around, you'll see sites that steal everything from us, down to the expansion icons that we make



I stole a smiley once... Smiley: frown


#21 Oct 14 2005 at 11:56 AM Rating: Good
Danalog, you need this.
#22 Oct 14 2005 at 9:10 PM Rating: Excellent
***
3,053 posts
Sorry for your frustration, but in the 1840's it was the US that was not respecting the copyright of european writers.

Oh this is JON posting under elne clare. Too lazy to log her out and log me in. Its her fault for not fixing my comp.
____________________________
In the place of a Dark Lord you would have a Queen! Not dark but beautiful and terrible as the Morn! Treacherous as the Seas! Stronger than the foundations of the Earth! All shall love me and despair! -ElneClare

This Post is written in Elnese, If it was an actual Post, it would make sense.
#23 Oct 15 2005 at 10:24 AM Rating: Good
***
3,053 posts
ElneClare wrote:
Sorry for your frustration, but in the 1840's it was the US that was not respecting the copyright of european writers.

Oh this is JON posting under elne clare. Too lazy to log her out and log me in. Its her fault for not fixing my comp.


Yet when I get on this morning you're log in. If you can take the time, so you can post as Jonwin, why can't you take the time to log me back in before you go to bed.

Jonwin is driving me nuts since he can't use his computer to play EQ. I guess I should try to take care of his graphic card problem.
____________________________
In the place of a Dark Lord you would have a Queen! Not dark but beautiful and terrible as the Morn! Treacherous as the Seas! Stronger than the foundations of the Earth! All shall love me and despair! -ElneClare

This Post is written in Elnese, If it was an actual Post, it would make sense.
#24 Oct 15 2005 at 12:15 PM Rating: Decent
**
874 posts
Just kick him in his nub.

Problem solved.
Reply To Thread

Colors Smileys Quote OriginalQuote Checked Help

 

Recent Visitors: 202 All times are in CST
Anonymous Guests (202)