2011-02-26, 02:09 PM
Hi, I was wondering the reason for this data: I wrote some scripts that rips legendary ranking data from the website, cleans it up a bit then throws it into a database...then I sorted it to find this:
Magician|4735
Warrior|1589
Thief|1462
Bowman|871
Pirate|402
Evan|291
Aran|276
WildHunter|188
DualBlade|90
BattleMage|46
Mechanic|32
Beginner|3
Here are the first 1000 weekly active players in job frequency...which tells me a few things: Mages and WHs are broken.
[(u'Magician', 365), (u'Evan', 205), (u'WildHunter', 193), (u'Mechanic', 50), (u'BattleMage', 48), (u'Warrior', 47), (u'Aran', 44), (u'Thief', 28), (u'Bowman', 8), (u'Pirate', 8), (u'DualBlade', 2)]
What implications does this have? Moreover, does anyone know a fast way to download webpages? I need to get about 2.5 million webpages, possibly less if I decided to narrow it down to level 70+s or 30s. Right now I'm suffering from horrible latency. Running multiple shell processes helps a little, but only increase my speed 5 or 6 fold.
I'd like to analyze far more data than just 10,000 characters, and I'd like to extend this to the active player ranking rather than legendary rankings (since obviously this is not a valid comparison of the speed of a WH vs. a magician)
Magician|4735
Warrior|1589
Thief|1462
Bowman|871
Pirate|402
Evan|291
Aran|276
WildHunter|188
DualBlade|90
BattleMage|46
Mechanic|32
Beginner|3
Here are the first 1000 weekly active players in job frequency...which tells me a few things: Mages and WHs are broken.
[(u'Magician', 365), (u'Evan', 205), (u'WildHunter', 193), (u'Mechanic', 50), (u'BattleMage', 48), (u'Warrior', 47), (u'Aran', 44), (u'Thief', 28), (u'Bowman', 8), (u'Pirate', 8), (u'DualBlade', 2)]
What implications does this have? Moreover, does anyone know a fast way to download webpages? I need to get about 2.5 million webpages, possibly less if I decided to narrow it down to level 70+s or 30s. Right now I'm suffering from horrible latency. Running multiple shell processes helps a little, but only increase my speed 5 or 6 fold.
I'd like to analyze far more data than just 10,000 characters, and I'd like to extend this to the active player ranking rather than legendary rankings (since obviously this is not a valid comparison of the speed of a WH vs. a magician)