Login

seagaia · 2011-02-26, 02:09 PM

Hi, I was wondering the reason for this data: I wrote some scripts that rips legendary ranking data from the website, cleans it up a bit then throws it into a database...then I sorted it to find this:

Magician|4735
Warrior|1589
Thief|1462
Bowman|871
Pirate|402
Evan|291
Aran|276
WildHunter|188
DualBlade|90
BattleMage|46
Mechanic|32
Beginner|3

Here are the first 1000 weekly active players in job frequency...which tells me a few things: Mages and WHs are broken.

[(u'Magician', 365), (u'Evan', 205), (u'WildHunter', 193), (u'Mechanic', 50), (u'BattleMage', 48), (u'Warrior', 47), (u'Aran', 44), (u'Thief', 28), (u'Bowman', 8), (u'Pirate', 8), (u'DualBlade', 2)]

What implications does this have? Moreover, does anyone know a fast way to download webpages? I need to get about 2.5 million webpages, possibly less if I decided to narrow it down to level 70+s or 30s. Right now I'm suffering from horrible latency. Running multiple shell processes helps a little, but only increase my speed 5 or 6 fold.

I'd like to analyze far more data than just 10,000 characters, and I'd like to extend this to the active player ranking rather than legendary rankings (since obviously this is not a valid comparison of the speed of a WH vs. a magician)

Shidoshi · 2011-02-26, 02:12 PM

What do you mean? After 4th job and ultimates mages had the upper hand on leveling speed. Of course they are the majority of lvl 200s

seagaia · 2011-02-26, 02:21 PM

Shidoshi Wrote:What do you mean? After 4th job and ultimates mages had the upper hand on leveling speed. Of course they are the majority of lvl 200s

Do you think this will become more balanced after Chaos or something? Even just looking at the recent rankings they're still the fastest.

maplefreak26 · 2011-02-26, 02:23 PM

seagaia Wrote:Do you think this will become more balanced after Chaos or something? Even just looking at the recent rankings they're still the fastest.

The other classes are probably just catching up now, you never know.

Overlord · 2011-02-26, 02:24 PM

seagaia Wrote:Do you think this will become more balanced after Chaos or something? Even just looking at the recent rankings they're still the fastest.

Most of those mages that are in the top ranks are hackers if you didn't already know. Legit mages training speeds are the same if not abit behind from other classes

seagaia · 2011-02-26, 02:32 PM

Overlord Wrote:Most of those mages that are in the top ranks are hackers if you didn't already know. Legit mages training speeds are the same if not abit behind from other classes

Yeah I guess this is the reason. Oh well. I should probably add in a field for EXP gained since right now I only have it get level, job, world, rank, name data..

Regardless, the question latency still stands. Anyone know how to get webpages really fast? I'm at about 0.500 s per webpage, which scales horrifically.

OB3LISK · 2011-02-26, 02:34 PM

Mages had a HUGEEEEEEEEEEEEEEEEE training boost it's no surprise at all.

If you mean right now, then mages are weak and useless at training and other classes have a chance to catch up.

Edit: Okay nvm I can't answer your magic computer question. Ask Fiel or Eos or someone F3.

Mike · 2011-02-26, 03:02 PM

Because all they had to do was spam Genesis, Blizzard or Meteor Shower before Big Bang.

Stereo · 2011-02-26, 03:09 PM

OB3LISK Wrote:Mages had a HUGEEEEEEEEEEEEEEEEE training boost it's no surprise at all.

If you mean right now, then mages are weak and useless at training and other classes have a chance to catch up.

None of the adventurer classes really get decent exp rates at high levels. I guess WH and Mechs can because they have insane mobility (from level 10, mechs have Rush, Stance, and Combat Step... WH train on a 180% speed mount)

Liteness · 2011-02-26, 04:06 PM

Stereo Wrote:None of the adventurer classes really get decent exp rates at high levels. I guess WH and Mechs can because they have insane mobility (from level 10, mechs have Rush, Stance, and Combat Step... WH train on a 180% speed mount)

or its called mine hacking lol

Stereo · 2011-02-26, 04:21 PM

Okay, yeah, the alternative is that they're just training 24 hours a day which most people can't manage.

Kaasoljoyyx · 2011-02-26, 04:29 PM

Liteness Wrote:or its called mine hacking lol

My wh trained slightly slower than my mech and it wasn't as geared. Their skills + mount are a huge advantage.

Shidoshi · 2011-02-26, 04:37 PM

seagaia Wrote:Do you think this will become more balanced after Chaos or something? Even just looking at the recent rankings they're still the fastest.

It's already balanced, with big bang most classes level at about the same speed.

The statistics also has to do with everyone and their mother being a bishop or having one at least (pre-BB).

Satellite · 2011-02-26, 04:59 PM

OP skills and/or hacks.

Short, but explains it all.

Transpierce · 2011-02-26, 10:30 PM

WH aren't broken, it's just that the top wild hunter trainers (Or at least most of them), use IRM hacks. And mages have been the top levelers since 4th job came out. Big bang sure did slow down bishops quite a bit, but arch mages definitely still have good training speeds with tele mastery+their summon+para/chain.

seagaia · 2011-03-07, 08:30 PM

Izzy · 2011-03-08, 03:47 PM

are you using wget to scrape the data? if so, thats about the best way i know of to do it

seagaia · 2011-03-10, 01:56 AM

Yeah - I mean, it's not AWFUL if I thread multiple processes together. My friend is using some python API and he's gotten it to 300,000 data points (60,000 requests for webpages) per hour, which beats my current pathetic 40,000 per hour for a single process...

I've found some interesting stuff, I decided to get (almost) all the characters off of demethos:

Spoiler

Login
Username:
Password:	Lost Password?
	Remember me