It is currently Wed May 14, 2025 11:05 pm

All times are UTC - 8 hours [ DST ]




Post new topic Reply to topic  [ 17 posts ] 
Author Message
Offline
 Post subject: Best players by Elo in go4go database
Post #1 Posted: Mon Jun 15, 2015 7:58 am 
Gosei
User avatar

Posts: 1744
Liked others: 704
Was liked: 288
KGS: greendemon
Tygem: greendemon
DGS: smaragdaemon
OGS: emeraldemon
I ran an Elo ranking over all the games in the go4go database. This graph is still a work in progress (anyone good with R?) but here is the top players by Elo for the last 25 years:

Attachment:
best.png
best.png [ 375.16 KiB | Viewed 10598 times ]


The first thing I notice is how truly dominant Lee Changho was. Not just the best, but the clear best for 10 solid years. Another interesting point is that by Elo Iyama Yuta is the strongest player in the world right now. Here's the current top 10:

Iyama Yuta: 2788.9701869012265
Ke Jie: 2766.0026491949425
Park Jungwhan: 2755.3027742005374
Shi Yue: 2734.911306108628
Lee Sedol: 2721.9747143862674
Tuo Jiaxi: 2719.2818172904167
Mi Yuting: 2715.9730263812394
Jiang Weijie: 2713.4313622455284
Lian Xiao: 2702.344198033096
Kono Rin: 2701.814513146868

I decided to set every players' starting rank at 2400. This isn't ideal, especially for the earlier games where 9d players have their ranks set the same as 1d. I'm hoping by the time of these charts those problems have mostly gone away. The go4go database emphasizes newer games at the expense of not having as much of the older stuff.

There's still a lot more I want to experiment with, like highest rated games in the db, biggest upsets, predicting future tournaments, etc. I also want to keep tinkering with the graph to get it to look better. It's less visually confusing over a smaller time scale, but then you don't get the full progression.


This post by emeraldemon was liked by 4 people: jeromie, tiger314, Uberdude, wineandgolover
Top
 Profile  
 
Offline
 Post subject: Re: Best players by Elo in go4go database
Post #2 Posted: Mon Jun 15, 2015 10:16 am 
Lives in gote

Posts: 553
Liked others: 61
Was liked: 250
Rank: AGA 5 dan
Interesting, please keep it up. But I have a pet peeve -- do you really think the ratings are accurate to better than one part per trillion? On a more serious note, does your system assign a probable error to the ratings?

Top
 Profile  
 
Offline
 Post subject: Re: Best players by Elo in go4go database
Post #3 Posted: Mon Jun 15, 2015 10:56 am 
Gosei
User avatar

Posts: 1744
Liked others: 704
Was liked: 288
KGS: greendemon
Tygem: greendemon
DGS: smaragdaemon
OGS: emeraldemon
mitsun wrote:
Interesting, please keep it up. But I have a pet peeve -- do you really think the ratings are accurate to better than one part per trillion?


Definitely not, I was too lazy to format the output so you are seeing the raw doubles.

Quote:
On a more serious note, does your system assign a probable error to the ratings?


Nope, there are other ratings systems that do, like glicko, but I chose Elo because it's very easy to code, and very simple so everyone understands it.

Top
 Profile  
 
Offline
 Post subject: Re: Best players by Elo in go4go database
Post #4 Posted: Tue Jun 16, 2015 2:18 am 
Judan

Posts: 6727
Location: Cambridge, UK
Liked others: 436
Was liked: 3720
Rank: UK 4 dan
KGS: Uberdude 4d
OGS: Uberdude 7d
Lee Changho's dominance is indeed striking, but something else I noticed was the generally upward trend in the ratings. Are pros on average getting stronger, is rank inflation inherent in ELO, or perhaps is your initial seeding at 2400 too low? What happens if you started everyone off at 2600?

Top
 Profile  
 
Offline
 Post subject: Re: Best players by Elo in go4go database
Post #5 Posted: Tue Jun 16, 2015 3:44 am 
Lives in sente

Posts: 1223
Liked others: 738
Was liked: 239
Rank: OGS 2d
KGS: illluck
Tygem: Trickprey
OGS: illluck
I'm not sure starting everyone at 2400 is going to be accurate across regions - given the fairly limited number of international games I think this will skew the Elo in favour of top Japanese players since the average level of pro is somewhat weaker than Korean and Chinese (at least for newer pros where competition is much more fierce in China and Korea).

Top
 Profile  
 
Offline
 Post subject: Re: Best players by Elo in go4go database
Post #6 Posted: Tue Jun 16, 2015 11:47 am 
Gosei
User avatar

Posts: 1744
Liked others: 704
Was liked: 288
KGS: greendemon
Tygem: greendemon
DGS: smaragdaemon
OGS: emeraldemon
Yes, I noticed the ratings increasing too. Elo is a zero-sum rating system, so if the winner gains 12 the loser loses 12. The only way for points to enter/leave the system overall is when new players enter or old ones stop playing. My guess is that there are just way more players in the database now than in 1990, so there are more points to spread around.

I'm not sure if there's a way to adjust or account for that, I may tinker with it some. It might be worth it to try other rating systems too and see how they do.

Top
 Profile  
 
Offline
 Post subject: Re: Best players by Elo in go4go database
Post #7 Posted: Wed Jun 17, 2015 2:36 am 
Judan

Posts: 6727
Location: Cambridge, UK
Liked others: 436
Was liked: 3720
Rank: UK 4 dan
KGS: Uberdude 4d
OGS: Uberdude 7d
emeraldemon wrote:
Yes, I noticed the ratings increasing too. Elo is a zero-sum rating system, so if the winner gains 12 the loser loses 12. The only way for points to enter/leave the system overall is when new players enter or old ones stop playing.

Aren't them some versions of Elo with a little epsilon factor that allows a small amount of points to enter the system to reflect that people can get stronger without others getting weaker. The EGF ratings have this: http://www.europeangodatabase.eu/EGD/EG ... system.php.


This post by Uberdude was liked by: emeraldemon
Top
 Profile  
 
Offline
 Post subject: Re: Best players by Elo in go4go database
Post #8 Posted: Mon Jun 22, 2015 7:19 am 
Gosei
User avatar

Posts: 1744
Liked others: 704
Was liked: 288
KGS: greendemon
Tygem: greendemon
DGS: smaragdaemon
OGS: emeraldemon
I am still messing with the rating system (reading about Whole History Ratings which seems very interesting) but in the meantime I wanted to share the other reason I did this: using elo to decide which games to play through. Every week go4go emails me new games. These are the top three games last week by Elo, and the winning odds it predicts:

#1) 17th Chinese City League A, round 7
Park Jungwhan 56% -- 44% Jiang Weijie

#2) Japanese Honinbo, Title match #4
Iyama Yuta 65% -- 35% Yamashita Keigo

#3) 17th Chinese City League A, round 7
Mi Yuting 47% -- 53% Shi Yue

So I'm off to play through these games, the other nice thing is I can spit the output out spoiler-free, so I can replay the game and be surprised by the outcome. I've used sites like Mr Kin's Go News in the past, but every game is listed with its result, so you always know who won before you start.

Top
 Profile  
 
Offline
 Post subject: Re: Best players by Elo in go4go database
Post #9 Posted: Thu Jul 16, 2015 6:20 am 
Lives with ko

Posts: 170
Liked others: 32
Was liked: 119
Rank: KGS 4 kyu
I had a similar idea, and produced WHR ratings from go4go.net data: http://www.goratings.org/

I am getting a different ranking from yours, though.

Before trying WHR, I tested Glicko. With an incremental rating system, Iyama Yuta had a better rank, but was still a bit far from #1.

I believe incremental systems don't work well for such data, because Japanese players play mostly Japanese opponents. WHR is not incremental, and can deal very well with situations where two strongly connected groups of players interact rarely.

Rémi


This post by Rémi was liked by 2 people: emeraldemon, Uberdude
Top
 Profile  
 
Offline
 Post subject: Re: Best players by Elo in go4go database
Post #10 Posted: Thu Jul 16, 2015 9:33 am 
Gosei

Posts: 1628
Liked others: 546
Was liked: 450
Rank: senior player
GD Posts: 1000
It may be true that Japanese pros mostly play only other Japanese pros, but that must be true for pros from any country, they mostly play other pros from their own country. The number of pros who frequently play in international tournaments is very small.

Top
 Profile  
 
Offline
 Post subject: Re: Best players by Elo in go4go database
Post #11 Posted: Thu Jul 16, 2015 9:55 am 
Judan

Posts: 6727
Location: Cambridge, UK
Liked others: 436
Was liked: 3720
Rank: UK 4 dan
KGS: Uberdude 4d
OGS: Uberdude 7d
gowan wrote:
It may be true that Japanese pros mostly play only other Japanese pros, but that must be true for pros from any country, they mostly play other pros from their own country. The number of pros who frequently play in international tournaments is very small.


I think Japan is certainly more isolated than China and Korea. Quite a few of the top Korean players play in the Chinese league which is 11 rounds a year. And picking two recent international tournaments there was the China-based MLily cup, which had 253 Chinese, 79 Korean, 23 Taiwanese, and 16 Japanese players in the prelimnary tournament (http://igokisen.web.fc2.com/wr/ml.html). And the Korea-based Samsung cup preliminary (http://igokisen.web.fc2.com/wr/sc.html) had 220 Korean, 87 Chinese, 25 Japanese, and 16 Taiwanese.

Top
 Profile  
 
Offline
 Post subject: Re: Best players by Elo in go4go database
Post #12 Posted: Thu Jul 16, 2015 10:12 am 
Oza
User avatar

Posts: 2777
Location: Seattle, WA
Liked others: 251
Was liked: 549
KGS: oren
Tygem: oren740, orenl
IGS: oren
Wbaduk: oren
gowan wrote:
It may be true that Japanese pros mostly play only other Japanese pros, but that must be true for pros from any country, they mostly play other pros from their own country. The number of pros who frequently play in international tournaments is very small.


Yes, the point is if you start all pros with same elo, then Taiwan and Japan will get an equal ratings start which is obviously not true from results.

Top
 Profile  
 
Offline
 Post subject: Re: Best players by Elo in go4go database
Post #13 Posted: Fri Jul 17, 2015 2:50 pm 
Gosei
User avatar

Posts: 1744
Liked others: 704
Was liked: 288
KGS: greendemon
Tygem: greendemon
DGS: smaragdaemon
OGS: emeraldemon
Remi your website is awesome, much prettier than I can do. Any chance you could make some comparative graphs like I tried to do for Elo?

Top
 Profile  
 
Offline
 Post subject: Re: Best players by Elo in go4go database
Post #14 Posted: Fri Jul 17, 2015 4:03 pm 
Gosei
User avatar

Posts: 1744
Liked others: 704
Was liked: 288
KGS: greendemon
Tygem: greendemon
DGS: smaragdaemon
OGS: emeraldemon
Compare the ratings for Cho Chikun and Lee Changho.

Top
 Profile  
 
Offline
 Post subject: Re: Best players by Elo in go4go database
Post #15 Posted: Fri Jul 17, 2015 5:20 pm 
Lives with ko

Posts: 170
Liked others: 32
Was liked: 119
Rank: KGS 4 kyu
emeraldemon wrote:
Remi your website is awesome, much prettier than I can do. Any chance you could make some comparative graphs like I tried to do for Elo?


Thanks for your suggestion. I probably won't have time to work on the web site very soon, but I add this feature to the todo list.

Top
 Profile  
 
Offline
 Post subject: Re: Best players by Elo in go4go database
Post #16 Posted: Sat Jul 18, 2015 4:00 am 
Lives in sente

Posts: 928
Location: UK
Liked others: 72
Was liked: 480
Rank: 5 dan
KGS: macelee
Remi, well done.

A small problem - your code does not handle games with 'Void' result correctly. For example, game ID 47707 is treated as B+R in your system. Should be easy to fix.

Top
 Profile  
 
Offline
 Post subject: Re: Best players by Elo in go4go database
Post #17 Posted: Sun Jul 19, 2015 4:38 am 
Lives with ko

Posts: 170
Liked others: 32
Was liked: 119
Rank: KGS 4 kyu
macelee wrote:
Remi, well done.

A small problem - your code does not handle games with 'Void' result correctly. For example, game ID 47707 is treated as B+R in your system. Should be easy to fix.


Thanks for noting this problem. It is now fixed.

I also optimized WHR parameters. The first version was using a parameter that I optimized for KGS data. But the volatility of pro. ratings should be much lower, and the prior stronger. So the new graphs are much smoother than before. This changes the ratings significantly:
- An Jungki was 16th, and is now 91, which looks more reasonable
- Kang Dongyun was 3rd and is now 7th. His 8-win streak did not make his rating grow as much as in the previous version, thanks to the lower volatility.


This post by Rémi was liked by: Bonobo
Top
 Profile  
 
Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 17 posts ] 

All times are UTC - 8 hours [ DST ]


Who is online

Users browsing this forum: No registered users and 1 guest


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Search for:
Jump to:  
Powered by phpBB © 2000, 2002, 2005, 2007 phpBB Group