It is currently Thu Oct 31, 2024 5:31 pm

All times are UTC - 8 hours [ DST ]




Post new topic Reply to topic  [ 7 posts ] 
Author Message
Offline
 Post subject: Ranking Systems: Have you considered TrueSkill?
Post #1 Posted: Thu Feb 09, 2012 7:46 am 
Lives in gote
User avatar

Posts: 310
Location: Deutschland
Liked others: 272
Was liked: 126
Rank: EGF 4 kyu
Have you considered using a post-modern ranking system designed specifically for online games, such as Microsoft's TrueSkill, instead of a Go-specific rank?

http://research.microsoft.com/en-us/projects/trueskill/

I recently discovered TrueSkill in the Google A.I. Challenge (Ants) that ended in December, last year. I know it isn't designed for Go so it wouldn't yield dan and kyu rankings but no existing online servers give very good dan or kyu rankings anyway. Consider KGS, for instance, with its vastly skewed ranking system. (I'm four ranks stronger on KGS than on our national system, here in South Africa)

What TrueSkill does give you is some indication of confidence.

Of course, using something like this would demand some research into handicapping against skill-differences.

Eventually, I suppose you could find some players who are ranked in real life and use their real-world ranks to seed the system and thereby assign dan and kyu ranks, too.

Top
 Profile  
 
Offline
 Post subject: Re: Ranking Systems: Have you considered TrueSkill?
Post #2 Posted: Thu Feb 09, 2012 7:54 am 
Tengen
User avatar

Posts: 4511
Location: Chatteris, UK
Liked others: 1589
Was liked: 656
Rank: Nebulous
GD Posts: 918
KGS: topazg
The server currently uses Glicko2, which means it already has confidence inbuilt - what advantages would TrueSkill provide?

Top
 Profile  
 
Offline
 Post subject: Re: Ranking Systems: Have you considered TrueSkill?
Post #3 Posted: Thu Feb 09, 2012 9:17 am 
Lives in gote

Posts: 589
Liked others: 0
Was liked: 114
Rank: 2 dan
Quote:
Consider KGS, for instance, with its vastly skewed ranking system. (I'm four ranks stronger on KGS than on our national system, here in South Africa)


KGS' ranking system isn't intended to predict players South African rating system grades, nor is there any particular reason for it to do so.

Top
 Profile  
 
Offline
 Post subject: Re: Ranking Systems: Have you considered TrueSkill?
Post #4 Posted: Thu Feb 09, 2012 9:44 am 
Dies in gote

Posts: 52
Location: Chevy Chase, MD
Liked others: 0
Was liked: 8
Rank: AGA 7K
KGS: gurujeet
DGS: gfromdc
The TrueSkill algorithm was built to also be able to assign credit to an individual in team play. This could be interesting in go if one were to think of handicap and komi as pseudo-players on a team with their own rating. The algorithm would adjust the individual's contribution while also takiing into account contributions from the 'team'. More information on the algorithm can be found here: http://research.microsoft.com/apps/pubs/default.aspx?id=67956.

The team behind the research are go players and also resposible for the AI in the XBox game The Path of Go.

- gurujeet

Top
 Profile  
 
Offline
 Post subject: Re: Ranking Systems: Have you considered TrueSkill?
Post #5 Posted: Thu Feb 09, 2012 10:35 am 
Gosei
User avatar

Posts: 2116
Location: Silicon Valley
Liked others: 152
Was liked: 330
Rank: 2d AGA
GD Posts: 1193
KGS: lavalamp
Tygem: imapenguin
IGS: lavalamp
OGS: daniel_the_smith
TrueSkill would be good for rating rengo games... :)

_________________
That which can be destroyed by the truth should be.
--
My (sadly neglected, but not forgotten) project: http://dailyjoseki.com


This post by daniel_the_smith was liked by: yoyoma
Top
 Profile  
 
Offline
 Post subject: Re: Ranking Systems: Have you considered TrueSkill?
Post #6 Posted: Thu Feb 09, 2012 4:10 pm 
Oza
User avatar

Posts: 2408
Location: Tokyo, Japan
Liked others: 2346
Was liked: 1332
Rank: Jp 6 dan
KGS: ez4u
Charlie wrote:
Have you considered using a post-modern ranking system designed specifically for online games, such as Microsoft's TrueSkill, instead of a Go-specific rank?

http://research.microsoft.com/en-us/projects/trueskill/

I recently discovered TrueSkill in the Google A.I. Challenge (Ants) that ended in December, last year. I know it isn't designed for Go so it wouldn't yield dan and kyu rankings but no existing online servers give very good dan or kyu rankings anyway. Consider KGS, for instance, with its vastly skewed ranking system. (I'm four ranks stronger on KGS than on our national system, here in South Africa)

What TrueSkill does give you is some indication of confidence.

Of course, using something like this would demand some research into handicapping against skill-differences.

Eventually, I suppose you could find some players who are ranked in real life and use their real-world ranks to seed the system and thereby assign dan and kyu ranks, too.

There is nothing new about TrueSkill. Remi Coulom used it as one of the comparison systems in his research. See the paper for his results: http://remi.coulom.free.fr/WHR/. As far as the comment on KGS, I believe you have (inadvertently perhaps) said more about the South African rating system than KGS. :blackeye:

_________________
Dave Sigaty
"Short-lived are both the praiser and the praised, and rememberer and the remembered..."
- Marcus Aurelius; Meditations, VIII 21

Top
 Profile  
 
Offline
 Post subject: Re: Ranking Systems: Have you considered TrueSkill?
Post #7 Posted: Mon Feb 20, 2012 11:06 pm 
Lives in gote

Posts: 302
Liked others: 70
Was liked: 8
Rank: DDK
KGS: Sujisan 12 kyu
OGS: Sujisan 13 kyu
You can't really compare your South African rank with your rank on KGS. Here's why: They have two completely different pools of players, and all a ranking is, is a comparison of how well you are playing within that pool of players.

_________________
My plan to become an SDK is here.

Top
 Profile  
 
Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 7 posts ] 

All times are UTC - 8 hours [ DST ]


Who is online

Users browsing this forum: No registered users and 1 guest


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Search for:
Jump to:  
Powered by phpBB © 2000, 2002, 2005, 2007 phpBB Group