Ranking Systems: Have you considered TrueSkill?

[Charlie]

Have you considered using a post-modern ranking system designed specifically for online games, such as Microsoft's TrueSkill, instead of a Go-specific rank?

http://research.microsoft.com/en-us/projects/trueskill/

I recently discovered TrueSkill in the Google A.I. Challenge (Ants) that ended in December, last year. I know it isn't designed for Go so it wouldn't yield dan and kyu rankings but no existing online servers give very good dan or kyu rankings anyway. Consider KGS, for instance, with its vastly skewed ranking system. (I'm four ranks stronger on KGS than on our national system, here in South Africa)

What TrueSkill does give you is some indication of confidence.

Of course, using something like this would demand some research into handicapping against skill-differences.

Eventually, I suppose you could find some players who are ranked in real life and use their real-world ranks to seed the system and thereby assign dan and kyu ranks, too.

[topazg]

The server currently uses Glicko2, which means it already has confidence inbuilt - what advantages would TrueSkill provide?

[amnal]

Consider KGS, for instance, with its vastly skewed ranking system. (I'm four ranks stronger on KGS than on our national system, here in South Africa)

KGS' ranking system isn't intended to predict players South African rating system grades, nor is there any particular reason for it to do so.

[gurujeet]

The TrueSkill algorithm was built to also be able to assign credit to an individual in team play. This could be interesting in go if one were to think of handicap and komi as pseudo-players on a team with their own rating. The algorithm would adjust the individual's contribution while also takiing into account contributions from the 'team'. More information on the algorithm can be found here: http://research.microsoft.com/apps/pubs/default.aspx?id=67956.

The team behind the research are go players and also resposible for the AI in the XBox game The Path of Go.

- gurujeet

[daniel_the_smith]

TrueSkill would be good for rating rengo games...

[ez4u]

Have you considered using a post-modern ranking system designed specifically for online games, such as Microsoft's TrueSkill, instead of a Go-specific rank?

http://research.microsoft.com/en-us/projects/trueskill/

I recently discovered TrueSkill in the Google A.I. Challenge (Ants) that ended in December, last year. I know it isn't designed for Go so it wouldn't yield dan and kyu rankings but no existing online servers give very good dan or kyu rankings anyway. Consider KGS, for instance, with its vastly skewed ranking system. (I'm four ranks stronger on KGS than on our national system, here in South Africa)

What TrueSkill does give you is some indication of confidence.

Of course, using something like this would demand some research into handicapping against skill-differences.

Eventually, I suppose you could find some players who are ranked in real life and use their real-world ranks to seed the system and thereby assign dan and kyu ranks, too.

There is nothing new about TrueSkill. Remi Coulom used it as one of the comparison systems in his research. See the paper for his results: http://remi.coulom.free.fr/WHR/. As far as the comment on KGS, I believe you have (inadvertently perhaps) said more about the South African rating system than KGS.

[Suji]

You can't really compare your South African rank with your rank on KGS. Here's why: They have two completely different pools of players, and all a ranking is, is a comparison of how well you are playing within that pool of players.