What's the best way to compute country ratings

For discussing go computing, software announcements, etc.
Post Reply
macelee
Lives in sente
Posts: 928
Joined: Mon Dec 31, 2012 1:46 pm
Rank: 5 dan
GD Posts: 0
KGS: macelee
Location: UK
Has thanked: 72 times
Been thanked: 480 times
Contact:

What's the best way to compute country ratings

Post by macelee »

Now we have pretty good ratings for individual Go players. I wonder what is the best way to assess the relative strength of countries. I am particularly interesting in the comparison between Korea and China.

The algorithm is probably a weighted average of some sort. It needs to reflect recent game results. For example, Korean guest players won 5 games and lost just 1 in last round of Chinese league. So the algorithm should show that Korea has an improved position.
pookpooi
Lives in sente
Posts: 727
Joined: Sat Aug 21, 2010 12:26 pm
GD Posts: 10
Has thanked: 44 times
Been thanked: 218 times

Re: What's the best way to compute country ratings

Post by pookpooi »

how about sum of all player's elo rating in one nation and divide it with the number of the player, like china has 10 + 10 + 10 = 30 and then /3 = 10, while japan has 6+6+6=18 and then /3 = 6, I think we can use elo's rating from goratings.org?
DrStraw
Oza
Posts: 2180
Joined: Tue Apr 27, 2010 4:09 am
Rank: AGA 5d
GD Posts: 4312
Online playing schedule: Every tenth February 29th from 20:00-20:01 (if time permits)
Location: ʍoquıɐɹ ǝɥʇ ɹǝʌo 'ǝɹǝɥʍǝɯos
Has thanked: 237 times
Been thanked: 662 times
Contact:

Re: What's the best way to compute country ratings

Post by DrStraw »

I don't think it is that simple. Which is more important to you: strength in depth, or strength at the top? If the former then a straight average does not reflect the sheer numbers of players and so underestimates; if the latter then the myriad of lower players drags it down and so underestimates but in a different way.
Still officially AGA 5d but I play so irregularly these days that I am probably only 3d or 4d over the board (but hopefully still 5d in terms of knowledge, theory and the ability to contribute).
Elom
Lives in sente
Posts: 827
Joined: Mon Aug 11, 2014 1:18 am
Rank: OGS 9kyu
GD Posts: 0
Universal go server handle: WindnWater, Elom
Location: UK
Has thanked: 568 times
Been thanked: 84 times

Re: What's the best way to compute country ratings

Post by Elom »

Couldn't you just weight each player's rating according to their ranking in the country? So that if there were 150 players, the top ranked player will have a weighting of her/his elo 150 times heavier than the lowest ranked player.
On Go proverbs:
"A fine Gotation is a diamond in the hand of a dan of wit and a pebble in the hand of a kyu" —Joseph Raux misquoted.
Elom
Lives in sente
Posts: 827
Joined: Mon Aug 11, 2014 1:18 am
Rank: OGS 9kyu
GD Posts: 0
Universal go server handle: WindnWater, Elom
Location: UK
Has thanked: 568 times
Been thanked: 84 times

Re: What's the best way to compute country ratings

Post by Elom »

On Go proverbs:
"A fine Gotation is a diamond in the hand of a dan of wit and a pebble in the hand of a kyu" —Joseph Raux misquoted.
macelee
Lives in sente
Posts: 928
Joined: Mon Dec 31, 2012 1:46 pm
Rank: 5 dan
GD Posts: 0
KGS: macelee
Location: UK
Has thanked: 72 times
Been thanked: 480 times
Contact:

Re: What's the best way to compute country ratings

Post by macelee »

Based on Elom's proposed algorithm and today's goratings data, here are the country ratings:

China: 3,250.53
Korea: 3,238.24
Japan: 3,044.74

I don't have access to goratings' full historical data, but I can perform the calculation every day and see how things change over time.

Another possibility is to give players with more games larger weight.
Bill Spight
Honinbo
Posts: 10905
Joined: Wed Apr 21, 2010 1:24 pm
Has thanked: 3651 times
Been thanked: 3373 times

Re: What's the best way to compute country ratings

Post by Bill Spight »

In such comparisons I would look first at the median rating for each group. I. e., how strong is the "average" player?

However, that's only one datum, and can be misleading. Once it seemed like the median club player in the US was 7 kyu. Today I walk into the same clubs and it seems like the median player is shodan. But that's because the 7 kyus of yore are the shodans of today. That is not a healthy sign, I think. Where are the 7 kyus of today?

Edit: Yes, I know that you are talking about pros, not amateurs.
The Adkins Principle:
At some point, doesn't thinking have to go on?
— Winona Adkins

Visualize whirled peas.

Everything with love. Stay safe.
dfan
Gosei
Posts: 1599
Joined: Wed Apr 21, 2010 8:49 am
Rank: AGA 2k Fox 3d
GD Posts: 61
KGS: dfan
Has thanked: 891 times
Been thanked: 534 times
Contact:

Re: What's the best way to compute country ratings

Post by dfan »

Bill Spight wrote:Once it seemed like the median club player in the US was 7 kyu. Today I walk into the same clubs and it seems like the median player is shodan. But that's because the 7 kyus of yore are the shodans of today. That is not a healthy sign, I think. Where are the 7 kyus of today?
I dunno, I have the opposite reaction. I feel like back in 2000 it was a big deal to be shodan, and a 4d was a demigod, capable of writing textbooks and dispensing wisdom from the skies. Today it seems like half the players around are dan-level, and they're all significantly younger than me, and 4d just means that you're really good. Of course this is just a sample size of one geographic area.

I think a lot of the 7 kyus of today pass through 7 kyu pretty quickly. I am not that surprised, given all the material that's available online these days, including videos.

But I guess I am digressing even more.
Bill Spight
Honinbo
Posts: 10905
Joined: Wed Apr 21, 2010 1:24 pm
Has thanked: 3651 times
Been thanked: 3373 times

Re: What's the best way to compute country ratings

Post by Bill Spight »

dfan wrote:
Bill Spight wrote:Once it seemed like the median club player in the US was 7 kyu. Today I walk into the same clubs and it seems like the median player is shodan. But that's because the 7 kyus of yore are the shodans of today. That is not a healthy sign, I think. Where are the 7 kyus of today?
I dunno, I have the opposite reaction. I feel like back in 2000 it was a big deal to be shodan, and a 4d was a demigod, capable of writing textbooks and dispensing wisdom from the skies. Today it seems like half the players around are dan-level, and they're all significantly younger than me,
Thanks. Glad to hear that. :D
The Adkins Principle:
At some point, doesn't thinking have to go on?
— Winona Adkins

Visualize whirled peas.

Everything with love. Stay safe.
Kirby
Honinbo
Posts: 9553
Joined: Wed Feb 24, 2010 6:04 pm
GD Posts: 0
KGS: Kirby
Tygem: 커비라고해
Has thanked: 1583 times
Been thanked: 1707 times

Re: What's the best way to compute country ratings

Post by Kirby »

Bill Spight wrote:But that's because the 7 kyus of yore are the shodans of today.
Interesting. Maybe that's motivation for me to improve...

How strong do I have to be in today's ranks (e.g. on KGS, Tygem, or with the AGA) to be a "shodan of yore"? Maybe after becoming "1d", I had less motivation, but if I have a new "1d" to aim at, that could be better motivation.
be immersed
Uberdude
Judan
Posts: 6727
Joined: Thu Nov 24, 2011 11:35 am
Rank: UK 4 dan
GD Posts: 0
KGS: Uberdude 4d
OGS: Uberdude 7d
Location: Cambridge, UK
Has thanked: 436 times
Been thanked: 3718 times

Re: What's the best way to compute country ratings

Post by Uberdude »

Kirby wrote:Maybe after becoming "1d", I had less motivation, but if I have a new "1d" to aim at, that could be better motivation.
In the traditional Korean gup ranks there were no amateur dans, so one dan meant one dan pro. Go for it Kirby!
Bill Spight
Honinbo
Posts: 10905
Joined: Wed Apr 21, 2010 1:24 pm
Has thanked: 3651 times
Been thanked: 3373 times

Re: What's the best way to compute country ratings

Post by Bill Spight »

Kirby wrote:
Bill Spight wrote:But that's because the 7 kyus of yore are the shodans of today.
Interesting. Maybe that's motivation for me to improve...

How strong do I have to be in today's ranks (e.g. on KGS, Tygem, or with the AGA) to be a "shodan of yore"?
Oh, I think that the AGA ratings have held pretty steady over the years. :) (Japanese shodan strength has dropped about two stones, I think.)

OC, there is more than one yore. When I made shodan the top amateur ranking was 6 dan. There were a handful of amateur 7 dans, but 6 dan covered a fairly wide range of ability, overlapping that of pros. My impression is that pro shodans are stronger now by one stone, maybe more.

BTW, when I said that the 7 kyus of yore are the shodans of today I meant that literally. They are the same players, who have gotten stronger. :)
The Adkins Principle:
At some point, doesn't thinking have to go on?
— Winona Adkins

Visualize whirled peas.

Everything with love. Stay safe.
Kirby
Honinbo
Posts: 9553
Joined: Wed Feb 24, 2010 6:04 pm
GD Posts: 0
KGS: Kirby
Tygem: 커비라고해
Has thanked: 1583 times
Been thanked: 1707 times

Re: What's the best way to compute country ratings

Post by Kirby »

Bill Spight wrote: BTW, when I said that the 7 kyus of yore are the shodans of today I meant that literally. They are the same players, who have gotten stronger. :)
Thanks, I misinterpreted what you meant, but it makes sense now that I reread it.
be immersed
User avatar
emeraldemon
Gosei
Posts: 1744
Joined: Sun May 02, 2010 1:33 pm
GD Posts: 0
KGS: greendemon
Tygem: greendemon
DGS: smaragdaemon
OGS: emeraldemon
Has thanked: 697 times
Been thanked: 287 times

Re: What's the best way to compute country ratings

Post by emeraldemon »

The idea of taking the average strength of all players seems very strange to me. You want a country with no weak go players? Why? How would that even happen?
mitsun
Lives in gote
Posts: 553
Joined: Fri Apr 23, 2010 10:10 pm
Rank: AGA 5 dan
GD Posts: 0
Has thanked: 61 times
Been thanked: 250 times

Re: What's the best way to compute country ratings

Post by mitsun »

Whatever the algorithm is, it should satisfy the requirement that every new go player in a country increases that country's rating.
One simple example would be sum(exp(k*rating)), summed over all players. The scale factor k determines how top-weighted you want to make the overall rating.
Post Reply