It is currently Sat May 03, 2025 7:38 am

All times are UTC - 8 hours [ DST ]




Post new topic Reply to topic  [ 97 posts ]  Go to page Previous  1, 2, 3, 4, 5
Author Message
Offline
 Post subject: Re: Entry Grade
Post #81 Posted: Tue Feb 01, 2011 6:47 am 
Lives in sente
User avatar

Posts: 921
Liked others: 401
Was liked: 164
Rank: German 2 dan
mohsart wrote:
And lastly, couldn't the formula be changed to compensate for this?


You would need to measure the individual effects in order to compensate them. Most of them are not measurable in practice, however.

Personally, I believe that some sort of Whole History Rating would be a much better model than anything ELO-derived.

_________________
A good system naturally covers all corner cases without further effort.


This post by Harleqin was liked by: topazg
Top
 Profile  
 
Offline
 Post subject: Re: Entry Grade
Post #82 Posted: Tue Feb 01, 2011 7:00 am 
Gosei
User avatar

Posts: 2011
Location: Groningen, NL
Liked others: 202
Was liked: 1087
Rank: Dutch 4D
GD Posts: 645
Universal go server handle: herminator
mohsart wrote:
HermanHiddema wrote:
Furthermore, GoR as a system tends to drift over time. It tries to compensate for this by the epsilon parameter in the formula, but the correct value depends on the number of tournaments that go into the system. And since that number of tournaments is different per country and per player, the epsilon currently is at best an average.

This is interesting.
In what direction would the drifting go for a player if
S/he plays a lot of tournaments vs very few (and what is the average number?)
Her/his country organizes many tournaments vs very few (and again, what is the average?)

And lastly, couldn't the formula be changed to compensate for this?

/Mats


Imagine an isolated group of 1 kyus, somewhere in the middle of nowhere, all at rating 2000. They don't visit tournaments, but every week they have a tournament amongst themselves and send the result to the EGD. Since they form a closed system, no rating points from outside enter the system. The epsilon parameter, meant to compensate for deflation, does however enter points into their system. Over time, their average rating will drift upwards. (This is not unreasonable, as presumably they get stronger from playing those round robins).

Now imagine the same group of 1 kyus, but instead of a weekly round robin, they just play over the internet (doesn't count for the rating). Once per year they play a real over the board tournament together and send the result to the EGD. With only one entry into the database, they will hardly drift at all.

From this example, we can conclude that playing more tournaments results in more rating movement upwards.

Of course real life is not that simple, and there are other factors at work, such as rating resets, new players entering the system, old players leaving the system, etc.

In general, we might expect:

  • Players from countries with fewer tournaments will tend to be underrated.
  • Players from countries with many new players entering will tend to be underrated.
  • Players from countries which do not allow rating resets will tend to be underrated.

And, of course, the opposite will also hold:

  • Players from countries with many tournaments will tend to be overrated.
  • Players from countries with no new players entering will tend to be overrated.
  • Players from countries which use rating resets often will tend to be overrated.

Since each country has different combinations of these factors, it is very hard to pinpoint which countries are under or overrated by how much.

To compensate for this behavior, you might use a per person factor determining the reliability of their rating. That's what the AGA ratings do with their Sigma, and also what a rating system like Glicko does.


This post by HermanHiddema was liked by 3 people: Harleqin, richardamullens, topazg
Top
 Profile  
 
Offline
 Post subject: Re: Entry Grade
Post #83 Posted: Tue Feb 01, 2011 7:40 am 
Lives with ko
User avatar

Posts: 209
Location: Blekinge, Sweden
Liked others: 2
Was liked: 38
Rank: Swedish 3 kyu
Thanks HermanHiddema for the clarification.

/Mats

_________________
mohsart - games & books
http://spel.mohsart.se/

Top
 Profile  
 
Offline
 Post subject: Re: Entry Grade
Post #84 Posted: Tue Feb 01, 2011 7:51 am 
Tengen
User avatar

Posts: 4511
Location: Chatteris, UK
Liked others: 1589
Was liked: 656
Rank: Nebulous
GD Posts: 918
KGS: topazg
WHL, Glicko, Glicko2, Maximum Likelihood would all, IMHO, be a really nice improvement to a system that has to rely on data as sparse as 6 games per year for accurately rating people.

Top
 Profile  
 
Offline
 Post subject: Re: Entry Grade
Post #85 Posted: Tue Feb 01, 2011 9:21 am 
Dies with sente

Posts: 93
Location: Europe
Liked others: 87
Was liked: 20
Rank: kgs 5 kyu
KGS: cockroach, hobosaurus
topazg wrote:
WHL, Glicko, Glicko2, Maximum Likelihood would all, IMHO, be a really nice improvement to a system that has to rely on data as sparse as 6 games per year for accurately rating people.


Organise a twice yearly 3 day 8 round residential Chatteris tournament with cheap booze or a camp site week long summer event by a pub on the Norfolk broads with the option to frolic in the water.

Then you can get an accurate GoR :)

Top
 Profile  
 
Offline
 Post subject: Re: Entry Grade
Post #86 Posted: Tue Feb 01, 2011 9:26 am 
Tengen
User avatar

Posts: 4511
Location: Chatteris, UK
Liked others: 1589
Was liked: 656
Rank: Nebulous
GD Posts: 918
KGS: topazg
richardamullens wrote:
topazg wrote:
WHL, Glicko, Glicko2, Maximum Likelihood would all, IMHO, be a really nice improvement to a system that has to rely on data as sparse as 6 games per year for accurately rating people.


Organise a twice yearly 3 day 8 round residential Chatteris tournament with cheap booze or a camp site week long summer event by a pub on the Norfolk broads with the option to frolic in the water.

Then you can get an accurate GoR :)


Sheesh, that sounds really fun actually :P

Top
 Profile  
 
Offline
 Post subject: Re: Entry Grade
Post #87 Posted: Sun Feb 06, 2011 1:42 pm 
Lives with ko

Posts: 293
Liked others: 10
Was liked: 41
Since it was conceived, GoR has not been updated. It will take more than arguments pointing out that a better system can be designed to change that.
I added some data to the bottom of this page that are vaguely relevant to this thread
http://senseis.xmp.net/?EGFRatingPerRank

Top
 Profile  
 
Offline
 Post subject: Re: Entry Grade
Post #88 Posted: Tue Feb 08, 2011 5:18 am 
Lives in sente

Posts: 774
Liked others: 137
Was liked: 155
I thought epsilon was changed, as Javaness noted some time ago...

However, I would like to see the dutch system (for dan players) explained here. Maybe, it is a viable alternative to rating magic.

Top
 Profile  
 
Offline
 Post subject: Re: Entry Grade
Post #89 Posted: Tue Feb 08, 2011 6:31 am 
Gosei
User avatar

Posts: 2011
Location: Groningen, NL
Liked others: 202
Was liked: 1087
Rank: Dutch 4D
GD Posts: 645
Universal go server handle: herminator
tapir wrote:
I thought epsilon was changed, as Javaness noted some time ago...

However, I would like to see the dutch system (for dan players) explained here. Maybe, it is a viable alternative to rating magic.


There is a short explanation at SL's EuropeanRanks already, but I'll give an answer here as well:

Promotions for dan grades are regulated by the Dutch Go Association via a "Promotion Committee". This committee consists of three people, who award promotions based on a player's tournament results.

To get promoted to X dan, the most important criterion is:
  • Score at least about 50% against other X dan in serious even games, over a sufficient number of games.
The "sufficient" here depends on the grade you're trying to get: higher grades require more games (something like 8+4*X games to get X dan, I think).

If this criterion is met, then there are two additional criteria that come into play:

  • Score about 67% against players 1 rank weaker than X dan.
  • Score about 33% against players 1 ranks stronger than X dan (at least 1 win required).

The above three criteria can, additionally, compensate a bit for each other.
For example: If you have ca. 60% against X dan, that could compensate for getting only ca. 25% against X+1 dan.

Very strong results can also lower the "sufficient" number of games in the first criterion. Personal example: I was promoted to 4d with a result of 8 wins, 3 losses against other 4 dan. Normally something like 12-12 is required.

For edge cases, there are several additional fuzzy factors:
  • How did the player do against players 2 or more ranks higher than X?
  • How old is the player, and how long has he been his current rank?
  • Did the results include foreign players? Are they from a country known to be weak/strong? How is their rating?
  • Do we like the player's hair style? What is his shoe size? Is today a thursday? ;)

This can be a pretty fuzzy system, and in the end it is the decision of the committee, and we trust their expertise. There are rarely complaints.

I don't think it's really a viable alternative for a European wide system though :)

Top
 Profile  
 
Offline
 Post subject: Re: Entry Grade
Post #90 Posted: Tue Feb 08, 2011 6:46 am 
Lives in gote
User avatar

Posts: 476
Liked others: 193
Was liked: 83
Rank: Dutch 2 dan
GD Posts: 56
KGS: hopjesvla
Nice explanation Herman! Did you ever ask if they're looking for a new third member now that Ad is inactive? You seem to be the perfect candidate ;)

_________________
My name is Gijs, from Utrecht, NL.

When in doubt, play the most aggressive move

Top
 Profile  
 
Offline
 Post subject: Re: Entry Grade
Post #91 Posted: Tue Feb 08, 2011 6:59 am 
Tengen
User avatar

Posts: 4511
Location: Chatteris, UK
Liked others: 1589
Was liked: 656
Rank: Nebulous
GD Posts: 918
KGS: topazg
Sounds like a very good system to me. Thanks very much Herman!

Top
 Profile  
 
Offline
 Post subject: Re: Entry Grade
Post #92 Posted: Wed Feb 09, 2011 3:20 am 
Dies with sente

Posts: 112
Liked others: 9
Was liked: 23
HermanHiddema wrote:
There is a short explanation at SL's EuropeanRanks already


I've corrected the links for the old BGA promotions committee there - it is http://www.britgo.org/history/gradcomm.html. The points system was created by Andrew Daly and was in operation for about 25-30 years.

Top
 Profile  
 
Offline
 Post subject: Re: Entry Grade
Post #93 Posted: Wed Feb 09, 2011 8:06 am 
Lives in sente
User avatar

Posts: 844
Liked others: 180
Was liked: 151
Rank: 3d
GD Posts: 422
KGS: komi
HermanHiddema wrote:
Promotions for dan grades are regulated by the Dutch Go Association via a "Promotion Committee".


Interesting system, I like it. What about demotion?

Top
 Profile  
 
Offline
 Post subject: Re: Entry Grade
Post #94 Posted: Wed Feb 09, 2011 8:55 am 
Lives in gote
User avatar

Posts: 476
Liked others: 193
Was liked: 83
Rank: Dutch 2 dan
GD Posts: 56
KGS: hopjesvla
quantumf wrote:
HermanHiddema wrote:
Promotions for dan grades are regulated by the Dutch Go Association via a "Promotion Committee".


Interesting system, I like it. What about demotion?

In practice, demotion only happens if a player asks for that himself. The nice thing about this system is that a dan grade becomes somehow a nice "title" (promotion norms are relatively strict). The downside is, of course, that there are a few (usually older) players that have been underperforming for their grade for many years. I think this is not so bad though, because many players apply for demotion anyway after a sufficient number of bad results.

_________________
My name is Gijs, from Utrecht, NL.

When in doubt, play the most aggressive move

Top
 Profile  
 
Offline
 Post subject: Re: Entry Grade
Post #95 Posted: Wed Feb 09, 2011 1:10 pm 
Lives in sente

Posts: 774
Liked others: 137
Was liked: 155
Sankyu Herman. Nice system, but probably suitable for limited populations only. (Most European countries are small enough, however.)

I've also read about the finnish system... it seems to be awfully complicated and I wonder how many players are really promoted that way? I.e. why do they wait so long for tournaments to get promoted, when basically the local club can do it by itself irrespective of tournament results and GoR?

Top
 Profile  
 
Offline
 Post subject: Re: Entry Grade
Post #96 Posted: Wed Feb 09, 2011 2:41 pm 
Lives with ko

Posts: 293
Liked others: 10
Was liked: 41
tapir wrote:
I thought epsilon was changed, as Javaness noted some time ago...

However, I would like to see the dutch system (for dan players) explained here. Maybe, it is a viable alternative to rating magic.


Actually I guess the first change was the introduction of tournament classes, after that initial change everything stayed the same. If you suggested a change, you were told that it would involve changing something. Then, yes, after 10 years along came a small change to one of the parameters. Since that changed the average rating of a shodan has been crawling upwards instead of downwards..

Top
 Profile  
 
Offline
 Post subject: Re: Entry Grade
Post #97 Posted: Wed Feb 09, 2011 3:24 pm 
Lives in sente

Posts: 774
Liked others: 137
Was liked: 155
Javaness wrote:
Actually I guess the first change was the introduction of tournament classes, after that initial change everything stayed the same. If you suggested a change, you were told that it would involve changing something. Then, yes, after 10 years along came a small change to one of the parameters. Since that changed the average rating of a shodan has been crawling upwards instead of downwards..


Isn't that fine, in about 30 years everything will be aligned to rating math again. :)

In the meantime we can comfort ourselves with the knowledge that self ranking is better in predicting results than rating anyway (acc. to andre engels case study for dutch kyu players). In countries with more emphasis on "earned" ranks, we will probably see that their ranks are not very predictive for the results at all.

Top
 Profile  
 
Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 97 posts ]  Go to page Previous  1, 2, 3, 4, 5

All times are UTC - 8 hours [ DST ]


Who is online

Users browsing this forum: No registered users and 1 guest


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Search for:
Jump to:  
Powered by phpBB © 2000, 2002, 2005, 2007 phpBB Group