It is currently Wed May 12, 2021 7:16 am

All times are UTC - 8 hours [ DST ]




Post new topic Reply to topic  [ 140 posts ]  Go to page Previous  1 ... 3, 4, 5, 6, 7
Author Message
Offline
 Post subject: Re: KGS Ranking adjustment?
Post #121 Posted: Tue May 05, 2020 10:42 am 
Tengen

Posts: 5324
Liked others: 0
Was liked: 726
You can "justify" any rating system (such as "the rating is a constant 1900") by saying "calculates the true rating according to the rating system". Bullshit! A good rating system can be recognised by producing numbers that are meaningful from external analysis and easily understood by human perception. I have never seen either for the KGS rating system. It is nothing but a black box that works in itself and justifies itself internally claiming to reveal eternal truth for the external observer, until an admin admits nonsense by readjusting some parameters.

Top
 Profile  
 
Offline
 Post subject: Re: KGS Ranking adjustment?
Post #122 Posted: Tue May 05, 2020 3:19 pm 
Beginner

Posts: 12
Liked others: 2
Was liked: 3
Rank: KGS 2k
KGS: lodestone
Tygem: sobriety
OGS: lodestone
I don't think the peculiarity you noticed is due to the frequency at which the rank updates, I think it is due to the fact that it looks at all recent history for your previous opponents as it updates.

For instance, if I win a game against someone who is currently listed at 5kyu, but who is rapidly improving so that one week later they are up to 2kyu, the KGS rating system will treat my win as though it was against a 2kyu player instead of a 5kyu player.

That means that as my vanquished opponent's rank is improving, mine is also drifting upward along with it. That is most of the reason that rank on that server tends to drift around even when you haven't played games recently.

Top
 Profile  
 
Offline
 Post subject: Re: KGS Ranking adjustment?
Post #123 Posted: Tue May 05, 2020 6:15 pm 
Lives in sente
User avatar

Posts: 798
Liked others: 307
Was liked: 131
Rank: German 2 dan
Bullshit yourself. You just can't separate the noise from the signal mentally, and seem unable to grasp what the signal itself is saying.

KGS' ranking algorithm certainly is far from perfect, but at least it is a more plausible effort to actually estimate strength than all ELO-based systems, especially given the paucity of data. If you want to gamble for points, then it may seem off to you, but gambling for points is, in the end, incompatible with actual strength estimation.

If you don't like the mechanisms of the KGS rank meta-game, then don't play it. Ignore the rank graphs and just be content that it gives you reasonably strong opponents.

_________________
A good system naturally covers all corner cases without further effort.

Top
 Profile  
 
Offline
 Post subject: Re: KGS Ranking adjustment?
Post #124 Posted: Tue May 05, 2020 9:23 pm 
Tengen

Posts: 5324
Liked others: 0
Was liked: 726
Harleqin wrote:
KGS' ranking algorithm certainly is far from perfect, but at least it is a more plausible effort to actually estimate strength than all ELO-based systems


I find the EGF rating system (ELO) to be (far from perfect but) very much more meaningful than the KGS rating system.

Quote:
just be content that it gives you reasonably strong opponents.


Nice theory, but in practice on average it does not. Among same-ranked opponents, I get players that play between ca. 1k and 6d real world ranks.

A simple rating system, such as +0.1 ranks for a win, +0 for a jigo, -0.1 ranks for a loss, would be much better.

Top
 Profile  
 
Offline
 Post subject: Re: KGS Ranking adjustment?
Post #125 Posted: Tue May 05, 2020 11:50 pm 
Lives in sente
User avatar

Posts: 1237
Liked others: 98
Was liked: 403
RobertJasiek wrote:
Among same-ranked opponents, I get players that play between ca. 1k and 6d real world ranks.


People don't always play at the same level on the internet. The 1k wanted to play a relaxing game after a hard day's work and his baby started crying during a complex fight. The 6d was more concentrated because he wanted to recover the rank he lost the day before due to a disconnection problem.

RobertJasiek wrote:
A simple rating system, such as +0.1 ranks for a win, +0 for a jigo, -0.1 ranks for a loss, would be much better.


That's more or less the IGS ranking system. Indeed it works reasonably well and is easy to understand, the only drawback is that you need to play 20 games before you get a firm rank (without "?" at the end).

Top
 Profile  
 
Offline
 Post subject: Re: KGS Ranking adjustment?
Post #126 Posted: Wed May 06, 2020 2:24 pm 
Lives in sente
User avatar

Posts: 798
Liked others: 307
Was liked: 131
Rank: German 2 dan
That's what I meant with gambling for points.

Such a system only works reasonably well, if

- the participants are paired randomly (otherwise subpopulations emerge that have different points distributions)
- each participant continually plays a lot of games (otherwise the noise of temporarily inactive players suddenly appearing with a different actual strength leads to different frustrations)
- the mechanisms for getting new points into the system in order to represent actual strength growth match the actual strength developments (otherwise there will be rating drifts and waves, but this is totally unmeasurable anyway)

It is very implausible that these assumptions are even remotely approximated.

So, all you get is gambling for points. That's simple and good for the endorphine rush of a simple mind, but that's all it is.

_________________
A good system naturally covers all corner cases without further effort.

Top
 Profile  
 
Offline
 Post subject: Re: KGS Ranking adjustment?
Post #127 Posted: Wed May 06, 2020 5:59 pm 
Judan

Posts: 6686
Location: Cambridge, UK
Liked others: 432
Was liked: 3663
Rank: UK 4 dan
KGS: Uberdude 4d
OGS: Uberdude 7d
From some testing a while ago (few games in history, previous opponent turning rank on and off) I concluded the KGS rank recalculation is done of the order of every 10 seconds.

Top
 Profile  
 
Offline
 Post subject: Re: KGS Ranking adjustment?
Post #128 Posted: Thu May 07, 2020 9:25 am 
Tengen

Posts: 5324
Liked others: 0
Was liked: 726
Uberdude, why then are rating graphs updated only once a day?

Top
 Profile  
 
Offline
 Post subject: Re: KGS Ranking adjustment?
Post #129 Posted: Thu May 07, 2020 10:10 am 
Lives in sente
User avatar

Posts: 1237
Liked others: 98
Was liked: 403
Updating graphs every 10 seconds would use too much computing resources.

Top
 Profile  
 
Offline
 Post subject: Re: KGS Ranking adjustment?
Post #130 Posted: Thu May 07, 2020 10:22 am 
Tengen

Posts: 5324
Liked others: 0
Was liked: 726
Updating graphs (copying an already calculated rating) must require much less computing power than updating ratings (calculating rating).

Top
 Profile  
 
Offline
 Post subject: Re: KGS Ranking adjustment?
Post #131 Posted: Thu May 07, 2020 10:34 am 
Lives in sente
User avatar

Posts: 1237
Liked others: 98
Was liked: 403
Don't know.

15kB (size of a rank graph) * 20 languages * 30000 users = 9 gigabytes

do you want to update that every 10 seconds?

Top
 Profile  
 
Offline
 Post subject: Re: KGS Ranking adjustment?
Post #132 Posted: Thu May 07, 2020 10:22 pm 
Tengen

Posts: 5324
Liked others: 0
Was liked: 726
Are you suggesting that rank graphs would be distributed as pictures instead of rating numbers?! Does CGoban not generate the rank graph picture from only receiving rating numbers only when the user opens it?!

Top
 Profile  
 
Offline
 Post subject: Re: KGS Ranking adjustment?
Post #133 Posted: Thu May 07, 2020 11:19 pm 
Lives in sente
User avatar

Posts: 1237
Liked others: 98
Was liked: 403
Actually I wrongly thought that rank graphs were stored as images. The rank graph in english of a given user can be visualized on

Code:
http://gokgs.com/servlet/graph/nicknameoftheuser-en_US.png


I didn't notice the URL contains "servlet", which suggests that the image is generated at each request.

Top
 Profile  
 
Offline
 Post subject: Re: KGS Ranking adjustment?
Post #134 Posted: Fri May 08, 2020 2:29 am 
Judan

Posts: 6686
Location: Cambridge, UK
Liked others: 432
Was liked: 3663
Rank: UK 4 dan
KGS: Uberdude 4d
OGS: Uberdude 7d
RobertJasiek wrote:
Uberdude, why then are rating graphs updated only once a day?


You'd have to ask wms, but I presume a combination of pragmatism, necessity, and laziness.

Top
 Profile  
 
Offline
 Post subject: Re: KGS Ranking adjustment?
Post #135 Posted: Thu Dec 31, 2020 7:35 am 
Lives in sente
User avatar

Posts: 1237
Liked others: 98
Was liked: 403
Does anybody else feel that KGS ranks have become weaker?

I looked at the table from a 2018 survey https://idex.github.io/go-rank-survey/g ... mean-ranks and circled my current ranks.

Attachment:
Capture.JPG
Capture.JPG [ 99.58 KiB | Viewed 3027 times ]

Top
 Profile  
 
Offline
 Post subject: Re: KGS Ranking adjustment?
Post #136 Posted: Thu Dec 31, 2020 9:09 am 
Lives in gote

Posts: 410
Location: Netherlands
Liked others: 210
Was liked: 120
Rank: EGF 3d
Universal go server handle: gennan
Possibly, and OGS ranks seem to have grown tougher recently.

A very recent survey lines up OGS 4k = KGS 1k (= EGF 3k = IGS 2k = Fox 1k = Tygem 1d). Though some of the results in that table look a bit suspicious to me, like the AGA dan levels.


Attachments:
4427434be501b390029370fbeee13a9124f7da96.jpeg
4427434be501b390029370fbeee13a9124f7da96.jpeg [ 24.96 KiB | Viewed 2998 times ]
Top
 Profile  
 
Offline
 Post subject: Re: KGS Ranking adjustment?
Post #137 Posted: Thu Dec 31, 2020 9:39 am 
Lives in sente
User avatar

Posts: 1237
Liked others: 98
Was liked: 403
So the recent table shows that in the 1-5k range, KGS ranks have become about 1 stone weaker.

(And I agree that AGA 5d = EGF 6-7d is highly suspicious.)

Top
 Profile  
 
Offline
 Post subject: Re: KGS Ranking adjustment?
Post #138 Posted: Thu Jan 28, 2021 12:26 am 
Lives in sente
User avatar

Posts: 1237
Liked others: 98
Was liked: 403
The "OGS" column is now obsolete, since ranks have been adjusted. Mine has moved from 5k to 2k.


This post by jlt was liked by: gennan
Top
 Profile  
 
Offline
 Post subject: Re: KGS Ranking adjustment?
Post #139 Posted: Thu Jan 28, 2021 2:08 am 
Gosei
User avatar

Posts: 1855
Location: Ghent, Belgium
Liked others: 286
Was liked: 848
Rank: KGS 2d OGS 1d Fox 4d
KGS: Artevelde
OGS: Knotwilg
Online playing schedule: UTC 18:00 - 22:00
FWIW this anecdotal evidence. About 10 years ago I was very active on KGS and had a stable 2d ranking. In the 10 years that I have been just casually playing, I dropped down to 1d, which seems fair. Nowadays I'm playing and studying intensively again and my rank has gone up to 2d. It all feels natural and fair and not an inflationary effect. If I look at other players who have been there for more than a decade I can see most are around the same level too. We may become weaker as we age but I hope and think not to the extent of a full stone.

As reported elsewhere, I'm 1k on OGS and 4d on Fox. That again seems to make KGS fairly well calibrated. But I'm just one data point of course.

Top
 Profile  
 
Offline
 Post subject: Re: KGS Ranking adjustment?
Post #140 Posted: Thu Jan 28, 2021 5:59 am 
Lives in sente
User avatar

Posts: 1237
Liked others: 98
Was liked: 403
Apparently the ranking adjustment on OGS moved your rank to 2d, which is in line with your other ranks on go servers or in real life.

Top
 Profile  
 
Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 140 posts ]  Go to page Previous  1 ... 3, 4, 5, 6, 7

All times are UTC - 8 hours [ DST ]


Who is online

Users browsing this forum: No registered users and 1 guest


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Search for:
Jump to:  
cron
Powered by phpBB © 2000, 2002, 2005, 2007 phpBB Group