What about the komi discussion, now that KataGo is coming
-
Yakago
- Dies in gote
- Posts: 53
- Joined: Tue Jan 16, 2018 10:39 am
- GD Posts: 0
- Has thanked: 2 times
- Been thanked: 12 times
What about the komi discussion, now that KataGo is coming
I managed to make KataGo analysis work on my pc, by gathering a few bits from the github pages of katago and lizzie
Now KataGo has a 'score estimation' network, and who would have thought - the evaluation of an empty board with chinese rules and 7.5 komi is a 1.2 points advantage for white.
Someone might correct me, but from my understanding, Chinese rules with 7.5 komi is equivalent to Japanese/Korean with either 6.5 or 7.5 komi depending on who gets the last dame.
If KataGo is 'correct', does this mean that 6.5 komi chinese rules is actually more appropriate than 7.5?
Now KataGo has a 'score estimation' network, and who would have thought - the evaluation of an empty board with chinese rules and 7.5 komi is a 1.2 points advantage for white.
Someone might correct me, but from my understanding, Chinese rules with 7.5 komi is equivalent to Japanese/Korean with either 6.5 or 7.5 komi depending on who gets the last dame.
If KataGo is 'correct', does this mean that 6.5 komi chinese rules is actually more appropriate than 7.5?
- EdLee
- Honinbo
- Posts: 8859
- Joined: Sat Apr 24, 2010 6:49 pm
- GD Posts: 312
- Location: Santa Barbara, CA
- Has thanked: 349 times
- Been thanked: 2070 times
-
moha
- Lives in gote
- Posts: 311
- Joined: Wed May 31, 2017 6:49 am
- Rank: 2d
- GD Posts: 0
- Been thanked: 45 times
Re: What about the komi discussion, now that KataGo is comin
There is little difference between 5.5 and 6.5 for Chinese. I'm not sure why they switched from 5.5 to 7.5 but I guess there were some statistical reasons.
Otherwise common sense would predict 7.5 is worse: correct komi is 7 and it is better to let B win ties than W, since practical players are not close to correct/perfect play thus need slightly less komi.
Otherwise common sense would predict 7.5 is worse: correct komi is 7 and it is better to let B win ties than W, since practical players are not close to correct/perfect play thus need slightly less komi.
-
bernds
- Lives with ko
- Posts: 259
- Joined: Sun Apr 30, 2017 11:18 pm
- Rank: 2d
- GD Posts: 0
- Has thanked: 46 times
- Been thanked: 116 times
Re: What about the komi discussion, now that KataGo is comin
However - if you repeat the experiment with zero komi, it thinks Black has a 9.1 point advantage on the empty board.Yakago wrote:Now KataGo has a 'score estimation' network, and who would have thought - the evaluation of an empty board with chinese rules and 7.5 komi is a 1.2 points advantage for white.
-
gennan
- Lives in gote
- Posts: 497
- Joined: Fri Sep 22, 2017 2:08 am
- Rank: EGF 3d
- GD Posts: 0
- Universal go server handle: gennan
- Location: Netherlands
- Has thanked: 273 times
- Been thanked: 147 times
Re: What about the komi discussion, now that KataGo is comin
But if white tries to win with zero komi, he has to try risky things, which leads to greater disadvantage if black counters well. If instead of trying to win, white tries to minimize the score difference, you may get different results. I think the average score difference would be smaller.bernds wrote:However - if you repeat the experiment with zero komi, it thinks Black has a 9.1 point advantage on the empty board.Yakago wrote:Now KataGo has a 'score estimation' network, and who would have thought - the evaluation of an empty board with chinese rules and 7.5 komi is a 1.2 points advantage for white.
-
RobertJasiek
- Judan
- Posts: 6272
- Joined: Tue Apr 27, 2010 8:54 pm
- GD Posts: 0
- Been thanked: 797 times
- Contact:
Re: What about the komi discussion, now that KataGo is comin
You are wrong, see viewtopic.php?p=246387#p246387Yakago wrote:Chinese rules with 7.5 komi is equivalent to Japanese/Korean with either 6.5 or 7.5 komi
- Knotwilg
- Oza
- Posts: 2432
- Joined: Fri Jan 14, 2011 6:53 am
- Rank: KGS 2d OGS 1d Fox 4d
- GD Posts: 0
- KGS: Artevelde
- OGS: Knotwilg
- Online playing schedule: UTC 18:00 - 22:00
- Location: Ghent, Belgium
- Has thanked: 360 times
- Been thanked: 1021 times
- Contact:
Re: What about the komi discussion, now that KataGo is comin
Have more experiments been carried out? Are there more conclusive statements on fair komi by looking at LZ's probabilities or KataGo's scoring?
Re: What about the komi discussion, now that KataGo is comin
We need new and fair komi!!!Knotwilg wrote:Have more experiments been carried out? Are there more conclusive statements on fair komi by looking at LZ's probabilities or KataGo's scoring?
When I run strongest Leela on my super machine:
12944050 playouts (analysis stops every time automatically and this is detritus) = more playouts are not possible:(
Black: 43% chance to win.
White: 57% chance to win.
Or in my words to be more clear 40% vs 60% or (4/10 vs 6/10) vs (40 = 66% vs 60 = 100%).
I think your know when I mean;)
-
bayu
- Lives with ko
- Posts: 163
- Joined: Wed Jul 20, 2011 11:33 am
- GD Posts: 0
- Has thanked: 19 times
- Been thanked: 32 times
Re: What about the komi discussion, now that KataGo is comin
A single 40:60 statement isn't worth a lot in my understanding. The question is what happens if you lower the komi. If you lower the komi by one and end up with 70:30, the original komi was a fairer one.
I don't think it is possible to achieve 50:50 winning chance anyway. And the stronger the bots get the more skewed will be the winning chances on the empty board. The question is, what komi leads to the least skewed winning chances. It will depend on the ruleset, and I expect that button go will turn out to be the optimal solution.
I don't think it is possible to achieve 50:50 winning chance anyway. And the stronger the bots get the more skewed will be the winning chances on the empty board. The question is, what komi leads to the least skewed winning chances. It will depend on the ruleset, and I expect that button go will turn out to be the optimal solution.
If something sank it might be a treasure. And 2kyu advice is not necessarily Dan repertoire..
-
Bill Spight
- Honinbo
- Posts: 10905
- Joined: Wed Apr 21, 2010 1:24 pm
- Has thanked: 3651 times
- Been thanked: 3373 times
Re: What about the komi discussion, now that KataGo is comin
Back in 1977 (if I remember the date correctly) the American Go Journal published an article that claimed, based upon statistics published by the Nihon Kiin of 1400 recent pro games at 4½ pt. komi and 1400 at 5½ pt. komi or 5 pt. komi with White winning jigo, that the correct komi is 7. Terry Benson sent me the article to review before publication, along with the data. For each set of 1400 games the komi which came closest to a 50:50 split was 6½ pts. As I recall, the percentage difference in wins for a one pt. difference in komi around a 6½ pt. komi was less than 3%, That proved to be enough of a winrate difference for the Japanese to raise komi to 6½ pts., but it took them more than 25 years to do so. 
The Adkins Principle:
At some point, doesn't thinking have to go on?
— Winona Adkins
Visualize whirled peas.
Everything with love. Stay safe.
At some point, doesn't thinking have to go on?
— Winona Adkins
Visualize whirled peas.
Everything with love. Stay safe.
-
Bill Spight
- Honinbo
- Posts: 10905
- Joined: Wed Apr 21, 2010 1:24 pm
- Has thanked: 3651 times
- Been thanked: 3373 times
Re: What about the komi discussion, now that KataGo is comin
What happens with a 9½ pt. komi?goame wrote:We need new and fair komi!!!Knotwilg wrote:Have more experiments been carried out? Are there more conclusive statements on fair komi by looking at LZ's probabilities or KataGo's scoring?
When I run strongest Leela on my super machine:
12944050 playouts (analysis stops every time automatically and this is detritus) = more playouts are not possible:(
Black: 43% chance to win.
White: 57% chance to win.
Or in my words to be more clear 40% vs 60% or (4/10 vs 6/10) vs (40 = 66% vs 60 = 100%).
I think your know when I mean;)
The Adkins Principle:
At some point, doesn't thinking have to go on?
— Winona Adkins
Visualize whirled peas.
Everything with love. Stay safe.
At some point, doesn't thinking have to go on?
— Winona Adkins
Visualize whirled peas.
Everything with love. Stay safe.
-
luigi
- Lives in gote
- Posts: 352
- Joined: Wed Jul 06, 2011 12:01 pm
- Rank: Low
- GD Posts: 0
- Location: Spain
- Has thanked: 181 times
- Been thanked: 41 times
Re: What about the komi discussion, now that KataGo is comin
AlphaZero confirms this. In the 1000-game match between AlphaZero and AlphaGo Zero, White won 57.6% of the time, as reported by DeepMind.goame wrote:We need new and fair komi!!!
When I run strongest Leela on my super machine:
12944050 playouts (analysis stops every time automatically and this is detritus) = more playouts are not possible:(
Black: 43% chance to win.
White: 57% chance to win.
Or in my words to be more clear 40% vs 60% or (4/10 vs 6/10) vs (40 = 66% vs 60 = 100%).
I think your know when I mean;)
(However, there must be a slight mistake in their numbers. For example, they say AlphaZero won 68.9% of its games as White, but that would mean 344.5 games out of 500. Where does the half game come from? They don't report any drawn games, and supposedly superko was used. Same thing with AlphaZero's games as Black. The decimal place in the percentages should be an even number.)
Re: What about the komi discussion, now that KataGo is comin
With fractional komi the strongest bots will always show skewed winrates. That unfair half point does matter at high levels.
- Knotwilg
- Oza
- Posts: 2432
- Joined: Fri Jan 14, 2011 6:53 am
- Rank: KGS 2d OGS 1d Fox 4d
- GD Posts: 0
- KGS: Artevelde
- OGS: Knotwilg
- Online playing schedule: UTC 18:00 - 22:00
- Location: Ghent, Belgium
- Has thanked: 360 times
- Been thanked: 1021 times
- Contact:
Re: What about the komi discussion, now that KataGo is comin
I don't think that makes a difference at all. Why would it be more likely that 7,5 results in skewed winrates than 7?jann wrote:With fractional komi the strongest bots will always show skewed winrates. That unfair half point does matter at high levels.
Suppose that a komi of 7 gives Black 55% and a komi of 8 gives 45%. Isn't it then to be expected that a komi of 7,5 will give 50%?
Re: What about the komi discussion, now that KataGo is comin
Because top bots are within a few stones to perfect play (which gives 50% with integer komi). In any case, as bots gets stronger, any komi flaws will get amplified towards 100% or 0%.Knotwilg wrote:Why would it be more likely that 7,5 results in skewed winrates than 7?
This doesn't seem likely at today's bot levels already. Actually, hard to imagine at any level.Suppose that a komi of 7 gives Black 55%