New networks Leela Zero, a Sensible Artificial Intelligence
-
Vargo
- Lives in gote
- Posts: 337
- Joined: Sat Aug 17, 2013 5:28 am
- GD Posts: 0
- Has thanked: 22 times
- Been thanked: 97 times
Re: New networks Leela Zero, a Sensible Artificial Intellige
Very nice, thanks !
sai9x9 seems very strong, about as strong as katago1.2 ?
9x9 Sabaki games between katago and sai are often very close.
(here, both programs play around 2-5 sec/move)
sai9x9 can win against gnugo at H2 and H3, and even sometimes at H4 (komi 0.5)
sai9x9 seems very strong, about as strong as katago1.2 ?
9x9 Sabaki games between katago and sai are often very close.
(here, both programs play around 2-5 sec/move)
- Attachments
-
- sgh4.sgf
- (986 Bytes) Downloaded 3267 times
-
- sgh3.sgf
- (731 Bytes) Downloaded 3234 times
-
- sw1.sgf
- (1.03 KiB) Downloaded 3259 times
-
And
- Gosei
- Posts: 1464
- Joined: Tue Sep 25, 2018 10:28 am
- GD Posts: 0
- Has thanked: 212 times
- Been thanked: 215 times
Re: New networks Leela Zero, a Sensible Artificial Intellige
if I understood correctly, sai9x9 uses a network 94619dea? but the network was received on 12/21/2018? almost a year ago! but strange, I haven’t seen this network before
-
And
- Gosei
- Posts: 1464
- Joined: Tue Sep 25, 2018 10:28 am
- GD Posts: 0
- Has thanked: 212 times
- Been thanked: 215 times
Re: New networks Leela Zero, a Sensible Artificial Intellige
last network 848fe9be (10 sec/move, cpu version) http://sai.unich.it/networks/848fe9be1b ... 99fbf84.gz
against zen 7 1 dan (gtp4zen -t4 -s1800 -n1 -o1.3 -p0.35) - zen 7 surrendered on move 109
against zen 7 1 dan (gtp4zen -t4 -s1800 -n1 -o1.3 -p0.35) - zen 7 surrendered on move 109
- Attachments
-
- sai 848fe9be - zen 7.sgf
- (964 Bytes) Downloaded 911 times
-
And
- Gosei
- Posts: 1464
- Joined: Tue Sep 25, 2018 10:28 am
- GD Posts: 0
- Has thanked: 212 times
- Been thanked: 215 times
Re: New networks Leela Zero, a Sensible Artificial Intellige
last network 43268842 (10 sec/move, cpu version) http://sai.unich.it/networks/43268842e5 ... 5d364fe.gz
against ZEN 7 2 dan (gtp4zen -t4 -s2000 -n1 -o1.0 -p0.4) - SAI won +2.5 (302 moves)
20 more games SAI & ZEN - 4:16
against ZEN 7 2 dan (gtp4zen -t4 -s2000 -n1 -o1.0 -p0.4) - SAI won +2.5 (302 moves)
20 more games SAI & ZEN - 4:16
- Attachments
-
- sai 43268842 - zen 7.sgf
- (2.43 KiB) Downloaded 903 times
-
And
- Gosei
- Posts: 1464
- Joined: Tue Sep 25, 2018 10:28 am
- GD Posts: 0
- Has thanked: 212 times
- Been thanked: 215 times
Re: New networks Leela Zero, a Sensible Artificial Intellige
SAI #64 fe1cfa3c (10 sec/move, cpu version) http://sai.unich.it/networks/fe1cfa3c81 ... 95f2dfb.gz
against ZEN 7 3 dan (gtp4zen -t4 -s2200 -n2 -o2.0 -p0.45) - 2:18
zen surrendered in two games:
against ZEN 7 3 dan (gtp4zen -t4 -s2200 -n2 -o2.0 -p0.45) - 2:18
zen surrendered in two games:
- Attachments
-
- fe1cfa3c - zen 7 2.sgf
- (1.55 KiB) Downloaded 877 times
-
- fe1cfa3c - zen 7.sgf
- (1.46 KiB) Downloaded 883 times
-
Vargo
- Lives in gote
- Posts: 337
- Joined: Sat Aug 17, 2013 5:28 am
- GD Posts: 0
- Has thanked: 22 times
- Been thanked: 97 times
Re: New networks Leela Zero, a Sensible Artificial Intellige
Two more Sabaki 9x9 games Sai-Katago (both at 40000 playouts)
Maybe Katago 1.2 wins slightly more often than Sai
Maybe Katago 1.2 wins slightly more often than Sai
- Attachments
-
- saikata2.sgf
- (752 Bytes) Downloaded 3009 times
-
- saikata.sgf
- (883 Bytes) Downloaded 2983 times
-
Vargo
- Lives in gote
- Posts: 337
- Joined: Sat Aug 17, 2013 5:28 am
- GD Posts: 0
- Has thanked: 22 times
- Been thanked: 97 times
Re: New networks Leela Zero, a Sensible Artificial Intellige
Two Sabaki 9x9 games Sai-gtp4zen (40000 playouts for Sai, -T10 -s40000 for Zen)
Sai wins even games and can win H2 with komi 7.5 (but not always)
Sai wins even games and can win H2 with komi 7.5 (but not always)
- Attachments
-
- saizen_h2_k75.sgf
- (612 Bytes) Downloaded 3032 times
-
- saizen.sgf
- (998 Bytes) Downloaded 2981 times
-
frmor
- Beginner
- Posts: 3
- Joined: Tue Jun 05, 2018 1:19 pm
- Rank: 9k
- GD Posts: 0
- KGS: vandertic
- DGS: vandertic
- Has thanked: 7 times
- Been thanked: 7 times
Re: New networks Leela Zero, a Sensible Artificial Intellige
Hi, SAI main author here!
What options are you using with SAI?
Be aware at least of the following ones:
--lambda [0.5]
--mu [0]
--nrsymm
The latter is the simplest. Merge symmetrical positions in order to explore more deeply. Highly recommended when playing at fixed visits as it could give quite a lot of strength increase
lambda and mu are real parameters intended as 0<=mu<=lambda<=1. They tell SAI to consider a range of komi values when playing, instead of just the real komi of the game. If you are playing with an opponent of equal strength it is recommended to set both to 0 (notice that this is NOT the default for lambda).
If you are playing with a weaker opponent, and/or there is handicap, the default values should be ok, at least for 9x9
What options are you using with SAI?
Be aware at least of the following ones:
--lambda [0.5]
--mu [0]
--nrsymm
The latter is the simplest. Merge symmetrical positions in order to explore more deeply. Highly recommended when playing at fixed visits as it could give quite a lot of strength increase
lambda and mu are real parameters intended as 0<=mu<=lambda<=1. They tell SAI to consider a range of komi values when playing, instead of just the real komi of the game. If you are playing with an opponent of equal strength it is recommended to set both to 0 (notice that this is NOT the default for lambda).
If you are playing with a weaker opponent, and/or there is handicap, the default values should be ok, at least for 9x9
-
And
- Gosei
- Posts: 1464
- Joined: Tue Sep 25, 2018 10:28 am
- GD Posts: 0
- Has thanked: 212 times
- Been thanked: 215 times
Re: New networks Leela Zero, a Sensible Artificial Intellige
frmor, thank you so much for this project!
I correctly understood, these recommendations for the case if SAI are used to play against another program (human)?
which values are better if the opponent is stronger? and mu = 0.5 or 1 can be used, and what will it give?
I correctly understood, these recommendations for the case if SAI are used to play against another program (human)?
which values are better if the opponent is stronger? and mu = 0.5 or 1 can be used, and what will it give?
-
Vargo
- Lives in gote
- Posts: 337
- Joined: Sat Aug 17, 2013 5:28 am
- GD Posts: 0
- Has thanked: 22 times
- Been thanked: 97 times
Re: New networks Leela Zero, a Sensible Artificial Intellige
and --noponder -p 40000 --komi x.xfrmor wrote:--lambda [0.5]
--mu [0]
--nrsymm
Thank you for your detailed explanation about lambda and mu. I like SAI very much
-
frmor
- Beginner
- Posts: 3
- Joined: Tue Jun 05, 2018 1:19 pm
- Rank: 9k
- GD Posts: 0
- KGS: vandertic
- DGS: vandertic
- Has thanked: 7 times
- Been thanked: 7 times
Re: New networks Leela Zero, a Sensible Artificial Intellige
It's a bit complicated, and you should read the paper to get full details. Let us say that lambda and mu control the two sides of the interval of komi values over which the winrate is averaged.And wrote:frmor, thank you so much for this project!
I correctly understood, these recommendations for the case if SAI are used to play against another program (human)?
which values are better if the opponent is stronger? and mu = 0.5 or 1 can be used, and what will it give?
If mu=0 it means to keep the real komi as one side.
If lambda=1 it means to use, for the other side, the komi value that SAI thinks would make the current position fair (in the sense of 50% winrate).
Intermediate values are to be intended in the winrate scale, not komi scale, so that for example, if SAI thinks it is ahead, with winrate 80% and lambda=0.3, than it would compute the weighted mean 71% = 0.3 * 50% + 0.7 * 80%, look for the komi value that would give itself a 71% winrate, and then use this as the side.
So if SAI is black and real komi is 7.5, then this virtual komi value would be something more, say 9.3. Then SAI for the exploration of the current move would compute the nodes winrates as averages over the komi range [7.5 ; 9.3] and choose its move accordingly.
You can put mu=lambda>0 and in this way SAI would play as if the komi was the one computed, hence giving itself increasing score handicap when ahead. (And the opposite when behind.)
My recommendation is to use lambda=mu=0 when against a strong opponent, to try hard to win with the real komi.
You should use values larger than 0 when against a weaker opponent, both to improve the final score, when playing a fair game, and to improve the strength of play when starting with handicap.
When SAI is behind with a weaker opponent because of handicap, positive values of lambda (and maybe mu) were showed to improve its ability to recover from the initial disadvantage.
-
And
- Gosei
- Posts: 1464
- Joined: Tue Sep 25, 2018 10:28 am
- GD Posts: 0
- Has thanked: 212 times
- Been thanked: 215 times
Re: New networks Leela Zero, a Sensible Artificial Intellige
SAI #70 c74e6c7d (10 sec/move, cpu version) http://sai.unich.it/networks/c74e6c7d84 ... 2c385ee.gz
against ZEN 7 4 dan (gtp4zen -t4 -s2400 -n2 -o1.5 -p0.5) - 1:19
zen surrendered in one game:
against ZEN 7 4 dan (gtp4zen -t4 -s2400 -n2 -o1.5 -p0.5) - 1:19
zen surrendered in one game:
- Attachments
-
- sai c74e6c7d - zen 7.sgf
- (1.58 KiB) Downloaded 2887 times
-
And
- Gosei
- Posts: 1464
- Joined: Tue Sep 25, 2018 10:28 am
- GD Posts: 0
- Has thanked: 212 times
- Been thanked: 215 times
Re: New networks Leela Zero, a Sensible Artificial Intellige
SAI 3ca44219 (10 sec/move, cpu version) http://sai.unich.it/networks/3ca44219f0 ... cd19998.gz
against ZEN 7 5 dan (gtp4zen -t4 -s2700 -n2 -o1.0 -p0.55) - zen surrendered:
against ZEN 7 5 dan (gtp4zen -t4 -s2700 -n2 -o1.0 -p0.55) - zen surrendered:
- Attachments
-
- sai 3ca44219 - zen 7.sgf
- (1.41 KiB) Downloaded 2792 times