does anyone know where to download LZ ZQ elf-2, LZ ZQ elf-5 ?
https://github.com/breakwa11/GoAIRatings
LZ's progression
-
Vargo
- Lives in gote
- Posts: 337
- Joined: Sat Aug 17, 2013 5:28 am
- GD Posts: 0
- Has thanked: 22 times
- Been thanked: 97 times
Re: LZ's progression
20 game match at time parity between
LZ0.16 #204 and LZ0.16 Elfv2
1x1080, twogtp 1.5.0, 5min per side and per game.
Elfv2 wins 13-7
All games by resignation, no error, no duplicate game.
Stats :
LZ0.16 #204 and LZ0.16 Elfv2
1x1080, twogtp 1.5.0, 5min per side and per game.
Elfv2 wins 13-7
All games by resignation, no error, no duplicate game.
Stats :
-
Uberdude
- Judan
- Posts: 6727
- Joined: Thu Nov 24, 2011 11:35 am
- Rank: UK 4 dan
- GD Posts: 0
- KGS: Uberdude 4d
- OGS: Uberdude 7d
- Location: Cambridge, UK
- Has thanked: 436 times
- Been thanked: 3718 times
Re: LZ's progression
Vargo, about how many playouts per move is this? The official LZ test was 1600 each and LZ won 65%.
-
Vargo
- Lives in gote
- Posts: 337
- Joined: Sat Aug 17, 2013 5:28 am
- GD Posts: 0
- Has thanked: 22 times
- Been thanked: 97 times
Re: LZ's progression
5 min per side and per game is, in fact, ~3.5 min/game effectively used, and is ~2s/move. It's similar to -v 1600 for #204 and -v 3000 for Elfv2 , all this with 1x1080.Uberdude wrote:how many playouts per move is this?
-
Vargo
- Lives in gote
- Posts: 337
- Joined: Sat Aug 17, 2013 5:28 am
- GD Posts: 0
- Has thanked: 22 times
- Been thanked: 97 times
Re: LZ's progression
Another 10 game match between LZ0.16_#204 and LZ0.16_Elfv2 at time parity
2x1080Ti, 5 minutes per side per game (probably similar to -v 5000 for #204 and to -v 9000 for Elfv2)
twogtp 1.5.0, no pondering, komi 7.5, no duplicate game, no error.
Result : Elfv2 wins 7-3.
The games :I've used "-alternate", so, #204 is B in the even numbered games, and #204 is W for the odd numbers.
(#204 only won the games numbered 1, 3, and 6)
The command lines and the stats :
2x1080Ti, 5 minutes per side per game (probably similar to -v 5000 for #204 and to -v 9000 for Elfv2)
twogtp 1.5.0, no pondering, komi 7.5, no duplicate game, no error.
Result : Elfv2 wins 7-3.
The games :I've used "-alternate", so, #204 is B in the even numbered games, and #204 is W for the odd numbers.
(#204 only won the games numbered 1, 3, and 6)
The command lines and the stats :
Re: LZ's progression
LZ0.16_#204 vs LZ0.16_Elfv2 2x1080Ti, 3s per move:
Nothing interesting:
Total: +62-138=0
Nothing interesting:
Code: Select all
+28-72=0 (as black)
+34-66=0 (as white)
Total: +62-138=0
- Attachments
-
- 204-elfv2-stat.zip
- (5.72 KiB) Downloaded 727 times
-
Vargo
- Lives in gote
- Posts: 337
- Joined: Sat Aug 17, 2013 5:28 am
- GD Posts: 0
- Has thanked: 22 times
- Been thanked: 97 times
Re: LZ's progression
Why do you say that ? I find it very interesting, particularly considering it's 200 gamesnbc44 wrote:Nothing interesting:
! ________________________________________________________________________________________
New network #205
40 game match #205 v. Elfv2
1x1080, 5min per side and per game, no pondering, komi 7.5
Elfv2 wins 25-15 (62.5 %)
40 games :
Command lines and stats (205 is B) :
Re: LZ's progression
Vargo wrote:Why do you say that ? I find it very interesting, particularly considering it's 200 games
I suppose the test result is predetermined.
Long test now:
LZ0.16_#205 vs LZ0.16_Elfv2 - 2x1080Ti, 120s (wow!) per move, (it will be 10 games):
+1-4=0 (#205 is black)
+1-4=0 (#205 is white)
Elfv2 wins 8-2 (80 %)
P.S.
Dragon tail loss
:- Attachments
-
- elfv2-205.zip
- logs-part2
- (1.21 MiB) Downloaded 720 times
-
- 205-elfv2.zip
- logs-part1
- (1.26 MiB) Downloaded 713 times
-
- games.zip
- (10.1 KiB) Downloaded 667 times
-
Vargo
- Lives in gote
- Posts: 337
- Joined: Sat Aug 17, 2013 5:28 am
- GD Posts: 0
- Has thanked: 22 times
- Been thanked: 97 times
Re: LZ's progression
In another thread, @jlt wrote an interesting comment :
The last 40b network is #207, it's now 50 networks away from the last 15b, and 30+ networks from the last 20b.
20 game matches LZ(n) v. LZ(n-10) at time parity, 3 min/game and /side, 1x1080, komi 7.5, no pondering, LZ0.16, twogtp 1.5.0.
#207 v. #197 --> 12-8 (40b v. 40b)
#197 v. #187 --> 12-8 (40b v. 40b)
#187 v. #177 --> 15-5 (40b v. 40b)
#177 v. #167 --> 13-7 (40b v. 20b)
#167 v. #157 --> 5-15 (20b v. 15b)
And one more match : LZ(n) v. LZ(n-50)
#207 v. #157 --> 15-5 (40b v. 15b)
All games by resignation, no error, no duplicate game.
Average time was around 1.3 sec/move.
Below, the little hands point the networks #157,167,177, etc.
If someone wants the games or the stats, I'll upload them.
... I would be surprised if, for some n, LeelaZero(n) didn't beat LeelaZero(n-10) more than 50% of the time.
The last 40b network is #207, it's now 50 networks away from the last 15b, and 30+ networks from the last 20b.
20 game matches LZ(n) v. LZ(n-10) at time parity, 3 min/game and /side, 1x1080, komi 7.5, no pondering, LZ0.16, twogtp 1.5.0.
#207 v. #197 --> 12-8 (40b v. 40b)
#197 v. #187 --> 12-8 (40b v. 40b)
#187 v. #177 --> 15-5 (40b v. 40b)
#177 v. #167 --> 13-7 (40b v. 20b)
#167 v. #157 --> 5-15 (20b v. 15b)
And one more match : LZ(n) v. LZ(n-50)
#207 v. #157 --> 15-5 (40b v. 15b)
All games by resignation, no error, no duplicate game.
Average time was around 1.3 sec/move.
Below, the little hands point the networks #157,167,177, etc.
If someone wants the games or the stats, I'll upload them.
-
jlt
- Gosei
- Posts: 1786
- Joined: Wed Dec 14, 2016 3:59 am
- GD Posts: 0
- Has thanked: 185 times
- Been thanked: 495 times
Re: LZ's progression
Yes, I should have added the condition "if LZ(n) and LZ(n-10) are networks of the same size". Changing the network size introduces some discontinuity. When 20-block networks were introduced, results were disappointing, that's why the LeelaZero project shifted to 40 blocks rather quickly.
-
Vargo
- Lives in gote
- Posts: 337
- Joined: Sat Aug 17, 2013 5:28 am
- GD Posts: 0
- Has thanked: 22 times
- Been thanked: 97 times
Re: LZ's progression
You're right, 15b #157 was a turning point, and 20b #158 was weaker.
Another 20 game match (just finished, with the same parameters) :
LZ(n) v. LZ(n-49)
#207 v. #158 --> 19-1 (40b v. 20b)
Not very surprising, but still... it's hard to pretend that LZ doesn't progress anymore
Another 20 game match (just finished, with the same parameters) :
LZ(n) v. LZ(n-49)
#207 v. #158 --> 19-1 (40b v. 20b)
Not very surprising, but still... it's hard to pretend that LZ doesn't progress anymore
-
Vargo
- Lives in gote
- Posts: 337
- Joined: Sat Aug 17, 2013 5:28 am
- GD Posts: 0
- Has thanked: 22 times
- Been thanked: 97 times
Re: LZ's progression
100 game match : LZ(today) v. LZ(1 year ago)
One year ago, the best LZ network was #90 (6x128)
2 minutes per game and side, LZ0.16, twogtp 1.5.0 no pondering, komi 7.5, gpu : 1x1080
Try to guess the result
NB. Because of the "-alternate" command, #207 is always named B, even though it was W 50 times.
One year ago, the best LZ network was #90 (6x128)
2 minutes per game and side, LZ0.16, twogtp 1.5.0 no pondering, komi 7.5, gpu : 1x1080
Try to guess the result
NB. Because of the "-alternate" command, #207 is always named B, even though it was W 50 times.
-
Vargo
- Lives in gote
- Posts: 337
- Joined: Sat Aug 17, 2013 5:28 am
- GD Posts: 0
- Has thanked: 22 times
- Been thanked: 97 times
Re: LZ's progression
What's the effect of the number of visits on a given network ?
For example, what would be the score of LZ#207 --visits=801 v. LZ#207 --visits=1601 ?
I ran such a match yesterday (#207 with --visits=1, --visits=401, --visits=801, --visits=1601, --visits=3201) but... the results were inconclusive, more than half the games were duplicates
probably because #207 knows all the tricks of #207
______________________________________________________________________________
Anyway, there's a new network, #208.
20 game matches : #208 with various visits counts, and -m 40
-m 40 is used to have a bit more randomness in the first 40 moves, and so, avoid duplicate games.
twogtp 1.5.0, LZ0.16, gpu:1x1080
no duplicate game, no error.
time/move seems to scale linearly :
-v 1 : ~0 sec/move
-v 401 : ~0.8
-v 801 : ~1.5
-v 1601 : ~3
-v 3201 : ~5 to 6
Results :
If someone wants all the stats (times, lengthes, etc) , I'll upload them.
All the games :
The smallest number of visits is always B in the even numbered games (and W in the odd ones)
for example, 208_401_801-17 is game number 17 between #208 with 400 visits and # 208 with 800 visits. 400 visits is W
For example, what would be the score of LZ#207 --visits=801 v. LZ#207 --visits=1601 ?
I ran such a match yesterday (#207 with --visits=1, --visits=401, --visits=801, --visits=1601, --visits=3201) but... the results were inconclusive, more than half the games were duplicates
______________________________________________________________________________
Anyway, there's a new network, #208.
20 game matches : #208 with various visits counts, and -m 40
-m 40 is used to have a bit more randomness in the first 40 moves, and so, avoid duplicate games.
Code: Select all
gogui-twogtp -black "C:\PATH TO LZ\leelaz.exe --gtp --weights=C:\PATH TO NETWORKS\208.gz --noponder -m 40 -v yyyy" -white "C:\PATH TO LZ\leelaz.exe --gtp --weights=C:\PATH TO NETWORKS\208.gz --noponder -m 40 -v zzzz" -games 20 -sgffile XXX -auto -komi 7.5 -alternateno duplicate game, no error.
time/move seems to scale linearly :
-v 1 : ~0 sec/move
-v 401 : ~0.8
-v 801 : ~1.5
-v 1601 : ~3
-v 3201 : ~5 to 6
Results :
- 208.gif (9.4 KiB) Viewed 15526 times
If someone wants all the stats (times, lengthes, etc) , I'll upload them.
All the games :
The smallest number of visits is always B in the even numbered games (and W in the odd ones)
for example, 208_401_801-17 is game number 17 between #208 with 400 visits and # 208 with 800 visits. 400 visits is W
-
And
- Gosei
- Posts: 1464
- Joined: Tue Sep 25, 2018 10:28 am
- GD Posts: 0
- Has thanked: 212 times
- Been thanked: 215 times
Re: LZ's progression
several matches 25x25, nets received by the program https://drive.google.com/open?id=1bgkVB ... oXHUdDuqt7,
https://github.com/leela-zero/leela-zero/issues/2240, 10sec/move, cpuonly, gogui-twogtp:
LM 192x15 GX89(25x25) - LZ 40x256 #205(25x25) 25:15
LZ 192x15 f438268e(25x25) - LZ 40x256 #205(25x25) 18:22
elf v2 256x20(25x25) - LZ 40x256 #205(25x25) 17:23, black elf all parties (11) won because of the ladder
converted minigo(25x25) 000930-goliath and 000990-cormorant do not work in gogui and sabaki.
Can someone with a powerful gpu make a couple of matches?
https://github.com/leela-zero/leela-zero/issues/2240, 10sec/move, cpuonly, gogui-twogtp:
LM 192x15 GX89(25x25) - LZ 40x256 #205(25x25) 25:15
LZ 192x15 f438268e(25x25) - LZ 40x256 #205(25x25) 18:22
elf v2 256x20(25x25) - LZ 40x256 #205(25x25) 17:23, black elf all parties (11) won because of the ladder
converted minigo(25x25) 000930-goliath and 000990-cormorant do not work in gogui and sabaki.
Can someone with a powerful gpu make a couple of matches?