Game programs for boards more than 19x19
-
And
- Gosei
- Posts: 1464
- Joined: Tue Sep 25, 2018 10:28 am
- GD Posts: 0
- Has thanked: 212 times
- Been thanked: 215 times
Re: Game programs for boards more than 19x19
25x25, KataGo (B) - Sayuri
KataGo b28-s728 playouts 5
Sayuri b20 2385k playouts 500
KataGo b28-s728 playouts 5
Sayuri b20 2385k playouts 500
- Attachments
-
- katago-sayuri.sgf
- (2.78 KiB) Downloaded 826 times
-
- katago-sayuri.gif (48.09 KiB) Viewed 54835 times
-
And
- Gosei
- Posts: 1464
- Joined: Tue Sep 25, 2018 10:28 am
- GD Posts: 0
- Has thanked: 212 times
- Been thanked: 215 times
Re: Game programs for boards more than 19x19
25x25, KataGo (B) - Sayuri
KataGo b28-s716 playouts 5
Sayuri b20 uec16 playouts 500
KataGo b28-s716 playouts 5
Sayuri b20 uec16 playouts 500
- Attachments
-
- katago-sayuri.sgf
- (1.94 KiB) Downloaded 814 times
-
- katago-sayuri.gif (33.22 KiB) Viewed 50470 times
-
Friday9i
- Dies in gote
- Posts: 43
- Joined: Sat Jun 17, 2017 9:36 am
- Rank: 1d
- GD Posts: 0
- KGS: kace
- Has thanked: 40 times
- Been thanked: 25 times
Re: Game programs for boards more than 19x19
Hi
You'll find here a 50x50 selfplay game by KataGo: enjoy!
KataGo now plays well on this board size. While there are still occasional scoring errors (particularly for boards larger than 40x40), overall performance is solid
I’ll share more games in the coming weeks and plan to release the model (.npz file) in the coming months.
A huge thanks to lightvector for KataGo, and for his guidance in setting up the selfplay loop for large boards!
You'll find here a 50x50 selfplay game by KataGo: enjoy!
KataGo now plays well on this board size. While there are still occasional scoring errors (particularly for boards larger than 40x40), overall performance is solid
I’ll share more games in the coming weeks and plan to release the model (.npz file) in the coming months.
A huge thanks to lightvector for KataGo, and for his guidance in setting up the selfplay loop for large boards!
- Attachments
-
- 50x50-SelfplayGame.sgf
- (101.46 KiB) Downloaded 579 times
-
Friday9i
- Dies in gote
- Posts: 43
- Joined: Sat Jun 17, 2017 9:36 am
- Rank: 1d
- GD Posts: 0
- KGS: kace
- Has thanked: 40 times
- Been thanked: 25 times
Re: Game programs for boards more than 19x19
Important precision: it's a specific 28b KataGo model I trained for more than one year on large boards, up to 50x50, starting from the latest available kata1 (I began with the latest 18b end of 2023, then switched to 28b in 2024).
More precisions during the weekend : -)
More precisions during the weekend : -)
-
And
- Gosei
- Posts: 1464
- Joined: Tue Sep 25, 2018 10:28 am
- GD Posts: 0
- Has thanked: 212 times
- Been thanked: 215 times
Re: Game programs for boards more than 19x19
Friday9i wrote:Hi
You'll find here a 50x50 selfplay game by KataGo: enjoy!
KataGo now plays well on this board size. While there are still occasional scoring errors (particularly for boards larger than 40x40), overall performance is solid
I’ll share more games in the coming weeks and plan to release the model (.npz file) in the coming months.
A huge thanks to lightvector for KataGo, and for his guidance in setting up the selfplay loop for large boards!
- Attachments
-
- katago selfplay.gif (226.1 KiB) Viewed 28326 times
-
Friday9i
- Dies in gote
- Posts: 43
- Joined: Sat Jun 17, 2017 9:36 am
- Rank: 1d
- GD Posts: 0
- KGS: kace
- Has thanked: 40 times
- Been thanked: 25 times
Re: Game programs for boards more than 19x19
Some more info: this "large board" KataGo network has been trained in selfplay since late 2023. Initial training used an 18b network (based on the latest kata1 run available 18b at that time).
In September 2024, I switched to 28b and immediately noticed a significant strength boost on all board sizes, including large boards —prompting a full transition to 28b for both selfplay and training.
Again, a huge thanks to lightvector for KataGo, and for his guidance in setting up the selfplay loop for large boards!
Training Process / selfplay mix:
- Around 85% of the data from upscaled kata1 selfplay (adjusted to 50x50 tensor sizes)
- Around 15% of the data from native large-board selfplay (generated directly on 50x50 tensors)
Hardware: 3 GPUs (RTX 4090, 4080, and 3090) running continuously for over a year.
Selfplay Evolution:
- Games generated up to 29x29 in 2023.
- From early 2024: expanded to 50x50, after resolving some stability issues. Proportion of large board games was progressively increased to 32x32 → ~40x40 → 50x50, also including rectangular boards (e.g., 7x50) like kata1.
Performance Insights:
Kata1 (« the main distributed run ») Baseline:
- ≤25x25: Strong native play.
- ≤30x30: Occasional errors (e.g., premature passes/first-line moves).
- 30x30 to 40x40: Frequent errors; above 40x40 requires quasi-systemic manual supervision to avoid frequent major mistakes or refusal to play (pass).
- Note : surprisingly, kata1 natively plays quite well on “very rectangular” boards such as 7x50. So the LB-trained network is better, but not insanely better.
LB18b (Large Board 18b, from 2023 to August 2024):
- Rapid (but limited) improvement up to 29x29, slower (but much bigger) progress beyond 35x35.
LB28b (Large Board 28b):
- Trained initially using LB18b selfplay data: it outperformed LB18b on all board sizes
- Then trained natively from LB28b selfplay data.
Quantitative Results (LB28b vs k1-s7503, 400 games, 1000 visits):
- 19x19: ~25 Elo gain over k1-s7503 (boost probably due to a lower learning rate).
- 25x25: around +200 Elo.
- 29x29: around +600 Elo (395 wins, 1 draw, only 9 losses out of 405 games).
- ≥30x30: LB28b largely dominates k1-s7503.
Progress Metrics on large boards (vs earlier LB-trained networks):
LB18b (2024):
- 37x37: +400 Elo (25 visits, April 2024 → Sept 2024).
- 50x50: +700 Elo (25 visits, June 2024 → Sept 2024).
LB28b (Sept. 2024 - March 2025):
- 37x37: +150 Elo (1K visits, Sept 2024→March 2025).
- 50x50: +350 Elo with 10 visits and +900 Elo with 100 visits (398 wins, 2 losses !).
Current Limitations (LB28b):
- Scoring errors: some minor discrepancies (≤few points) on boards >37x37, some rare strong discrepancies
- Dame issues: Residual neutral points on boards mainly above 40x40.
Next Steps:
- Uploading LB28b vs kata1 29x29 games, and some 50x50 games in the coming days!
- More large-board games to follow, with a few high visits large board games.
- Releasing the network after (probably) a last training by mid-April
And attached, you'll find 8 games from the 29x29 match against kata1 at 1000 visits (with about +600 Elo, cf quantitative results above). It's a txt file that you can split in 8 different sgf files if needed.
In September 2024, I switched to 28b and immediately noticed a significant strength boost on all board sizes, including large boards —prompting a full transition to 28b for both selfplay and training.
Again, a huge thanks to lightvector for KataGo, and for his guidance in setting up the selfplay loop for large boards!
Training Process / selfplay mix:
- Around 85% of the data from upscaled kata1 selfplay (adjusted to 50x50 tensor sizes)
- Around 15% of the data from native large-board selfplay (generated directly on 50x50 tensors)
Hardware: 3 GPUs (RTX 4090, 4080, and 3090) running continuously for over a year.
Selfplay Evolution:
- Games generated up to 29x29 in 2023.
- From early 2024: expanded to 50x50, after resolving some stability issues. Proportion of large board games was progressively increased to 32x32 → ~40x40 → 50x50, also including rectangular boards (e.g., 7x50) like kata1.
Performance Insights:
Kata1 (« the main distributed run ») Baseline:
- ≤25x25: Strong native play.
- ≤30x30: Occasional errors (e.g., premature passes/first-line moves).
- 30x30 to 40x40: Frequent errors; above 40x40 requires quasi-systemic manual supervision to avoid frequent major mistakes or refusal to play (pass).
- Note : surprisingly, kata1 natively plays quite well on “very rectangular” boards such as 7x50. So the LB-trained network is better, but not insanely better.
LB18b (Large Board 18b, from 2023 to August 2024):
- Rapid (but limited) improvement up to 29x29, slower (but much bigger) progress beyond 35x35.
LB28b (Large Board 28b):
- Trained initially using LB18b selfplay data: it outperformed LB18b on all board sizes
- Then trained natively from LB28b selfplay data.
Quantitative Results (LB28b vs k1-s7503, 400 games, 1000 visits):
- 19x19: ~25 Elo gain over k1-s7503 (boost probably due to a lower learning rate).
- 25x25: around +200 Elo.
- 29x29: around +600 Elo (395 wins, 1 draw, only 9 losses out of 405 games).
- ≥30x30: LB28b largely dominates k1-s7503.
Progress Metrics on large boards (vs earlier LB-trained networks):
LB18b (2024):
- 37x37: +400 Elo (25 visits, April 2024 → Sept 2024).
- 50x50: +700 Elo (25 visits, June 2024 → Sept 2024).
LB28b (Sept. 2024 - March 2025):
- 37x37: +150 Elo (1K visits, Sept 2024→March 2025).
- 50x50: +350 Elo with 10 visits and +900 Elo with 100 visits (398 wins, 2 losses !).
Current Limitations (LB28b):
- Scoring errors: some minor discrepancies (≤few points) on boards >37x37, some rare strong discrepancies
- Dame issues: Residual neutral points on boards mainly above 40x40.
Next Steps:
- Uploading LB28b vs kata1 29x29 games, and some 50x50 games in the coming days!
- More large-board games to follow, with a few high visits large board games.
- Releasing the network after (probably) a last training by mid-April
And attached, you'll find 8 games from the 29x29 match against kata1 at 1000 visits (with about +600 Elo, cf quantitative results above). It's a txt file that you can split in 8 different sgf files if needed.
- Attachments
-
- B93512F09D0D26A0.txt
- (181.76 KiB) Downloaded 532 times
-
Friday9i
- Dies in gote
- Posts: 43
- Joined: Sat Jun 17, 2017 9:36 am
- Rank: 1d
- GD Posts: 0
- KGS: kace
- Has thanked: 40 times
- Been thanked: 25 times
Re: Game programs for boards more than 19x19
I'm using the TRT version, which works. I did not test the other versions recently, not sure anymore.And wrote:is the Katago version available for download now for boards larger than 29x29 and 28b nets?
They should be "clean", but please check again before using them.
And IIRC, I compiled them for 50x50 or 51x51 board sizes.
- Attachments
-
- KG.7z
- (1.79 MiB) Downloaded 545 times
Last edited by Friday9i on Mon Mar 24, 2025 11:34 am, edited 1 time in total.
-
Friday9i
- Dies in gote
- Posts: 43
- Joined: Sat Jun 17, 2017 9:36 am
- Rank: 1d
- GD Posts: 0
- KGS: kace
- Has thanked: 40 times
- Been thanked: 25 times
Re: Game programs for boards more than 19x19
My bad, the OpenCL version was not the good one, I modified the 7zip file (and the OCL version is now called OCL50): it should work hopefully!
-
Friday9i
- Dies in gote
- Posts: 43
- Joined: Sat Jun 17, 2017 9:36 am
- Rank: 1d
- GD Posts: 0
- KGS: kace
- Has thanked: 40 times
- Been thanked: 25 times
Re: Game programs for boards more than 19x19
Here is the first game I generated on a 50x50 games played with 10K visits!
It is between the two most recent networks trained on large boards (which are quite comparable in strength).
It is between the two most recent networks trained on large boards (which are quite comparable in strength).
- Attachments
-
- 943D157D00BB3323.sgf
- (51.24 KiB) Downloaded 533 times
-
Friday9i
- Dies in gote
- Posts: 43
- Joined: Sat Jun 17, 2017 9:36 am
- Rank: 1d
- GD Posts: 0
- KGS: kace
- Has thanked: 40 times
- Been thanked: 25 times
Re: Game programs for boards more than 19x19
On 33x33 board, some games of KataGo's network trained on large boards vs latest standard kata1 network (kata1-s8446), with H5 and 10 times less visits 
- Attachments
-
- All2.txt
- (241.27 KiB) Downloaded 531 times