It is currently Wed Apr 30, 2025 5:24 am

All times are UTC - 8 hours [ DST ]




Post new topic Reply to topic  [ 205 posts ]  Go to page Previous  1 ... 7, 8, 9, 10, 11  Next
Author Message
Offline
 Post subject: Re: Game programs for boards more than 19x19
Post #181 Posted: Sun Jun 30, 2024 5:18 pm 
Gosei
User avatar

Posts: 1460
Liked others: 211
Was liked: 211
25x25, KataGo (B) - Sayuri
KataGo b28-s728 playouts 5
Sayuri b20 2385k playouts 500


Attachments:
katago-sayuri.sgf [2.78 KiB]
Downloaded 391 times
katago-sayuri.gif
katago-sayuri.gif [ 48.09 KiB | Viewed 32704 times ]
Top
 Profile  
 
Offline
 Post subject: Re: Game programs for boards more than 19x19
Post #182 Posted: Sat Jul 27, 2024 5:01 am 
Gosei
User avatar

Posts: 1460
Liked others: 211
Was liked: 211
25x25, KataGo (B) - Sayuri
KataGo b28-s716 playouts 5
Sayuri b20 uec16 playouts 500


Attachments:
katago-sayuri.sgf [1.94 KiB]
Downloaded 388 times
katago-sayuri.gif
katago-sayuri.gif [ 33.22 KiB | Viewed 28339 times ]
Top
 Profile  
 
Offline
 Post subject: Re: Game programs for boards more than 19x19
Post #183 Posted: Fri Mar 21, 2025 3:22 am 
Dies in gote

Posts: 42
Liked others: 36
Was liked: 24
Rank: 1d
KGS: kace
Hi

You'll find here a 50x50 selfplay game by KataGo: enjoy!

KataGo now plays well on this board size. While there are still occasional scoring errors (particularly for boards larger than 40x40), overall performance is solid :)

I’ll share more games in the coming weeks and plan to release the model (.npz file) in the coming months.

A huge thanks to lightvector for KataGo, and for his guidance in setting up the selfplay loop for large boards!


Attachments:
50x50-SelfplayGame.sgf [101.46 KiB]
Downloaded 99 times

This post by Friday9i was liked by: And
Top
 Profile  
 
Offline
 Post subject: Re: Game programs for boards more than 19x19
Post #184 Posted: Fri Mar 21, 2025 6:34 am 
Gosei
User avatar

Posts: 1460
Liked others: 211
Was liked: 211
What a stunning surprise!!! which version of Katago are you using? Can you upload it?


This post by And was liked by: Friday9i
Top
 Profile  
 
Offline
 Post subject: Re: Game programs for boards more than 19x19
Post #185 Posted: Fri Mar 21, 2025 6:55 am 
Dies in gote

Posts: 42
Liked others: 36
Was liked: 24
Rank: 1d
KGS: kace
Important precision: it's a specific 28b KataGo model I trained for more than one year on large boards, up to 50x50, starting from the latest available kata1 (I began with the latest 18b end of 2023, then switched to 28b in 2024).
More precisions during the weekend : -)


This post by Friday9i was liked by: And
Top
 Profile  
 
Offline
 Post subject: Re: Game programs for boards more than 19x19
Post #186 Posted: Sat Mar 22, 2025 8:14 am 
Gosei
User avatar

Posts: 1460
Liked others: 211
Was liked: 211
Friday9i wrote:
Hi

You'll find here a 50x50 selfplay game by KataGo: enjoy!

KataGo now plays well on this board size. While there are still occasional scoring errors (particularly for boards larger than 40x40), overall performance is solid :)

I’ll share more games in the coming weeks and plan to release the model (.npz file) in the coming months.

A huge thanks to lightvector for KataGo, and for his guidance in setting up the selfplay loop for large boards!


Attachments:
katago selfplay.gif
katago selfplay.gif [ 226.1 KiB | Viewed 6195 times ]

This post by And was liked by: Friday9i
Top
 Profile  
 
Offline
 Post subject: Re: Game programs for boards more than 19x19
Post #187 Posted: Sun Mar 23, 2025 4:25 am 
Dies in gote

Posts: 42
Liked others: 36
Was liked: 24
Rank: 1d
KGS: kace
Some more info: this "large board" KataGo network has been trained in selfplay since late 2023. Initial training used an 18b network (based on the latest kata1 run available 18b at that time).
In September 2024, I switched to 28b and immediately noticed a significant strength boost on all board sizes, including large boards —prompting a full transition to 28b for both selfplay and training.
Again, a huge thanks to lightvector for KataGo, and for his guidance in setting up the selfplay loop for large boards!

Training Process / selfplay mix:
- Around 85% of the data from upscaled kata1 selfplay (adjusted to 50x50 tensor sizes)
- Around 15% of the data from native large-board selfplay (generated directly on 50x50 tensors)

Hardware: 3 GPUs (RTX 4090, 4080, and 3090) running continuously for over a year.

Selfplay Evolution:
- Games generated up to 29x29 in 2023.
- From early 2024: expanded to 50x50, after resolving some stability issues. Proportion of large board games was progressively increased to 32x32 → ~40x40 → 50x50, also including rectangular boards (e.g., 7x50) like kata1.

Performance Insights:
Kata1 (« the main distributed run ») Baseline:
- ≤25x25: Strong native play.
- ≤30x30: Occasional errors (e.g., premature passes/first-line moves).
- 30x30 to 40x40: Frequent errors; above 40x40 requires quasi-systemic manual supervision to avoid frequent major mistakes or refusal to play (pass).
- Note : surprisingly, kata1 natively plays quite well on “very rectangular” boards such as 7x50. So the LB-trained network is better, but not insanely better.

LB18b (Large Board 18b, from 2023 to August 2024):
- Rapid (but limited) improvement up to 29x29, slower (but much bigger) progress beyond 35x35.

LB28b (Large Board 28b):
- Trained initially using LB18b selfplay data: it outperformed LB18b on all board sizes
- Then trained natively from LB28b selfplay data.

Quantitative Results (LB28b vs k1-s7503, 400 games, 1000 visits):
- 19x19: ~25 Elo gain over k1-s7503 (boost probably due to a lower learning rate).
- 25x25: around +200 Elo.
- 29x29: around +600 Elo (395 wins, 1 draw, only 9 losses out of 405 games).
- ≥30x30: LB28b largely dominates k1-s7503.

Progress Metrics on large boards (vs earlier LB-trained networks):
LB18b (2024):
- 37x37: +400 Elo (25 visits, April 2024 → Sept 2024).
- 50x50: +700 Elo (25 visits, June 2024 → Sept 2024).
LB28b (Sept. 2024 - March 2025):
- 37x37: +150 Elo (1K visits, Sept 2024→March 2025).
- 50x50: +350 Elo with 10 visits and +900 Elo with 100 visits (398 wins, 2 losses !).

Current Limitations (LB28b):
- Scoring errors: some minor discrepancies (≤few points) on boards >37x37, some rare strong discrepancies
- Dame issues: Residual neutral points on boards mainly above 40x40.

Next Steps:
- Uploading LB28b vs kata1 29x29 games, and some 50x50 games in the coming days!
- More large-board games to follow, with a few high visits large board games.
- Releasing the network after (probably) a last training by mid-April

And attached, you'll find 8 games from the 29x29 match against kata1 at 1000 visits (with about +600 Elo, cf quantitative results above). It's a txt file that you can split in 8 different sgf files if needed.


Attachments:
B93512F09D0D26A0.txt [181.76 KiB]
Downloaded 87 times

This post by Friday9i was liked by 2 people: And, Dragon
Top
 Profile  
 
Offline
 Post subject: Re: Game programs for boards more than 19x19
Post #188 Posted: Sun Mar 23, 2025 11:14 pm 
Gosei
User avatar

Posts: 1460
Liked others: 211
Was liked: 211
is the Katago version available for download now for boards larger than 29x29 and 28b nets?

Top
 Profile  
 
Offline
 Post subject: Re: Game programs for boards more than 19x19
Post #189 Posted: Sun Mar 23, 2025 11:46 pm 
Dies in gote

Posts: 42
Liked others: 36
Was liked: 24
Rank: 1d
KGS: kace
And wrote:
is the Katago version available for download now for boards larger than 29x29 and 28b nets?

I'm using the TRT version, which works. I did not test the other versions recently, not sure anymore.
They should be "clean", but please check again before using them.
And IIRC, I compiled them for 50x50 or 51x51 board sizes.


Attachments:
KG.7z [1.79 MiB]
Downloaded 85 times


Last edited by Friday9i on Mon Mar 24, 2025 11:34 am, edited 1 time in total.

This post by Friday9i was liked by: And
Top
 Profile  
 
Offline
 Post subject: Re: Game programs for boards more than 19x19
Post #190 Posted: Mon Mar 24, 2025 2:37 am 
Gosei
User avatar

Posts: 1460
Liked others: 211
Was liked: 211
katagoOCL:


Attachments:
size.jpg
size.jpg [ 93.34 KiB | Viewed 5823 times ]
Top
 Profile  
 
Offline
 Post subject: Re: Game programs for boards more than 19x19
Post #191 Posted: Mon Mar 24, 2025 11:35 am 
Dies in gote

Posts: 42
Liked others: 36
Was liked: 24
Rank: 1d
KGS: kace
My bad, the OpenCL version was not the good one, I modified the 7zip file (and the OCL version is now called OCL50): it should work hopefully!


This post by Friday9i was liked by: And
Top
 Profile  
 
Offline
 Post subject: Re: Game programs for boards more than 19x19
Post #192 Posted: Mon Mar 24, 2025 12:57 pm 
Gosei
User avatar

Posts: 1460
Liked others: 211
Was liked: 211
thank you very much! It's working! b28-s832 on board 51 of course "at a loss" :)


This post by And was liked by: Friday9i
Top
 Profile  
 
Offline
 Post subject: Re: Game programs for boards more than 19x19
Post #193 Posted: Mon Mar 24, 2025 8:28 pm 
Gosei
User avatar

Posts: 1460
Liked others: 211
Was liked: 211
37x37 Katago - Katago, b28-s844, 200 playouts


Attachments:
37x37 28b katago-katago.gif
37x37 28b katago-katago.gif [ 95.4 KiB | Viewed 5657 times ]

This post by And was liked by: Dragon
Top
 Profile  
 
Offline
 Post subject: Re: Game programs for boards more than 19x19
Post #194 Posted: Tue Mar 25, 2025 12:21 am 
Dies in gote

Posts: 42
Liked others: 36
Was liked: 24
Rank: 1d
KGS: kace
Here is the first game I generated on a 50x50 games played with 10K visits!
It is between the two most recent networks trained on large boards (which are quite comparable in strength).


Attachments:
943D157D00BB3323.sgf [51.24 KiB]
Downloaded 79 times
Top
 Profile  
 
Offline
 Post subject: Re: Game programs for boards more than 19x19
Post #195 Posted: Tue Mar 25, 2025 3:05 pm 
Dies in gote

Posts: 42
Liked others: 36
Was liked: 24
Rank: 1d
KGS: kace
On 33x33 board, some games of KataGo's network trained on large boards vs latest standard kata1 network (kata1-s8446), with H5 and 10 times less visits :-)


Attachments:
All2.txt [241.27 KiB]
Downloaded 93 times
Top
 Profile  
 
Offline
 Post subject: Re: Game programs for boards more than 19x19
Post #196 Posted: Tue Mar 25, 2025 4:30 pm 
Gosei
User avatar

Posts: 1460
Liked others: 211
Was liked: 211
Friday9i wrote:
On 33x33 board, some games of KataGo's network trained on large boards vs latest standard kata1 network (kata1-s8446), with H5 and 10 times less visits :-)

an error with the placement of handicap stones


Attachments:
error.jpg
error.jpg [ 124.55 KiB | Viewed 5377 times ]
Top
 Profile  
 
Offline
 Post subject: Re: Game programs for boards more than 19x19
Post #197 Posted: Tue Mar 25, 2025 11:18 pm 
Dies in gote

Posts: 42
Liked others: 36
Was liked: 24
Rank: 1d
KGS: kace
It's not an error, it's a choice made by lightvector to generate more diversity in handicap games: the handicap stones are placed "randomly".

Top
 Profile  
 
Offline
 Post subject: Re: Game programs for boards more than 19x19
Post #198 Posted: Wed Mar 26, 2025 1:41 pm 
Dies in gote
User avatar

Posts: 45
Liked others: 47
Was liked: 10
Friday9i wrote:
On 33x33 board, some games of KataGo's network trained on large boards vs latest standard kata1 network (kata1-s8446), with H5 and 10 times less visits :-)

it would be interesting to play with this network. Can you upload it?

Top
 Profile  
 
Offline
 Post subject: Re: Game programs for boards more than 19x19
Post #199 Posted: Fri Mar 28, 2025 1:07 am 
Dies in gote

Posts: 42
Liked others: 36
Was liked: 24
Rank: 1d
KGS: kace
Dragon wrote:
Friday9i wrote:
On 33x33 board, some games of KataGo's network trained on large boards vs latest standard kata1 network (kata1-s8446), with H5 and 10 times less visits :-)

it would be interesting to play with this network. Can you upload it?

See above my post and the "next steps" : I'm releasing it in the coming weeks, I'm currently generating some more selfplay and will do some more training tests before releasing the best network ; -).

Top
 Profile  
 
Offline
 Post subject: Re: Game programs for boards more than 19x19
Post #200 Posted: Fri Mar 28, 2025 2:13 am 
Gosei
User avatar

Posts: 1460
Liked others: 211
Was liked: 211
27x27 Katago - Katago, b28-fd3 - b28-s844
maxPlayouts = 50


Attachments:
fd3-s844.gif
fd3-s844.gif [ 78.85 KiB | Viewed 4742 times ]
eval.jpg
eval.jpg [ 43.44 KiB | Viewed 4742 times ]
Top
 Profile  
 
Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 205 posts ]  Go to page Previous  1 ... 7, 8, 9, 10, 11  Next

All times are UTC - 8 hours [ DST ]


Who is online

Users browsing this forum: No registered users and 1 guest


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Search for:
Jump to:  
Powered by phpBB © 2000, 2002, 2005, 2007 phpBB Group