Life In 19x19 http://www.lifein19x19.com/ |
|
Realistic Go problems http://www.lifein19x19.com/viewtopic.php?f=9&t=19425 |
Page 1 of 1 |
Author: | mart900 [ Tue Mar 26, 2024 9:22 am ] |
Post subject: | Realistic Go problems |
Hi, I quite like Go but never liked tsumego, finding them tedious and too small in scope, so I've made a website with what I think to be a more rewarding and fun approach to Go problems. They are whole board positions from pro games turned into problems by AI (curated by me). It's still a work in progress but should be able to handle some traffic. I'd love to know what you all think of the concept and the quality of the problems. I assigned the initial difficulty ratings myself, and especially in the 2200+ (4d+) range they are not likely to be accurate. Some of them could be simply too difficult, but it's hard for me to judge what's too difficult for high dan players. https://realgoproblems.com/ Would appreciate any and all feedback! |
Author: | jlt [ Tue Mar 26, 2024 2:25 pm ] |
Post subject: | Re: Realistic Go problems |
Nice idea, however I don't always understand why my wrong answers are wrong and why Katago's answers are correct. Perhaps show a few followup moves? |
Author: | Knotwilg [ Tue Mar 26, 2024 2:54 pm ] |
Post subject: | Re: Realistic Go problems |
Is the concept similar to https://neuralnetgoproblems.com/ ? |
Author: | xela [ Tue Mar 26, 2024 4:13 pm ] |
Post subject: | Re: Realistic Go problems |
mart900 wrote: Would appreciate any and all feedback! The link takes me to a login page. I can't see anything else without registering. Literally nothing, it's just a black background, not even a bit of basic info about the site. I've already got more accounts on more sites than I want to keep track of. I'm not going to create another one before I've had a look around and decided if I'm interested in the content. Compare goproblems.com, tsumego-hero.com, 101weiqi.com... |
Author: | mart900 [ Wed Mar 27, 2024 4:06 am ] |
Post subject: | Re: Realistic Go problems |
jlt wrote: Nice idea, however I don't always understand why my wrong answers are wrong and why Katago's answers are correct. Perhaps show a few followup moves? I considered adding the AI variation but given the (low) amount of playouts per position it's likely to confuse the user more than help them. I will probably add a few extra moves as played in the game though, in case AI and pro played the same move (usually the case).One feature I want to add is allowing users to comment on problems and add variations, which would become visible with the solution and could help clarify things. Knotwilg wrote: Is the concept similar to Yes, though I don't know how they generated the problems. I suppose the biggest difference is the rating system, which I believe to be important because it gives users something to play for, a way to measure progress, and it allows the ratings of the problems to grow organically, which will eventually make them perfectly accurate.https://neuralnetgoproblems.com/ ? xela wrote: The link takes me to a login page. I can't see anything else without registering. Literally nothing, it's just a black background, not even a bit of basic info about the site. Fair point, I'll add a link to the about page there.
I've already got more accounts on more sites than I want to keep track of. I'm not going to create another one before I've had a look around and decided if I'm interested in the content. Compare goproblems.com, tsumego-hero.com, 101weiqi.com... |
Author: | mart900 [ Fri Mar 29, 2024 1:58 am ] |
Post subject: | Re: Realistic Go problems |
xela wrote: mart900 wrote: Would appreciate any and all feedback! The link takes me to a login page. I can't see anything else without registering. Literally nothing, it's just a black background, not even a bit of basic info about the site. I've already got more accounts on more sites than I want to keep track of. I'm not going to create another one before I've had a look around and decided if I'm interested in the content. Compare goproblems.com, tsumego-hero.com, 101weiqi.com... |
Author: | xela [ Fri Mar 29, 2024 9:14 pm ] |
Post subject: | Re: Realistic Go problems |
mart900 wrote: You can now play without registering Thanks, this is what I was looking for :-) I think the concept is promising but difficult to execute well. Please keep working on it! Some low hanging fruit (*) for the UI:
* I say that, but I know these things are often harder than they look! |
Author: | xela [ Fri Mar 29, 2024 9:24 pm ] |
Post subject: | Re: Realistic Go problems |
mart900 wrote: Knotwilg wrote: Is the concept similar to Yes, though I don't know how they generated the problems.https://neuralnetgoproblems.com/ ? The info is all there on the site. Just click the "about" button at top right. For me the big difference is that most of the positions on neuralnetgoproblems are what I think of as basic instinct problems: things you can solve based on a sense of shape or direction of play, without reading or deep positional judgement. I think realgoproblems is already covering a wider variety of problem types. This has both pros and cons. The "basic instinct" character comes from the fact that the right answer is the highest policy move in a particular neural net. This somehow captures the idea that the move is "right" based on general considerations, rather than needing to read out variations. It also means that once the right answer is on the board, you often have a sense that it feels right, rather than thinking "why would anyone want to play that move???" Two other key differences:
|
Author: | xela [ Fri Mar 29, 2024 9:37 pm ] |
Post subject: | Re: Realistic Go problems |
xela wrote: I think the concept is promising but difficult to execute well. I tried to do something similar early this year, but gave up! The biggest issue I see with https://realgoproblems.com/ in its current state is that it's a bit unsatisfying to put just a single move on the board and be told "right" or "wrong" with absolutely no explanation. I believe you plan to address this in the long term by allowing users to submit comments and variations. If you get enough users and build up the right culture, this could work well. But it's a long road... For a few weeks, when I reviewed my games with KataGo I was noting the positions where it surprised me. Then I went through the list looking for things I could post on goproblems.com. My criteria were:
Listing the other plausible attempts and refutations also caused a bit of an explosion of variations. Ultimately I discarded three quarters of my original candidate positions, and spent 30-60 minutes per problem working out the variations for what was left. Then I uploaded three of them, waited for some feedback before posting the rest, and found that goproblems.com is no longer the lively discussion forum it used to be :-/ I've just uploaded the rest of the set in their current state. Chances are there are few errors, and a few important things missing. At this stage I'm unlikely to do more. If you want to see how far I got, check out https://goproblems.com/problems/groups? ... ection=247. Hopefully https://realgoproblems.com/ can get over or around these sorts of roadbumps and go further! |
Author: | mart900 [ Sat Mar 30, 2024 2:21 am ] |
Post subject: | Re: Realistic Go problems |
Thanks so much for the thorough feedback! I added most of it to my rapidly growing todo-list. Initially there were more problems per game, so I decided against a "download SGF" feature early on. After all, users would be able to analyze the game, then go to the next problem and immediately know the answer if it's from the same game. But over time I've landed on a way to generate the problems that leads to much less problems per game (typically one or two), so it's safe to add now. I like your problem set! I considered eventually adding a way for people to submit their own problems but wasn't sure if anyone would. This has given me renewed interest in the feature. xela wrote: The biggest issue I see with https://realgoproblems.com/ in its current state is that it's a bit unsatisfying to put just a single move on the board and be told "right" or "wrong" with absolutely no explanation. I think that's right, and it's a hard problem to solve. As you mentioned, eventually I want users to be able to add comments and variations but that is a long road indeed. Something else I recently thought of and you mentioned as well is, as more users attempt the problems, "common mistakes" might emerge. And I could have KataGo have an automated look at those common mistakes and give refutations.I'm afraid that adding the recommended variations other than what was played in the game, or multiple-move refutations to these common mistakes, and doing this with any kind of confidence that the recommendation/refutation is actually correct all the way through, is simply too costly when it comes to GPU resources. But this might change in the future. |
Author: | xela [ Sat Mar 30, 2024 4:52 am ] |
Post subject: | Re: Realistic Go problems |
mart900 wrote: I'm afraid that adding the recommended variations other than what was played in the game, or multiple-move refutations to these common mistakes, and doing this with any kind of confidence that the recommendation/refutation is actually correct all the way through, is simply too costly when it comes to GPU resources. But this might change in the future. Yes, efficiency is an issue here. That's why I only made 11 problems before giving up, while you're at several hundred and counting :-) |
Page 1 of 1 | All times are UTC - 8 hours [ DST ] |
Powered by phpBB © 2000, 2002, 2005, 2007 phpBB Group http://www.phpbb.com/ |