Without disagreeing with any specific element of what you are saying, Marcel, I think you are being too pessimistic.

I think we can even leave aside the probable fact that many book examples have been researched by amateurs under pro guidance which can vary from lackadaisical to attentive.

For a time I shared your pessimism. I felt it most keenly when I looked at Katsugo Shinpyo. This tesuji book had been touted by Fujisawa Hideyuki as the best thing since sliced bread, and so I chose this for my first venture into checking books with AI. The problem wasn't just finding apparent "mistakes" - you expect that anyway given the difficulty of setting up tesuji positions on a big board. It was the sheer number. I gave up part way through, not having found a single "correct" problem. It was doubly disheartening because the solutions looked correct to me!

A couple of things have changed my view. One is that looking at full games showed that pros make a HUGE number of moves that bots like. Pros genuinely are of a very, very high standard. That must include Fujisawa. So, my reasoning goes, surely he couldn't really have been wrong about KS. That didn't help much at the time, though, because I still couldn't explain the discrepancy.

The next thing that turned my view was that I kept coming across recent throw-away comments by top pros discussing their games, and the gist of these was that they knew that a move they played may not have been objectively the best but they preferred to make a move they understood. Playing move after move they way you think a bot might play is an incoherent, scattergun approach, and unless you are a Meijin you probably are wrong in most cases amyway. You quickly lose control. If you play a move you understand, you know what the follow-ups are likely to be. You retain a measure of control - and with knobs on when you are doing this against another human, and not a bot, which for a pro applies almost 100% of the time in their professional lives.

Seeing those comments also made me realise (at least so I think) what was going on with KS. I had been looking at examples of specific tesujis. What I should have been looking at was general suji. The flow of the combination. And control of the flow. KS is very, very good at that. I now think I see some of what Fujisawa saw. It was something like learning to pay one tune at a time by memorising how to plonk on a keyboard, always in the key of C. With suji, you can play in any key. And learning to play any tune any time from sheet music is like keeping control of a game. It still doesn't make you a concert pianist, of course. A busker with a monkey churning out tunes on a pianola might even play more accurately than you. But if you wanted improve your technique, would you spend a fortune on peanuts and turn to the organ grinder, or would you dig out your old book of Hanon exercises again?

And I don't think any of this glimmer of understanding of control, flow, suji or whatever is something I (and most others) would get from the present generation of bots. Bots wave flags but they don't do semaphore.

Without referring to specific positions, two thoughts:

1. Bots are stronger than pros. This does not mean their "opinion" in a position is necessarily correct over pros', only that it is more often correct than pros'. In some positions it may be the bot that is wrong.

2. What does "correct" mean? Correct in minimax sense (ie. better assuming perfect play from that position)? Or correct in strategic sense (ie. - more often than not - better in similar positions, even if - from random noise - that strategy doesn't happen to work to a meaningful result in that particular position? I think bot opinion and human opinion target different correctness...

(emphasis mine)

Hear, hear!


When the book came out, Japanese amateurs, and even this foreigner, knew that Kajiwara was creative, eccentric, and prone to overstatement.



I know from experience creating problems that the law of unintended consequences applies. You cannot assume that what you mean to illustrate actually holds in your constructed position, especially a whole board position.

_________________
The Adkins Principle:
At some point, doesn't thinking have to go on?
— Winona Adkins

Visualize whirled peas.

Everything with love. Stay safe.

Well, there are a few caveats. First, particularly in the early opening, a lot of bot plays are fairly predictable. Furthermore, it is well within the capability of pros to understand how to follow up those choices. The bot moves are not hard, just not what humans came up with.

Second, the principle of starting from where you are applies. Pros, having devoted their lives to the game, have a bank of userful knowledge, experience, and intuition. It makes no sense for them to throw all that away and try to play like a bot. As SDK, OTOH, has little to lose by trying to play like a bot. As a 2 kyu I tried to play like Go Seigen. OC, I did not come close, but I believe it helped.

Third. you do not lose control by imitation. You still search for the truth as best you can. Imitation guides your path. And if you choose a good guide, so much the better.



As lightvector and Marcel indicate, you use a bot as a tool, not a master. How many of us, coming along, could consult a pro every time we had a question? Yes, the bots do not speak, but used aright, they help us find answers to our questions.

To paraphrase the Buddha, Work out your own salvation, with the help of a bot.

_________________
The Adkins Principle:
At some point, doesn't thinking have to go on?
— Winona Adkins

Visualize whirled peas.

Everything with love. Stay safe.

Yes. Humans do tend to strive for objective optimality. Bots try to win games.

That's by design. And one reason I would like to try to train a bot on difference games. I expect that such a bot would think more like a human.

_________________
The Adkins Principle:
At some point, doesn't thinking have to go on?
— Winona Adkins

Visualize whirled peas.

Everything with love. Stay safe.

I'm not sure what "objective" mean here, but would guess it is closer to the minimax meaning of correctness, thus humans may be the less objective of the two.

And I doubt differences would change bot nature significantly. I think the fundamental difference is that - despite popular opinion - neural networks are nothing like human intuition. A NN learns (an approximation for) a complex function. Once learning is over that function can be pretty sharp, and is evaluated exactly. If you move a single stone a single step in a complicated position, NN output may change drastically (unlike human intuition, and closer to minimax truth).

A perfect player could feel similar, the limits of human strategy. Again: human wisdom is only guaranteed to be correct more often than incorrect (>50%), but bot wisdom may even be correct most of the time (>90%).

Here is what I mean by using difference games to compare plays.
https://www.lifein19x19.com/viewtopic.php?f=15&t=17082

Neural networks trained on difference games will play differently on single boards than those trained as they are today. OC, they will be weaker per training time and resources, because difference games double the size of play and because they compare moves one at a time.

_________________
The Adkins Principle:
At some point, doesn't thinking have to go on?
— Winona Adkins

Visualize whirled peas.

Everything with love. Stay safe.