It is currently Thu Mar 28, 2024 10:33 am

All times are UTC - 8 hours [ DST ]




Post new topic Reply to topic  [ 20 posts ] 
Author Message
Offline
 Post subject: Are we getting better?
Post #1 Posted: Fri Nov 26, 2021 9:05 am 
Beginner

Posts: 5
Liked others: 0
Was liked: 0
Hi All

My first post here.
I have been thinking recently about how effective the modern go learning tools and the bar set by AI such as alpha go are in increasing our skills. I can easily see how tools like KaTrain with their strong engine and the metrics help me progress very quickly, but I wonder if this value of AI support is reflected in the top limits of human capacities.

Have recent years seen any substantial leap forward of the top professionals? Whether yes or no, what measures do you find the most reliable evidence for that?

Top
 Profile  
 
Offline
 Post subject: Re: Are we getting better?
Post #2 Posted: Tue Dec 07, 2021 5:26 am 
Lives in gote

Posts: 532
Liked others: 27
Was liked: 142
KGS: pajaro
IGS: pajaro
I think the answer has to be yes.

Not considering AI, the global knowledge and experience is always increasing. People learn from their games, but also from others. The same person in different historical times would have different learning chances. Hopefully, the later you are born, the better. This is also true for any other field of knowledge.

With AI, the research for new moves, new analysis... is faster. Josekis take very short to be accepted, mistakes are found even in high level games, and there is more room to improve.

How would a top player today do against a top player of 20 years ago? The top player today would have the advantage. But of course, that doesn't mean that any player would win against an opponent from the past and lose against an opponent from the future. Individual talent matters.

Top
 Profile  
 
Offline
 Post subject: Re: Are we getting better?
Post #3 Posted: Tue Dec 07, 2021 6:26 am 
Lives in sente

Posts: 905
Liked others: 22
Was liked: 168
Rank: panda 5 dan
IGS: kvasir
When you study game records from the past it is evident that even top players didn't always have the right understanding and when presented with new moves they often played moves that are not the best in hindsight. You can find many such examples in the opening and in joseki.

There are also examples of new (and better) strategies. In games before the 20th century it was usual to play every big point in the opening before challenging the opponent in the middle game. They followed a rough guideline of how big these moves are compered to each other, this is really useful to learn by heart, but modern players never play like this and tend to push much harder to challenge the opponent early in the game. It is largely the same knowledge that underpins their play but the strategy is different.

The general skill level and knowledge also seems to have increased steadily through the 20th century. Analysis has also become much more objective. I have observed that some "old" josekis appear to really just be what was played in some famous game, maybe there was a special reason why it is very good in that game, and sometimes they seem to be accepted for a long time without anyone questioning it. In later half of the 20th century, maybe because of more volume of published books and magazines, the analysis seems to become much more objective. Maybe a larger number of recognized "strong" players is the primary cause for better analyzes, it is easy to dismiss opinions in any human activity because the are not from the right person.

With the new AI programs it is much easier to analyze objectively. Many positions and moves that we hardly knew how to judge can now be analyzed by anyone. There are certainly many skills that we can learn using programs like KaTrain but were not accessible for us before because it was too difficult before to test our understanding and skills.

I think it must be the case that modern players are overall better than in the past but it is an unfair comparison. Still some players from the past were very good, even in hindsight and despite whatever the shortcomings of the past, would be among top tournament contenders if they arrived today in a time machine.

Top
 Profile  
 
Offline
 Post subject: Re: Are we getting better?
Post #4 Posted: Tue Dec 07, 2021 6:56 am 
Gosei
User avatar

Posts: 1753
Liked others: 177
Was liked: 491
Take a player from the past and give him 3 days to study new josekis and review a few modern games. Would he play worse than modern players?

Top
 Profile  
 
Offline
 Post subject: Re: Are we getting better?
Post #5 Posted: Tue Dec 07, 2021 5:30 pm 
Oza
User avatar

Posts: 2408
Location: Ghent, Belgium
Liked others: 359
Was liked: 1019
Rank: KGS 2d OGS 1d Fox 4d
KGS: Artevelde
OGS: Knotwilg
Online playing schedule: UTC 18:00 - 22:00
I don't think the original question was if past players were intrinsically better or worse than modern ones. It's precisely the availability of knowledge that has increased the overall level. For me it's a yes. I'm as studious as ever before and I have trouble keeping my rank.

Top
 Profile  
 
Offline
 Post subject: Re: Are we getting better?
Post #6 Posted: Tue Dec 07, 2021 7:42 pm 
Beginner

Posts: 5
Liked others: 0
Was liked: 0
Naturally, there is progress in knowledge, strategies and methods of learning. Old strategies prove obsolete in the face of new ones - that is a given in all areas of human endeavor actually. Even if Einstein would shine among our contemporaries, most of them would outshine his contemporaries.

What I am after is 1) whether humans have got significantly more adept, say, from pre-AlphaGo to AlphaGo Zero. Thus, much shorter time span than a century, and human 'curve of development' in sync with that of AI.

2) Some statistical tools to make such progress measurable would be useful but would require an objective point/scale of reference, so happy to leave this part out for now.
Without it we are left to our collective subjective experience though so a more general question boils down to 3) is AI in the avant-garde yet (meaning are the best humans learning more from AI than from one another) and 4) does having such models make human players more ingenious or just more skillful.

Top
 Profile  
 
Offline
 Post subject: Re: Are we getting better?
Post #7 Posted: Wed Dec 08, 2021 12:22 am 
Judan

Posts: 6087
Liked others: 0
Was liked: 786
kvasir: "Analysis has also become much more objective.": Yes, where application of mathematical theorems allow objectivity.

"With the new AI programs it is much easier to analyze objectively.": No, because AI can make mistakes. Analysis with AI need not be objective. The advantage is rather that using AI allows to find more blunders, which human beings might have overlooked.

Knowledge of go theory increases and more people have access to AI as another tool; this can make everybody stronger. At the same time, thinking times decrease resulting in more blunders (as I have also observed), less tactical reading and less endgame evaluation; this can make everybody weaker.

It boils down to opinion whether the overall level has increased in the last decades. It is easier to justify improvement over centuries because opening knowledge was significantly weaker in early centuries. Circa five centuries ago, the overall knowledge of go theory was weak compared to today.

Concerning my own experience as a 5 dan since 1998, my knowledge has increased dramatically since then and the 5 dan I was in 1998 would have no chance against the 5 dan I am today. So I think European dan play must have improved significantly since then. I just cannot say exactly how many ranks in terms of 1998 ranks. Might be 0.5 or 1.5 ranks - I do not know which. When comparing the skills of 3 dan opponents then and now, I think it is closer to 1.5 ranks overall improvement. When comparing the skills of 5 dan opponents, judgement is much harder because I might be prejudiced too much. When seeing the improvement of top Europeans, 1.5 ranks is realistic but does that boil down 1:1 to 6d and 5d players, too? I am unsure. At least 0.5 ranks for sure, but it could be more.

I would not suspect the same level of improvement since 1998 of top Asian professionals for the reasons further above though.

Top
 Profile  
 
Offline
 Post subject: Re: Are we getting better?
Post #8 Posted: Wed Dec 08, 2021 5:22 am 
Gosei
User avatar

Posts: 1753
Liked others: 177
Was liked: 491
Assuming 5 dan in 1998 = 4 dan in 2021, this doesn't prove that 2021 players are stronger than in 1998. Maybe there has been rank deflation. You need to examine the rank distribution before drawing conclusions.

Top
 Profile  
 
Offline
 Post subject: Re: Are we getting better?
Post #9 Posted: Wed Dec 08, 2021 5:43 am 
Judan

Posts: 6087
Liked others: 0
Was liked: 786
My judgement is independent of rating systems and only depends on my subjective assessment of quality of play and knowledge then versus now.

Top
 Profile  
 
Offline
 Post subject: Re: Are we getting better?
Post #10 Posted: Wed Dec 08, 2021 6:34 am 
Oza

Posts: 3647
Liked others: 20
Was liked: 4626
Quote:
My judgement is independent of rating systems and only depends on my subjective assessment of quality of play and knowledge then versus now.


Knowing you have greater knowledge now may affective your subjective assessment of quality (the old "if only I knew then what I know now" syndrome).

But in general, it is likely that we all underestimate how the effects of age creep up on you - tiredness, less concentration, less caring about the result, more cares in the rest of daily life, more blunders, more decrepitude. And we also tend to underestimate how early all this begins. Look at Yi Ch'ang-ho. He was not even 40 when he went off the boil. Yet I bet he knows more about go now than when he was a world-beating teenager.

But knowledge acquisition itself is a two-edged sword, anyway. All the new knowledge you soak up can knock useful old knowledge to the bottom of the pile, can play havoc with your intuition.

Remember, too, the old chestnut: an expert is someone who knows more and more about less and less. My own view is that there is a good chance that there is no modern writer demonstrably better than Shakespeare or Murasaki Shikibu, say, or no modern painter better than da Vinci or Rembrandt, or better musician than Mozart or Beethoven - but there are many modern people in those fields who are more knowledgeable ("hey, I can even tell you about literary theory, how to use acrylic paints, how to make music with a midi synthesiser" etc). The modern need to become "experts" leads people down narrow culs-de-sac. They may be Top Cat there, but will never match Renaissance Cat.

Quality tends to outdo quantity when we evaluate things,

Top
 Profile  
 
Offline
 Post subject: Re: Are we getting better?
Post #11 Posted: Wed Dec 08, 2021 7:30 am 
Judan

Posts: 6087
Liked others: 0
Was liked: 786
I am aware of the possible impact of age but do not think that it (already) affects me significantly.

tiredness, less concentration, less caring about the result, decrepitude - no

more cares in the rest of daily life - yes but hardly while playing

more blunders - no, instead less blunders

can knock useful old knowledge to the bottom of the pile - in my case, I replace less useful by more useful knowledge

intuition - in 1998, I still played some moves under ordinary thinking time solely due to guessing; since ca. 15 years, I play all moves under sufficient thinking time due to reasoning

"an expert is someone who knows more and more about less and less": Although there may be such experts, I am not such. Instead, I know more and more about a) more generally applicable knowledge and b) more details about related or other topics. I love generalisation but if necessary I also describe the details.

Top
 Profile  
 
Offline
 Post subject: Re: Are we getting better?
Post #12 Posted: Wed Dec 08, 2021 7:59 am 
Oza
User avatar

Posts: 2408
Location: Ghent, Belgium
Liked others: 359
Was liked: 1019
Rank: KGS 2d OGS 1d Fox 4d
KGS: Artevelde
OGS: Knotwilg
Online playing schedule: UTC 18:00 - 22:00
John Fairbairn wrote:
(...)

Remember, too, the old chestnut: an expert is someone who knows more and more about less and less. My own view is that there is a good chance that there is no modern writer demonstrably better than Shakespeare or Murasaki Shikibu, say, or no modern painter better than da Vinci or Rembrandt, or better musician than Mozart or Beethoven - but there are many modern people in those fields who are more knowledgeable ("hey, I can even tell you about literary theory, how to use acrylic paints, how to make music with a midi synthesiser" etc). The modern need to become "experts" leads people down narrow culs-de-sac. They may be Top Cat there, but will never match Renaissance Cat.

Quality tends to outdo quantity when we evaluate things,


I often wonder where the 21st century Leonardo da Vinci is. Or, given today's accessibility of knowledge, tools and people, how on Earth did da Vinci do it back then? There are tons of uneducated guesses I can make about it. The "perversion of specialization" which you hint at (I think) is one explanation. With total access comes abundance, is one of mine. And another is that science and arts have been democratized to a degree that it is comparatively harder for the elite to cross-pollinate.

Top
 Profile  
 
Offline
 Post subject: Re: Are we getting better?
Post #13 Posted: Wed Dec 08, 2021 8:04 am 
Gosei
User avatar

Posts: 1753
Liked others: 177
Was liked: 491
John Fairbairn wrote:
But in general, it is likely that we all underestimate how the effects of age creep up on you - tiredness, less concentration, less caring about the result, more cares in the rest of daily life, more blunders, more decrepitude. And we also tend to underestimate how early all this begins. Look at Yi Ch'ang-ho. He was not even 40 when he went off the boil. Yet I bet he knows more about go now than when he was a world-beating teenager.


On the other hand, Sakata Eio, Rin Kaiho, Cho Chikun managed to win big titles after the age of 50.

Top
 Profile  
 
Offline
 Post subject: Re: Are we getting better?
Post #14 Posted: Wed Dec 08, 2021 1:58 pm 
Lives in gote

Posts: 476
Location: Netherlands
Liked others: 270
Was liked: 147
Rank: EGF 3d
Universal go server handle: gennan
RobertJasiek wrote:
It boils down to opinion whether the overall level has increased in the last decades. It is easier to justify improvement over centuries because opening knowledge was significantly weaker in early centuries. Circa five centuries ago, the overall knowledge of go theory was weak compared to today.

If a Japanese Edo period 7p would time-travel to today, there would be a knowledge gap. But I think strong pros of today may not be able to give more than josen handicap, maybe less if the classical pro is allowed some time to catch up with their knowledge.

RobertJasiek wrote:
Concerning my own experience as a 5 dan since 1998, my knowledge has increased dramatically since then and the 5 dan I was in 1998 would have no chance against the 5 dan I am today. So I think European dan play must have improved significantly since then. I just cannot say exactly how many ranks in terms of 1998 ranks. Might be 0.5 or 1.5 ranks - I do not know which. When comparing the skills of 3 dan opponents then and now, I think it is closer to 1.5 ranks overall improvement. When comparing the skills of 5 dan opponents, judgement is much harder because I might be prejudiced too much. When seeing the improvement of top Europeans, 1.5 ranks is realistic but does that boil down 1:1 to 6d and 5d players, too? I am unsure. At least 0.5 ranks for sure, but it could be more.

I also believe that EGF ranks have slowly grown tougher over the decades (even after the recent EGF rating system udpate that softened EGF ranks a bit).

There is a Dutch player who was a strong 5d around 1980, while having a hard time keeping an EGF 4d rating today (even though he kept studying and playing competitively during the past 40 years). He estimates that he can give a 2 stone handicap to his old self from 40 years ago.

As for myself, it was not that exceptional for me to beat 5-6d players in tournaments between 10 and 20 years ago. But I don't have a chance against today's players rated 5-6d EGF. Even though I'm pretty convinced that since then, my reading has improved significantly and my game has become more balanced.

But it's possible that I'm deluding myself, not noticing the effects of ageing and other factors that slowly reduced my competitive abilities. And maybe the variation in strength of 5-6d players has shrunk over time, because today's players are more prone to demote if they feel that their results are below par for too long.

Top
 Profile  
 
Offline
 Post subject: Re: Are we getting better?
Post #15 Posted: Wed Dec 08, 2021 2:20 pm 
Gosei

Posts: 1625
Liked others: 542
Was liked: 450
Rank: senior player
GD Posts: 1000
I think the original post referred to the population rather than any particular individual. Some of the great old players won major titles after the age of fifty but even
then it was rare enough to be remarkable. Consider how much attention used to be paid studying games of players from the 19th century whereas now there seems to be little study of the games of twentieth century players.

I venture to say that some standard patterns understood in the 1970's (e.g. Avalanche, Taisha) would perplex twenty first century young hotshots. Of course the top programs would not be fooled.

Top
 Profile  
 
Offline
 Post subject: Re: Are we getting better?
Post #16 Posted: Thu Dec 09, 2021 7:06 am 
Lives in sente

Posts: 905
Liked others: 22
Was liked: 168
Rank: panda 5 dan
IGS: kvasir
RobertJasiek wrote:
kvasir: "Analysis has also become much more objective.": Yes, where application of mathematical theorems allow objectivity.


That is a very narrow view if you use the normal meaning of 'objectivity' but it could be reasonable if you are thinking in terms of philosophy and philosophy of science. Not sure if it can be considered reasonable even in philosophy of science. What I mean is if I analyze a joseki, you analyze the same joskei and a third person does the same. Now we all agree, does it really matter if it is ultimately only our opinion. Obviously it is possible to be very thorough, even play multiple trial games, ask others opinions and so forth; there are degrees of objectivity. It may just be the human experience that we can't fathom everything, but still we take what we can have.

RobertJasiek wrote:
"With the new AI programs it is much easier to analyze objectively.": No, because AI can make mistakes. Analysis with AI need not be objective. The advantage is rather that using AI allows to find more blunders, which human beings might have overlooked.


It is true that the programs do make mistakes and sometimes the point estimates of errors is suspiciously close to counting the immediate point difference of two moves as if nothing else matters. I think I have also seen a few cases were KataGo was off by a 0.5 point at the end of the game. You can still use the programs to speed up your analysis, the program corrects most errors quickly and you can play out sequences and use basic tewari principles to test for impossible results. Though, you are right in that the main usefulness is in quickly finding blunders (and also small errors). It would take hours to analyze games in the same detail that I can do in couple of minutes with my new laptop and it would take months to analyze a single game in the same detail that my new laptop can do in 20-30 minutes and one wouldn't really be able to do either without making many mistakes. There just wouldn't be any time to learn from it. Such tools are much more useful than I thought they would be and I have really only recently been realizing what this could do for my game, if I can really learn so much because the learning tools might out pace the student now.

RobertJasiek wrote:
Concerning my own experience as a 5 dan since 1998, my knowledge has increased dramatically since then and the 5 dan I was in 1998 would have no chance against the 5 dan I am today. So I think European dan play must have improved significantly since then. I just cannot say exactly how many ranks in terms of 1998 ranks. Might be 0.5 or 1.5 ranks - I do not know which. When comparing the skills of 3 dan opponents then and now, I think it is closer to 1.5 ranks overall improvement. When comparing the skills of 5 dan opponents, judgement is much harder because I might be prejudiced too much. When seeing the improvement of top Europeans, 1.5 ranks is realistic but does that boil down 1:1 to 6d and 5d players, too? I am unsure. At least 0.5 ranks for sure, but it could be more.

I would not suspect the same level of improvement since 1998 of top Asian professionals for the reasons further above though.


I have heard many similar antidotes. Norway comes to mind because with few new dan players through out the years everyone that improves ends up robbing rating points from their friend, later their friend improves and takes back the rating points and everyone is exactly where they started.

What I find interesting is that we have rating deflation but games like chess have rating inflation.

Top
 Profile  
 
Offline
 Post subject: Re: Are we getting better?
Post #17 Posted: Fri Dec 24, 2021 12:57 pm 
Beginner

Posts: 5
Liked others: 0
Was liked: 0
An interesting commentary by one of the co-creators of AlphaGo & Zero: https://www.youtube.com/watch?v=WXHFqTvfFSw

I was unaware Zero did not actually play with any top-ranked human at least officially. If people do not really have access to zero, my original question loses validity; it was the tabula rasa, self-reinforcing approach that I think would bring human playing to new levels.

At the same time, it might disrupt the culture, steal the spirit of the game.
If it finds out some part of the playing heritage less relevant than its totally synthetic creations, I can easily imagine how this could broaden the human horizons on the one hand and make top humans retire, as was the case with Lee Sedol.

Top
 Profile  
 
Offline
 Post subject: Re: Are we getting better?
Post #18 Posted: Fri Dec 24, 2021 7:40 pm 
Gosei

Posts: 1625
Liked others: 542
Was liked: 450
Rank: senior player
GD Posts: 1000
It might be that some players have given up the game after it became clear that AI can be stronger than any current human player. I've said elsewhere that whether humans can't defeat AI players is really irrelevant. Human runners can't run a mile is less than three minutes and AI controlled self-driving cars would be able to go one mile in two minutes. Does this somehow disparage human capability?

Top
 Profile  
 
Offline
 Post subject: Re: Are we getting better?
Post #19 Posted: Sat Dec 25, 2021 5:37 am 
Beginner

Posts: 5
Liked others: 0
Was liked: 0
I agree with the running analogy to a point. If it should turn out that the AI breakthroughs to come might turn the knowledge of go upside-down, as already hinted at with reference to 'some' classic moves and strategies in that video,
1) new generations of go geniuses might dominate the human go world with new, synthetic strategies. Note that on several occasions when AG played totally out of the blue but successfully, Lee Sedol was disconcerted as he lost the capacity to draw from his arsenal of strategies. It was broadly commented that he was not playing 'his game' (I forget the original wording). What mattered was that the best human player on Earth seemed unprepared for this type of eventuality - he did not understand what was happening.
2) if the breakthroughs to come are numerous and huge - and I am aware this is a condition, but I think we all agree, go is way deeper than what has been explored - it might be that those top talents who have a 'subscription' to the newest engines will have an advantage comparable, to get back to your metaphor, to sprinters having high-tech leg implants.

Top
 Profile  
 
Offline
 Post subject: Re: Are we getting better?
Post #20 Posted: Sun Dec 26, 2021 1:01 am 
Judan

Posts: 6087
Liked others: 0
Was liked: 786
TOTAL wrote:
If it should turn out that the AI breakthroughs to come might turn the knowledge of go upside-down


Maybe partially but not all the knowledge of go theory! There is go theory established as mathematical theorems, which already state the absolute truth within the, sometimes powerful, scope of their presuppositions and can, in principle, never be improved. See e.g. http://home.snafu.de/jasiek/GoTheoryResearch.html

Top
 Profile  
 
Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 20 posts ] 

All times are UTC - 8 hours [ DST ]


Who is online

Users browsing this forum: Bing [Bot], Google [Bot] and 1 guest


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Search for:
Jump to:  
Powered by phpBB © 2000, 2002, 2005, 2007 phpBB Group