It is currently Wed Apr 24, 2024 4:54 pm

All times are UTC - 8 hours [ DST ]




Post new topic Reply to topic  [ 11 posts ] 
Author Message
Offline
 Post subject: KataGo does not show influence
Post #1 Posted: Sat Dec 14, 2019 6:20 am 
Judan

Posts: 6160
Liked others: 0
Was liked: 788
In Deutsche Go-Zeitung 5/2019 on page 19 in the article "AI Sensei goes KataGo" is a diagram on KataGo with "influence".

However, it is NOT influence, which - according to my definitions of this strategic concept - represents (existing or expected) connection status, (existing or expected) life status and (expected) territory of the players or their (existing or playable) stones. It is also not distance (to live stones).

Rather, the black and white square markings in the diagram seem to be something else: for sampled scoring positions (and in the meaning of expected values), the represented concept seems to be EXPECTED CONTROL of each intersection by black or white two-eye-alive-formations (or independent life formations that can be transformed into such) comprising their stones and two single point eyes. (I cannot know how KataGo interprets sekis but this detail is immaterial for the fundamental understanding of what is represented at all.)

It cannot be 'current control' because the shades of the markings do not correspond to such. However, as empirical 'expected control' they do. Near 50% expected values, there are no (perceivable) shades. The shades are partially lighter where nearer to 3-3 under 4-4 than they are somewhat off the corner. A possible shoulder reduction including some counter-attack expected by the program can be recognised. All these are manifestations of expected control - not, however, of current control or even of influence.

Therefore, KataGo itself, its applying-programmer-users and end users should not mislead the, or other, go players (or themselves) by the disinformation "influence". Instead, the should use the apparently correct information "expected control" and name / refer to the concept accordingly. At least, the markings are more useful than the fake influences in the meaning of measures of distances by old programs a couple of decades ago. The narkings are, however, by far not as useful as real influence is.

Top
 Profile  
 
Offline
 Post subject: Re: KataGo does not show influence
Post #2 Posted: Sat Dec 14, 2019 6:38 am 
Honinbo

Posts: 10905
Liked others: 3651
Was liked: 3374
I agree that influence, however defined, is a static concept which is independent of who has the move. Projected territory or area at the end of the game is different.

_________________
The Adkins Principle:
At some point, doesn't thinking have to go on?
— Winona Adkins

Visualize whirled peas.

Everything with love. Stay safe.

Top
 Profile  
 
Offline
 Post subject: Re: KataGo does not show influence
Post #3 Posted: Sun Dec 15, 2019 8:08 am 
Gosei

Posts: 1590
Liked others: 886
Was liked: 528
Rank: AGA 3k Fox 3d
GD Posts: 61
KGS: dfan
KataGo does not call this "influence". It is referred to in the documentation as "predicted final ownership".


This post by dfan was liked by 2 people: Bill Spight, wineandgolover
Top
 Profile  
 
Offline
 Post subject: Re: KataGo does not show influence
Post #4 Posted: Sun Dec 15, 2019 9:57 am 
Judan

Posts: 6160
Liked others: 0
Was liked: 788
Good!

So I have identified correctly what is shown from thoroughly studying just one diagram.

The problem then is one of some users of KataGo calling its markings "influence". I have seen this mistake several times but never before seen them using the correct description.

Top
 Profile  
 
Offline
 Post subject: Re: KataGo does not show influence
Post #5 Posted: Sun Dec 15, 2019 10:32 am 
Gosei

Posts: 1733
Location: Earth
Liked others: 621
Was liked: 310
Quote:
KataGo does not call this "influence". It is referred to in the documentation as "predicted final ownership".


And because it estimates predicted final ownership quite accuratly it is able to give a rather good POINTS estimate as well :lol:

Top
 Profile  
 
Offline
 Post subject: Re: KataGo does not show influence
Post #6 Posted: Sun Dec 15, 2019 12:24 pm 
Judan

Posts: 6160
Liked others: 0
Was liked: 788
Gomoto, how does KataGo predict final ownership quite accuratly? Every variation can result in different ownerships. KataGo may predict empirical final ownership with KataGo's sampled variations accurately and therefore estimate points well. Predicting final ownership of specific intersections differs from predicting empirical final ownership!

Having not used KataGo yet, I wonder what kind of points does KataGo estimate: a) current territory but not points outside safe territory regions or b) an empirical estimation from sampling many variations and their resulting scores? How reliable is the points estimate and possibly why could we know the degree of reliability?

Top
 Profile  
 
Offline
 Post subject: Re: KataGo does not show influence
Post #7 Posted: Sun Dec 15, 2019 1:15 pm 
Gosei

Posts: 1733
Location: Earth
Liked others: 621
Was liked: 310
Robert, this was just meant to be a fun remark with regard to the other thread about points.

From reviewing many games with KataGo, I know that KataGo gives a good estimate in the later phases of the game, when you can play out the variations and check. In the earlier phases I have just a good feeling about the KataGo score points to compare different plays (I simply trust KataGo).

I am sure that you use the word "accurate" much more strictly than my fun remark implied.

Top
 Profile  
 
Offline
 Post subject: Re: KataGo does not show influence
Post #8 Posted: Sun Dec 15, 2019 1:25 pm 
Gosei

Posts: 1590
Liked others: 886
Was liked: 528
Rank: AGA 3k Fox 3d
GD Posts: 61
KGS: dfan
RobertJasiek wrote:
Having not used KataGo yet, I wonder what kind of points does KataGo estimate: a) current territory but not points outside safe territory regions or b) an empirical estimation from sampling many variations and their resulting scores? How reliable is the points estimate and possibly why could we know the degree of reliability?

Basically b), if I understand you correctly. It tries to predict the probability of final ownership of every location on the board just as it tries to predict the probability of the final win/loss result of the game. These predictions are of course much more accurate for safe territory.

Top
 Profile  
 
Offline
 Post subject: Re: KataGo does not show influence
Post #9 Posted: Sun Dec 15, 2019 1:38 pm 
Honinbo

Posts: 10905
Liked others: 3651
Was liked: 3374
In any event, KataGo's estimate of the final score difference should be much more accurate than its estimate of the final ownership of any point. :)

_________________
The Adkins Principle:
At some point, doesn't thinking have to go on?
— Winona Adkins

Visualize whirled peas.

Everything with love. Stay safe.

Top
 Profile  
 
Offline
 Post subject: Re: KataGo does not show influence
Post #10 Posted: Sun Dec 15, 2019 5:35 pm 
Lives in sente

Posts: 757
Liked others: 114
Was liked: 916
Rank: maybe 2d
Yeah, I consistently in the code (variable names, comments) and documentation always refer to it as a prediction of ownership. I don't know what exactly to do about if some users that I've never interacted with still call it "influence". :)

The prediction of ownership is separate from the prediction of win/loss or score. It's the same neural network, so it can uses what it learns about predicting one of them to help also predict the other, but they are not guaranteed to be mutually consistent.

(Thought experiment: consider if you asked a top human pro to give you a numeric probability for their belief of the ownership of each point in the board one by one, in total 361 different values. And consider if you then could wave a magic wand so that they entirely forgot you had asked them that and you then asked them to predict either the final score or the number of extra komi points they think would make the game into a fair game. Do you think that the sum of their 361 ownership predictions would be exactly equal to either their score or lead-in-komi-points predictions? Probably not.)


This post by lightvector was liked by 3 people: Bonobo, Gomoto, xela
Top
 Profile  
 
Offline
 Post subject: Re: KataGo does not show influence
Post #11 Posted: Mon Dec 16, 2019 12:42 am 
Lives in gote

Posts: 586
Location: Adelaide, South Australia
Liked others: 208
Was liked: 265
Rank: Australian 2 dan
GD Posts: 200
I'm finding the predicted ownership useful from a positional judgement perspective, regardless of whether or not it might have any connection with "score". Often when I look at positional judgement problems in books, I get the wrong answer because I misjudge the strength or weakness of groups. I'll choose a move that defends a "weak" group, then read in the commentary that tenuki was OK because the group had a defensive resource that I overlooked. Or I'll abandon a "strong" group only to learn that it was much more vulnerable to attack than I thought.

KataGo's predicted ownership will tell me things like:
  • In about a quarter of the variations KataGo looked at, those stones got captured; or
  • where I thought white had some territory on the left, KataGo counts the area as dame because a running battle is about to hurtle right through the middle of it.
These are cues that an unsettled group might be weaker or stronger than it looks to my amateur eye.

Of course it's possible that I'm horribly misinterpreting things here...

Top
 Profile  
 
Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 11 posts ] 

All times are UTC - 8 hours [ DST ]


Who is online

Users browsing this forum: No registered users and 1 guest


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Search for:
Jump to:  
Powered by phpBB © 2000, 2002, 2005, 2007 phpBB Group