It is currently Fri Apr 19, 2024 10:34 pm

All times are UTC - 8 hours [ DST ]




Post new topic Reply to topic  [ 32 posts ]  Go to page 1, 2  Next
Author Message
Offline
 Post subject: Go Style Estimator
Post #1 Posted: Sun Apr 14, 2013 9:11 am 
Dies in gote

Posts: 43
Liked others: 4
Was liked: 22
Long time ago, Josef Moudrik and me worked on an automatic Go style/strength estimator that takes a look at your game records and tries to estimate your style and strength based on a large body of games it used for training.

Now, Josef Moudrik has pushed the concept much further and created a shiny web app that allows you to get your games analyzed with no hassle! You can either upload a .zip with your SGF games or it will download your games from KGS if you supply your username (entering password not required). Try it out at: http://gostyle.j2m.cz/webapp.html

Example pages with analysis of the latest TheCaptain's and pachi's KGS games:

http://gostyle.j2m.cz/WAPP_RES/edb042f9 ... 04c13f47b/

http://gostyle.j2m.cz/WAPP_RES/840fc3ad ... e7b0631d3/

(they last two months; just enter their nicks to the form at the main page if they already expired)

Let us know what you think! :-)

_________________
Go programmer and researcher: http://pasky.or.cz/~pasky/go/
EGF 1921, KGS ~1d and getting weaker


This post by pasky was liked by 8 people: daal, Kirby, poulpe, shapenaji, SoDesuNe, Solomon, Splatted, Toge
Top
 Profile  
 
Offline
 Post subject: Re: Go Style Estimator
Post #2 Posted: Sun Apr 14, 2013 4:22 pm 
Lives in gote
User avatar

Posts: 313
Liked others: 36
Was liked: 63
Rank: KGS dan
KGS: Toge
I'll give it a shot. I supplied my KGS username and it's been loading for quite a while now. Probably offline or crashed.

I looked at TheCaptain's stats that you gave. The Distinctive Patterns chart is hard to read. So 5x4, 3x4, tenuki, 3x3 attach joseki pattern is something strong players play but TheCaptain doesn't play? This pattern happens about every 14th game in professional play based on the red mark? What is it about strong players and weak players?

Anyway, very nice idea. I'm excited to find out what it says about my style.

Edit:
Took a couple of tries, but now the results are in:
http://gostyle.j2m.cz/WAPP_RES/388e6238 ... 9231ae01c/
Rank estimate at 2d±2.63 is about 1 ¼ stones too high. I've been hovering at 1k, occasionally dipping to 2k and peaking at 1d. I agree with style evaluation. My games are often full of fighting. I'm pretty bad at shinogi too.


Last edited by Toge on Mon Apr 15, 2013 8:43 am, edited 1 time in total.
Top
 Profile  
 
Offline
 Post subject: Re: Go Style Estimator
Post #3 Posted: Sun Apr 14, 2013 8:04 pm 
Honinbo

Posts: 9545
Liked others: 1600
Was liked: 1711
KGS: Kirby
Tygem: 커비라고해
Awesome idea! This is pretty cool.

_________________
be immersed

Top
 Profile  
 
Offline
 Post subject: Re: Go Style Estimator
Post #4 Posted: Sun Apr 14, 2013 8:24 pm 
Lives in gote
User avatar

Posts: 472
Location: Wisconsin
Liked others: 414
Was liked: 461
I tried uploading a SGF. It said 'pending' for about half an hour. How long should it take?

Top
 Profile  
 
Offline
 Post subject: Re: Go Style Estimator
Post #5 Posted: Sun Apr 14, 2013 11:52 pm 
Lives in sente
User avatar

Posts: 842
Liked others: 180
Was liked: 151
Rank: 3d
GD Posts: 422
KGS: komi
Seems a little generous in its rank estimation, calling me a 3d (when the account hovers between 1k and 1d). The results are a little vague and feel a bit meaningless. What does 5.5 mean on the scale of territory vs. moyo? It suggested one move I should consider playing, a one space jump, but it meant nothing to me, as it lacked context, i.e. it lacked examples from my games where I could/should have played this.

A 3k friend did the test, it ranked him a 1d, and told him to stop playing empty triangles. That was perhaps a little more concrete, but again, without context it's hard to know whether this advice is meaningful.

I understand this extremely localized pattern matching is fundamental to the technique, which I presume comes from go engine research, but it does feel like there is some way to go to make this meaningful or instructive to humans. Still, I look forward to further improvements.

Top
 Profile  
 
Offline
 Post subject: Re: Go Style Estimator
Post #6 Posted: Mon Apr 15, 2013 12:48 am 
Dies in gote

Posts: 45
Liked others: 12
Was liked: 8
Pasky,

This is very interesting read
"On Move Pattern Trends in a Large Go Games Corpus"

http://arxiv.org/pdf/1209.5251.pdf

Top
 Profile  
 
Offline
 Post subject: Re: Go Style Estimator
Post #7 Posted: Mon Apr 15, 2013 2:45 am 
Oza
User avatar

Posts: 2508
Liked others: 1304
Was liked: 1128
This is a fun idea. I did the test by entering my kgs account name, and within a minute or so the results were posted. I later entered another one of my accounts to compare, and although it showed different patterns, the judgements about my preferences were very close. I really like the idea of showing typical patterns and correlating them to strong or weak - but it doesn't seem particularly informative at this stage. Although the app correctly picked my rank, it seemed to think that I had a tendency to make strong moves.

_________________
Patience, grasshopper.

Top
 Profile  
 
Offline
 Post subject: Re: Go Style Estimator
Post #8 Posted: Mon Apr 15, 2013 7:06 am 
Oza

Posts: 2494
Location: DC
Liked others: 157
Was liked: 442
Universal go server handle: skydyr
Online playing schedule: When my wife is out.
I downloaded my username from KGS and got 1 dan, which seems high.

One thing I noticed looking at the list of games is that it treats demonstration games, including reviews, as separate games to be analyzed. Perhaps this should only look at rated or free games?

Top
 Profile  
 
Offline
 Post subject: Re: Go Style Estimator
Post #9 Posted: Mon Apr 15, 2013 7:53 am 
Beginner

Posts: 4
Liked others: 0
Was liked: 0
Inkwolf,Toge: Yep, it was down for a half day, now it is up again. It should take (once the stautus changes to working) less than a minute..

quantumf: Of course, it might be off, especially when the user submits a small number of games (but even without it, the method has a certain error). The empty triangles and other advices have even bigger error and I am trying to tweak the process to be relevant. The problem here of course is, that the method correctly learns that weak players play the empty triangle a lot, while strong players generally do not. But, sometimes, they do and when they do play it in larger number in the sample submitted, the program warns them on thing they already surely know. The 5.5 on territory <-> moyo scale marks what compromise between territory-based game style and influence-based style the player makes. Similarly to empty triangle, the one-point jump basically says that "better players play this more" and yes, more context is needed - this statistics is basically a byproduct (which I considered interesting though) of the strength estimation.

Anyway, it is not just patterns, the program also analyzes the awareness of "sente/gote" (for a certain definition of these terms), high/low plays throughout the game, and some other "features".

skydyr: Hmm, yes it should disregard the demonstration and review games, as it does with handicap and other board sizes, I will look into this, thanks! I've looked on your output and I think the cause for the mis-guess in strength is the fact that the games (not much of them anyway) are relatively sparsely scattered over a long time during which your strength changed.

Top
 Profile  
 
Offline
 Post subject: Re: Go Style Estimator
Post #10 Posted: Mon Apr 15, 2013 7:57 am 
Tengen

Posts: 4380
Location: North Carolina
Liked others: 499
Was liked: 733
Rank: AGA 3k
GD Posts: 65
OGS: Hyperpape 4k
I got 1k, and I was about to say that it's too high, but then I realized my KGS ranking has actually been floating around there recently. It's even 1d? or 2d? now. Whether that's my real rank (I haven't been playing much) or not, that's where KGS has had me.

As for the style, I think it's about right--it pegged me as territorial, orthodox, just slightly above average in fightiness, and evenly split between safety and shinogi.

_________________
Occupy Babel!

Top
 Profile  
 
Offline
 Post subject: Re: Go Style Estimator
Post #11 Posted: Mon Apr 15, 2013 8:00 am 
Oza

Posts: 2494
Location: DC
Liked others: 157
Was liked: 442
Universal go server handle: skydyr
Online playing schedule: When my wife is out.
JoeM wrote:
skydyr: Hmm, yes it should disregard the demonstration and review games, as it does with handicap and other board sizes, I will look into this, thanks! I've looked on your output and I think the cause for the mis-guess in strength is the fact that the games (not much of them anyway) are relatively sparsely scattered over a long time during which your strength changed.


Yeah, that doesn't surprise me too much. I don't actually play on KGS particularly frequently, to say the least.

Top
 Profile  
 
Offline
 Post subject: Re: Go Style Estimator
Post #12 Posted: Tue Apr 16, 2013 7:10 am 
Lives with ko

Posts: 160
Liked others: 15
Was liked: 11
Rank: KGS 2k
KGS: blade90
I tested it 3 times with:
1. 40 Tygem games
2. 40 KGS games (by entering my userid)
3. 40 IGS games

Of course for IGS and Tygem I used my latest games.
With my tygem games it estimated me as KGS 2k (pretty accurate)
With KGS: 3k (again very accurate)
With my IGS games (at 5k range) it estimated me as 3d (needless to say that's very wrong).

The estimated playing style of all of my games was pretty much the same and very accurate!
The recommended professional players were always different except of two playerse which was shown in 2 of the 3 trys.

As problems it pointed out:
1. Tygem: Sente and Gote
2. KGS: Sente and Gote, Empty triangle, likes to capture stones (the last one is very true :roll: )
3. IGS: Nothing (that's not a surprise as 3d :-? )

The diagrams at the end don't really tell me much.

Now my thoughts: I really like it! It's a great and interesting idea. I always knew I play territarial but seeing a number on how much (8 in my case) is really interesting.
The other areas of playing style are also very helpful.
The recommedations of professional players that have similar style and whose style is very different is very cool.

I would love to see an offline/downloadable version, of course new information must still be exchange online but that way you won't need to upload all games. And maybe can even use more than 40 games.
Even if that isn't possible, I would still like to see this being improved.

Now here is something I didn't like: It told me that I like to play empty triangles, I would have liked to get a list of the games where I did play it. Without context it's hard to take it seriously.

Top
 Profile  
 
Offline
 Post subject: Re: Go Style Estimator
Post #13 Posted: Tue Apr 16, 2013 7:20 am 
Oza

Posts: 2494
Location: DC
Liked others: 157
Was liked: 442
Universal go server handle: skydyr
Online playing schedule: When my wife is out.
I'm not entirely clear on what is meant by the Orthodoxity axis. Could you explain it?

Top
 Profile  
 
Offline
 Post subject: Re: Go Style Estimator
Post #14 Posted: Tue Apr 16, 2013 8:01 am 
Lives in gote
User avatar

Posts: 472
Location: Wisconsin
Liked others: 414
Was liked: 461
Cool, tried again with 8 recent SGF files. They estimated me at 10k KGS...which is, in fact, my current rank.

No surprises on style...low in fighting and innovation, high on territory, medium on thickness. I will check out some of those suggested pros to study! Thanks for the fun new tool. :tmbup:

BYW, this seems like an interesting way to scout out your opponents on KGS, too... :batman:


This post by Inkwolf was liked by: Bill Spight
Top
 Profile  
 
Offline
 Post subject: Re: Go Style Estimator
Post #15 Posted: Tue Apr 16, 2013 8:42 pm 
Honinbo

Posts: 9545
Liked others: 1600
Was liked: 1711
KGS: Kirby
Tygem: 커비라고해
I'm 7k, I guess. And I like to capture stones.

_________________
be immersed

Top
 Profile  
 
Offline
 Post subject: Re: Go Style Estimator
Post #16 Posted: Tue Apr 16, 2013 9:36 pm 
Honinbo

Posts: 10905
Liked others: 3651
Was liked: 3374
Kirby wrote:
I'm 7k, I guess. And I like to capture stones.


Oh, don't be so tentative. More machismo, if you please. Like this:

Kirby sama wrote:

Hi. I'm Seven Kyu. {Pause to let that sink in.}

I capture stones.



:)

_________________
The Adkins Principle:
At some point, doesn't thinking have to go on?
— Winona Adkins

Visualize whirled peas.

Everything with love. Stay safe.


This post by Bill Spight was liked by 6 people: Bonobo, daal, Inkwolf, rhubarb, SoDesuNe, Splatted
Top
 Profile  
 
Offline
 Post subject: Re: Go Style Estimator
Post #17 Posted: Wed Apr 17, 2013 7:50 am 
Lives in gote
User avatar

Posts: 310
Location: Deutschland
Liked others: 272
Was liked: 126
Rank: EGF 4 kyu
Interestingly, 37 recent games on IGS (going back to December, last year) put me at 2 kyu:
http://gostyle.j2m.cz/WAPP_RES/c5fbd3b8 ... e8fe8c460/
(I was actually 11 kyu to 9 kyu, IGS, for these games)

But 40 recent games on KGS put me at 5 kyu:
http://gostyle.j2m.cz/WAPP_RES/bea1a707 ... b8b33c5aa/

Both of the feedback pages instructed me to concentrate on sente and gote but the style statistics appear completely different.

Top
 Profile  
 
Offline
 Post subject: Re: Go Style Estimator
Post #18 Posted: Wed Apr 17, 2013 1:41 pm 
Dies in gote

Posts: 43
Liked others: 4
Was liked: 22
Charlie wrote:
Interestingly, 37 recent games on IGS (going back to December, last year) put me at 2 kyu:
http://gostyle.j2m.cz/WAPP_RES/c5fbd3b8 ... e8fe8c460/
(I was actually 11 kyu to 9 kyu, IGS, for these games)

But 40 recent games on KGS put me at 5 kyu:
http://gostyle.j2m.cz/WAPP_RES/bea1a707 ... b8b33c5aa/

Both of the feedback pages instructed me to concentrate on sente and gote but the style statistics appear completely different.


Hmm, to me it seems the statistics actually are quite similar except for "orthodoxity". The style statistics are influenced also by your opponents, of course; different competing styles may provoke you to play different moves, perhaps we could conclude that IGS players have more traditional style than KGS players. ;-) Or it's just a statistical error, the confidence intervals are unfortunately very wide still.

Thank you all for trying it out!

_________________
Go programmer and researcher: http://pasky.or.cz/~pasky/go/
EGF 1921, KGS ~1d and getting weaker

Top
 Profile  
 
Offline
 Post subject: Re: Go Style Estimator
Post #19 Posted: Wed Apr 17, 2013 7:10 pm 
Oza

Posts: 2356
Location: Ireland
Liked others: 662
Was liked: 442
Universal go server handle: Boidhre
So I tried it: http://gostyle.j2m.cz/WAPP_RES/da8bfcab ... 6e489c5c7/

I've never played a whole lot of go online (and not a whole lot of even games) so it was never going to work right but a few things:

It says it took games from September 2012 to December 2012. It didn't, it took games from March 2012 onwards. This presents a problem in that it's mixing games where the server thinks I'm 22k or whatever right back when I started playing go, in with games where the server thinks I'm 8k. You can't really take games from when someone is just starting out in go and use them to give tips for play 9 months later. If the problems persist from the early games then that's an excellent thing to bring up (and if you do this you should highlight this!). I think there should be some check in the program to make sure you're not using games from a region exceeding 5 or 6 stones in strength. Also over a 14 stone strength difference (I don't actually believe I was 7/8k but whatever) any discussion of style over that series of games will be meaningless. I didn't know what thickness meant at 8k but I knew even less about it at 22k and so on.

Also the first game is wrong, I was 30k in that game, it was my first game of go and I thought 30k was appropriate. The problem could be on KGS's end though as my rank would have been ? for that game with 0 games played so no predicted rank. Is it possible this game being marked as 8k threw off your algorithm?


Nice tool though, good work. :)

Top
 Profile  
 
Offline
 Post subject: Re: Go Style Estimator
Post #20 Posted: Thu Apr 18, 2013 1:18 am 
Beginner

Posts: 4
Liked others: 0
Was liked: 0
Boidhre: The wrong range of games is a clear bug, I'll fix this ;-) The rank of the player in each of the games listed is taken from the sgf file and is not taken in account in any way - it is listed just for convenience. The number of games from KGS is taken as the last 40 games currently, so if you have played less then 40 games on KGS altogether, it takes all of them. This is done (taking last 40 games) so that the algorithm has enough information, but in these extreme cases (improvement of 15 stones within the sample) this additional information might simply not be worth the error introduced by the difference in strength. However, I still consider the fact that the rank is estimated approximately as the average in the sample and the "Bad things you play" gives a long list a pretty good result. :-)

Charlie: Actually, 9-11 kyu IGS (as listed in the sgf files), corresponds to 6-7kyu KGS. Moreover, the KGS range in the results is longer - February 2012 to March 2013, so that even the games where you were KGS 10kyu are included. So the results seem to overestimate your strength by 4 stones but consistently; similarly, the "Bad things you play" suggests in both cases that you should study sente/gote and focus on keeping the initative.

So maybe your overall gameplay is really stronger, but your main weakness is the sente/gote - once you fix this you could easily become 4stones stronger. :batman:

Top
 Profile  
 
Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 32 posts ]  Go to page 1, 2  Next

All times are UTC - 8 hours [ DST ]


Who is online

Users browsing this forum: No registered users and 1 guest


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Search for:
Jump to:  
Powered by phpBB © 2000, 2002, 2005, 2007 phpBB Group