It is currently Thu Apr 18, 2024 5:24 pm

All times are UTC - 8 hours [ DST ]




Post new topic Reply to topic  [ 25 posts ]  Go to page 1, 2  Next
Author Message
Offline
 Post subject: crazy-sensei.com can analyze your games
Post #1 Posted: Mon Jan 23, 2017 7:29 am 
Lives with ko

Posts: 170
Liked others: 32
Was liked: 119
Rank: KGS 4 kyu
Hi,

I am glad to announce that my web site at https://www.crazy-sensei.com/ is now able to analyze sgf game records and produce an analysis that can be browsed online. In order to test it, I will analyze some games of this forum and post the links.

A little bit of explanation of the analysis:
- The blue line is Black's probability of winning
- Red bars indicate errors and their magnitude
- You can click on move numbers on the board to browse the search tree

Rémi


This post by Rémi was liked by 12 people: Bill Spight, Bonobo, clemi, dfan, dsatkas, dust, gustav, hyperpape, jeromie, jptavan, tj86430, Uberdude
Top
 Profile  
 
Offline
 Post subject: Re: crazy-sensei.com can analyze your games
Post #2 Posted: Mon Jan 23, 2017 7:56 am 
Judan

Posts: 6725
Location: Cambridge, UK
Liked others: 436
Was liked: 3719
Rank: UK 4 dan
KGS: Uberdude 4d
OGS: Uberdude 7d
Nice tool! I signed up and tried to analyse the last game from my study journal at 6d level (10 credits) but it said I didn't have enough credit despite my account showing 10 credits, an off-by-1 or > vs >= error? 4d level worked and is in progress so let's see what that says, but seeing as the players were 4d I wanted to try the deeper analysis.

Also as a testing point that sgf has variations but the game is the mainline. Will those get analysed too or confuse it or get ignored?

P.S. funny that for the first move the policy network strongly prefers the large knight's move away from tengen over other nearby moves, as well as tengen itself and normal corner moves.

Top
 Profile  
 
Offline
 Post subject: Re: crazy-sensei.com can analyze your games
Post #3 Posted: Mon Jan 23, 2017 8:05 am 
Lives with ko

Posts: 170
Liked others: 32
Was liked: 119
Rank: KGS 4 kyu
Uberdude wrote:
Nice tool! I signed up and tried to analyse the last game from my study journal at 6d level (10 credits) but it said I didn't have enough credit despite my account showing 10 credits, an off-by-1 or > vs >= error? 4d level worked and is in progress so let's see what that says, but seeing as the players were 4d I wanted to try the deeper analysis.

Also as a testing point that sgf has variations but the game is the mainline. Will those get analysed too or confuse it or get ignored?


You have 9 credits if you posted one 4d game. Maybe you navigated back to your profile. If you reload, you should see 9, because the 4d analysis costs1. You have 10 more now. I also added 10 credits to everyone who registered so far. I may add more later when my server is not busy any more.

Note that a 6d analysis may take time, especially when there is a queue. You can set an option in your account profile to get an email notification when it is ready.

Top
 Profile  
 
Offline
 Post subject: Re: crazy-sensei.com can analyze your games
Post #4 Posted: Mon Jan 23, 2017 8:13 am 
Judan

Posts: 6725
Location: Cambridge, UK
Liked others: 436
Was liked: 3719
Rank: UK 4 dan
KGS: Uberdude 4d
OGS: Uberdude 7d
Rémi wrote:
You have 9 credits if you posted one 4d game. Maybe you navigated back to your profile. If you reload, you should see 9, because the 4d analysis costs1.

I tried the 6d level analysis first and it failed, and went back to check my profile and it still said I had 10. I then did the 4d one and it worked and credits went down to 9.

Rémi wrote:
You have 10 more now.

Thanks!

Are you planning to allow the purchase of credits with real money in future? I wonder what the exchange rate would be...

Btw, I really like the policy view, great way to visualise where it wants to play and how much with the different sizes. :tmbup:

Top
 Profile  
 
Offline
 Post subject: Re: crazy-sensei.com can analyze your games
Post #5 Posted: Mon Jan 23, 2017 8:20 am 
Lives with ko

Posts: 170
Liked others: 32
Was liked: 119
Rank: KGS 4 kyu
Uberdude wrote:
I tried the 6d level analysis first and it failed, and went back to check my profile and it still said I had 10. I then did the 4d one and it worked and credits went down to 9.
That was a bug. Thanks for reporting. The fix will soon be online.

Uberdude wrote:
Are you planning to allow the purchase of credits with real money in future?
Yes.

Top
 Profile  
 
Offline
 Post subject: Re: crazy-sensei.com can analyze your games
Post #6 Posted: Mon Jan 23, 2017 8:27 am 
Lives with ko

Posts: 170
Liked others: 32
Was liked: 119
Rank: KGS 4 kyu
It seems that some people register their email address, but never set a password. If you don't receive the registration email, then please tell me by sending a mail to the contact address, or by telling me your provider here. I am still trying to configure my mail server so that it passes the various spam filters.

Also some people obviously made typos. I have one @gmail.con address, for instance. Trying to register again with the correct spelling should work.

And if you wish to change your password: log out, then choose "forgot password". Then you'll be able to reset it.

Thanks

Top
 Profile  
 
Offline
 Post subject: Re: crazy-sensei.com can analyze your games
Post #7 Posted: Mon Jan 23, 2017 8:36 am 
Dies in gote

Posts: 66
Location: Paris
Liked others: 51
Was liked: 35
KGS: clemi
Thks Rémi,

I confirm that you're allotted 0 credit at first.
Only after uploading a game with 4d analysis is the store credit filled, decreased by 1... and showing 9 then :).

Top
 Profile  
 
Offline
 Post subject: Re: crazy-sensei.com can analyze your games
Post #8 Posted: Mon Jan 23, 2017 8:45 am 
Lives in sente

Posts: 727
Liked others: 44
Was liked: 218
GD Posts: 10
I also have 0 credit but I'm not in a hurry

So 4 dan use pure neural net and 6 dan toped with a little bit of MCTS playout?

Top
 Profile  
 
Offline
 Post subject: Re: crazy-sensei.com can analyze your games
Post #9 Posted: Mon Jan 23, 2017 10:27 am 
Judan

Posts: 6725
Location: Cambridge, UK
Liked others: 436
Was liked: 3719
Rank: UK 4 dan
KGS: Uberdude 4d
OGS: Uberdude 7d
Rémi, does this tool read the komi from the uploaded SGF and take that into account? I noticed on my game (#34 and #43) (in which I left komi blank as 0) it thought black was leading a bit from the start. I recall reading that some bots like CrazyStone and AlphaGo slightly prefer white with normal komi (6.5 or 7.5?).

Top
 Profile  
 
Offline
 Post subject: Re: crazy-sensei.com can analyze your games
Post #10 Posted: Mon Jan 23, 2017 10:54 am 
Lives with ko

Posts: 170
Liked others: 32
Was liked: 119
Rank: KGS 4 kyu
Uberdude wrote:
Rémi, does this tool read the komi from the uploaded SGF and take that into account? I noticed on my game (#34 and #43) (in which I left komi blank as 0) it thought black was leading a bit from the start. I recall reading that some bots like CrazyStone and AlphaGo slightly prefer white with normal komi (6.5 or 7.5?).

Yes, it reads the komi from the SGF.

Top
 Profile  
 
Offline
 Post subject: Re: crazy-sensei.com can analyze your games
Post #11 Posted: Mon Jan 23, 2017 1:27 pm 
Lives in sente

Posts: 923
Location: UK
Liked others: 72
Was liked: 479
Rank: 5 dan
KGS: macelee
It did not work for me. When I tried to upload a game, it always says that I have no credit. Have I missed anything?

Top
 Profile  
 
Offline
 Post subject: Re: crazy-sensei.com can analyze your games
Post #12 Posted: Mon Jan 23, 2017 1:39 pm 
Tengen

Posts: 4380
Location: North Carolina
Liked others: 499
Was liked: 733
Rank: AGA 3k
GD Posts: 65
OGS: Hyperpape 4k
Looks cool. As I am waiting for one of my games to be analyzed, I have a feature request: give some sort of feedback when it is reasonable to expect that the game will be processed.

_________________
Occupy Babel!

Top
 Profile  
 
Offline
 Post subject: Re: crazy-sensei.com can analyze your games
Post #13 Posted: Mon Jan 23, 2017 1:51 pm 
Lives with ko

Posts: 170
Liked others: 32
Was liked: 119
Rank: KGS 4 kyu
hyperpape wrote:
Looks cool. As I am waiting for one of my games to be analyzed, I have a feature request: give some sort of feedback when it is reasonable to expect that the game will be processed.

Thanks for your suggestion. I'll think about providing an estimation. You can set an option in your profile to get email notifications of when the analysis is ready. Your game should be available in about 15 minutes.

Top
 Profile  
 
Offline
 Post subject: Re: crazy-sensei.com can analyze your games
Post #14 Posted: Mon Jan 23, 2017 1:56 pm 
Tengen

Posts: 4380
Location: North Carolina
Liked others: 499
Was liked: 733
Rank: AGA 3k
GD Posts: 65
OGS: Hyperpape 4k
Rémi wrote:
You can set an option in your profile to get email notifications of when the analysis is ready.
I turned that setting on and already forgot I'd done so! I'm just the sort of annoying user you want testing things, I guess.

_________________
Occupy Babel!

Top
 Profile  
 
Offline
 Post subject: Re: crazy-sensei.com can analyze your games
Post #15 Posted: Mon Jan 23, 2017 2:31 pm 
Lives in sente

Posts: 902
Location: Fort Collins, CO
Liked others: 319
Was liked: 287
Rank: AGA 3k
Universal go server handle: jeromie
Thanks; this is great! I've thought about purchasing Crazy Stone in the past, but all I really want it for is analysis. If this works well and the credits are priced reasonably, this is definitely something I'll use.

Do you want us to post feedback about our experience with the tool here or elsewhere? I'd like to be helpful in any way I can!

Top
 Profile  
 
Offline
 Post subject: Re: crazy-sensei.com can analyze your games
Post #16 Posted: Tue Jan 24, 2017 12:48 am 
Lives in gote
User avatar

Posts: 388
Location: Riverside CA
Liked others: 246
Was liked: 79
Rank: KGS 7 kyu
KGS: Krill
OGS: Krill
Is there any chance that some of these analysis tools (like the Policy view and the red 'error' bars) might be added to the PC version of Crazy Stone Deep Learning? The visuals make reviewing a lot easier, and it would be a shame if the $80 pricetag for CS:DL is for something that is worse for game review than this online service.


This post by Monadology was liked by 2 people: dfan, ez4u
Top
 Profile  
 
Offline
 Post subject: Re: crazy-sensei.com can analyze your games
Post #17 Posted: Tue Jan 24, 2017 6:50 am 
Judan

Posts: 6725
Location: Cambridge, UK
Liked others: 436
Was liked: 3719
Rank: UK 4 dan
KGS: Uberdude 4d
OGS: Uberdude 7d
Hi Rémi, I'm really liking this tool, a nice UI that works well on mobile too :tmbup: . I have a question about the meaning of the policy view red squares. Is it how popular that move is in the policy network, irrespective of winning probability after playing it? If you look in this game at move 15, for the next move white (Haylee) played the 2-4 point in the corner which is a very normal move in pro games, and it looks like it has the biggest policy red square. However, that move has a medium-size red error bar, indicating it was a mistake (according to CS) and raised black's winning chances. On the 'tree' view it is #2, and #1 is the 2-space pincer (which has significantly smaller red policy square). Does that mean the pincer was the best move for win probability, with the corner move 2nd? This does actually tally with some other bot analysis I heard about (maybe AlphaGo, or Zen or CS, I can't recall) that it didn't like that corner defence.

Top
 Profile  
 
Offline
 Post subject: Re: crazy-sensei.com can analyze your games
Post #18 Posted: Tue Jan 24, 2017 7:34 am 
Lives in sente
User avatar

Posts: 1310
Liked others: 14
Was liked: 153
Rank: German 1 Kyu
Monadology wrote:
Is there any chance that some of these analysis tools (like the Policy view and the red 'error' bars) might be added to the PC version of Crazy Stone Deep Learning? The visuals make reviewing a lot easier, and it would be a shame if the $80 pricetag for CS:DL is for something that is worse for game review than this online service.

I am afraid that the awareness about the value of analysing tools is greater in the West (e.g. Rémi) than in the East (e.g. Unbalance).

In my opinion, it should not be underestimated that the analysing tools of a programme (e.g. CS DL) will also benefit players of a strength (far) above the programme's playing strength.

+ + + + + + + + + + +

I let Crazy Sensei analyse one of the recent AlphaGo games (vs. Meng Tailing, #9). It seems to me that the result (winning probability) is totally congruent with CS DL's "P B(wins)".

But with Crazy Sensei, you have additional views, and the histograms are also stored for browsing through. :tmbup:

_________________
The really most difficult Go problem ever: https://igohatsuyoron120.de/index.htm
Igo Hatsuyōron #120 (really solved by KataGo)

Top
 Profile  
 
Offline
 Post subject: Re: crazy-sensei.com can analyze your games
Post #19 Posted: Tue Jan 24, 2017 8:04 am 
Lives with ko

Posts: 199
Liked others: 6
Was liked: 55
Rank: KGS 3 kyu
Whenever you have time to do a few UI/UX tweaks:
- There is no way to know the current move number.
- Keyboard shortcuts (at least left/right to go over the game) would be nice.

Top
 Profile  
 
Offline
 Post subject: Re: crazy-sensei.com can analyze your games
Post #20 Posted: Tue Jan 24, 2017 8:09 am 
Judan

Posts: 6725
Location: Cambridge, UK
Liked others: 436
Was liked: 3719
Rank: UK 4 dan
KGS: Uberdude 4d
OGS: Uberdude 7d
uPWarrior wrote:
- There is no easy way to know the current move number.

My current workaround:
- right-click on current vertical bar in the win% graph
- Inspect element (in dev tools / firebug etc)
- find value of 'data-title' attribute
:)


This post by Uberdude was liked by: Monadology
Top
 Profile  
 
Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 25 posts ]  Go to page 1, 2  Next

All times are UTC - 8 hours [ DST ]


Who is online

Users browsing this forum: No registered users and 1 guest


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Search for:
Jump to:  
Powered by phpBB © 2000, 2002, 2005, 2007 phpBB Group