It is currently Sat May 24, 2025 6:01 am

All times are UTC - 8 hours [ DST ]




Post new topic Reply to topic  [ 27 posts ]  Go to page Previous  1, 2
Author Message
Offline
 Post subject: Re: stuck at 13 kyu Many faces of GO
Post #21 Posted: Tue Dec 07, 2010 1:35 pm 
Lives in sente
User avatar

Posts: 1326
Liked others: 14
Was liked: 153
Rank: German 1 Kyu
Li Kao wrote:
Does ManyFaces have some kind of dynamic komi? Because from what I heard handicap doesn't work well with monte carlo AIs.

Yes, it is said to be "linear" Komi.

E. g. with 8 stones handicap Many Faces starts with a Komi of 50.5 and this Komi is reduced by 1 point every two moves. With move 100, Komi remains 0.5 points. Reduction does not depend on the situation on the board, so "linear".

May be that there are several parameters that can be set (start level, decrement, ...).

_________________
The really most difficult Go problem ever: https://igohatsuyoron120.de/index.htm
Igo Hatsuyōron #120 (really solved by KataGo)

Top
 Profile  
 
Offline
 Post subject: Re: stuck at 13 kyu Many faces of GO
Post #22 Posted: Wed Dec 08, 2010 11:59 am 
Lives in sente

Posts: 1045
Liked others: 0
Was liked: 182
Separate issues? (and I really think discussion at this level belongs in the "computer go" section)

1) How a Monte Carlo tree search based program works at all (or how best works) might depend on using an "evaluation komi" different than the actual komi of the game. It would be an empirical matter whether slight skewing of the outcomes of the random games helped or hurt.

2) That's why I ignore this in discussing what sorts of adjustments might be needed when playing when handicaps are involved. There are all sorts of possibilities with "dynamic komi" besides starting with some set value other than the actual komi of the game and then a deterministic adjustment back to the actual. As I indicated in "1", I don't know if one would ever use the actual. I'm not looking at the code and then deciding what the algorithm is!

3) I was discussing another issue, how to have a Monte Carlo tree search based program that had more than one playing strength level. That's nowhere near as simple an issue as it might at first seem

Top
 Profile  
 
Offline
 Post subject: Re: stuck at 13 kyu Many faces of GO
Post #23 Posted: Wed Dec 08, 2010 12:19 pm 
Gosei
User avatar

Posts: 2116
Location: Silicon Valley
Liked others: 152
Was liked: 330
Rank: 2d AGA
GD Posts: 1193
KGS: lavalamp
Tygem: imapenguin
IGS: lavalamp
OGS: daniel_the_smith
Mike Novack wrote:
3) I was discussing another issue, how to have a Monte Carlo tree search based program that had more than one playing strength level. That's nowhere near as simple an issue as it might at first seem


Is there something wrong with just using different amounts of time for the different levels?

_________________
That which can be destroyed by the truth should be.
--
My (sadly neglected, but not forgotten) project: http://dailyjoseki.com

Top
 Profile  
 
Offline
 Post subject: Re: stuck at 13 kyu Many faces of GO
Post #24 Posted: Thu Dec 09, 2010 7:46 am 
Lives in sente

Posts: 1045
Liked others: 0
Was liked: 182
daniel_the_smith wrote:
Mike Novack wrote:
3) I was discussing another issue, how to have a Monte Carlo tree search based program that had more than one playing strength level. That's nowhere near as simple an issue as it might at first seem


Is there something wrong with just using different amounts of time for the different levels?


Yes -- unless all you want is a very small adjustment. The performance of the algorithms used is very non-linear with respsect to time. Take the newest release 12.021. That will max out at about 2 dan but Fotland says that's on a 12 core xeon. It is supposed to play at about 1 dan on a "standard machine" (2 core, 2+ GHz). In other words, giving it (in effect) 6-8 times less time). But 12.021 is supposed to be offering a 3 kyu (as well as 1 dan) level.

Note that there is also a problem with the (lower) AI levels too. If one takes the simplest approach of leaving something out of consideration (that the higher level has coding for) the playing behavior becomes less human like --- one can learn how to beat the program and the program can't "see" how to learn to avoid this (it can't).

I'm not "in the game" of writing these things but if I were the first thing I would try would be to introduce "probability of making an error in play". More like the behavior of a weaker human who sometimes sees the best move and sometimes doesn't. So at the AI levels, at move N it might or might not be using some parts of the engine. At the Monte Carlo levels, a probability that it might choose to make the 2nd best move instead of the best. I don't know that this approach would work but if it did would surely be very easy to adjust.

This is my last comment here (this discussion needs to be moved to "computer go")

Top
 Profile  
 
Offline
 Post subject: Re: stuck at 13 kyu Many faces of GO
Post #25 Posted: Thu Dec 09, 2010 10:03 am 
Gosei
User avatar

Posts: 2116
Location: Silicon Valley
Liked others: 152
Was liked: 330
Rank: 2d AGA
GD Posts: 1193
KGS: lavalamp
Tygem: imapenguin
IGS: lavalamp
OGS: daniel_the_smith
Mike Novack wrote:
daniel_the_smith wrote:
Mike Novack wrote:
3) I was discussing another issue, how to have a Monte Carlo tree search based program that had more than one playing strength level. That's nowhere near as simple an issue as it might at first seem


Is there something wrong with just using different amounts of time for the different levels?


Yes -- unless all you want is a very small adjustment. The performance of the algorithms used is very non-linear with respsect to time. Take the newest release 12.021. That will max out at about 2 dan but Fotland says that's on a 12 core xeon. It is supposed to play at about 1 dan on a "standard machine" (2 core, 2+ GHz). In other words, giving it (in effect) 6-8 times less time). But 12.021 is supposed to be offering a 3 kyu (as well as 1 dan) level.


I think if you continue to decrease the time (or, more precisely, the # of playouts) the performance will degrade quite a bit, eventually to the point where it's not much better than random (one playout per available move). Non-linearity doesn't matter if you're trying to make it play *worse*... (this may not apply completely to MFoG as I don't think it is pure monte carlo.)

Whether those mistakes would be human-like or not I can't say, monte-carlo doesn't play very human-like to begin with (though I haven't tried MFoG, maybe it's better than the others).

_________________
That which can be destroyed by the truth should be.
--
My (sadly neglected, but not forgotten) project: http://dailyjoseki.com

Top
 Profile  
 
Offline
 Post subject: Re: stuck at 13 kyu Many faces of GO
Post #26 Posted: Fri Dec 10, 2010 5:18 pm 
Lives in gote
User avatar

Posts: 502
Location: Coloradao USA
Liked others: 50
Was liked: 12
Rank: malk-5k
KGS: go1986
thanks for the info i didn't even know about the update so i got it, but the updated version still plays like the old version to me the dan level must have been the only upgrade 12 kyu still plays the same its about the same amount of aggression and style., but you say time and the speed of the computer is a factor huh, so the game will play better if i add more time to it, interesting... i think the next time i will try to play a long game with the dan engine with a challenging handicap and see how i do thanks everybody for the comments & tips :rambo:

_________________
standing still means going backwards

Top
 Profile  
 
Offline
 Post subject: Re: stuck at 13 kyu Many faces of GO
Post #27 Posted: Sat Dec 11, 2010 8:17 am 
Lives in sente

Posts: 1045
Liked others: 0
Was liked: 182
I said I wasn't going to comment more but need to correct a misconception.

When I said that time/computer power was a factor I meant at the levels where Monte Carlo tree search is involved. I do not mean at the lower levels of MFOG where it's just the AI "go knowledge" engine and positon evaluator choosing the moves. Nor do I know what adjustments Fotland may or may not have made to the lower levels in terms of what they were set at. Nor do I know that the AI "go knowledge" engine hasn't been changed -- an improvement there might not change the level of agrression as that could be up to the AI "position evaluator" component which does the actual move selection.

If you have been playing even against the 12 kyu level but now have update 12.021 and what to see what the "Monte Carlo" levels are like (should be much less passive) I suggest you try the 3 kyu level and take 9 stones rather than the 1 dan level and even more stones. Let us know what happens.

I will add what I am experiencing. When playing against the 1 dan level it appears the "right handicap" is more critical than I would expect against a human opponent. In other words, I win rarely at one handicap and almost all the time at one stone more.

Top
 Profile  
 
Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 27 posts ]  Go to page Previous  1, 2

All times are UTC - 8 hours [ DST ]


Who is online

Users browsing this forum: No registered users and 1 guest


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Search for:
Jump to:  
Powered by phpBB © 2000, 2002, 2005, 2007 phpBB Group