It is currently Thu Apr 25, 2024 6:10 pm

All times are UTC - 8 hours [ DST ]




Post new topic Reply to topic  [ 79 posts ]  Go to page 1, 2, 3, 4  Next

How long until a bot reaches consistent 6d on KGS?
Poll ended at Fri Jul 01, 2011 2:33 pm
<3 months 0%  0%  [ 0 ]
<6 months 13%  13%  [ 4 ]
<1 year 50%  50%  [ 15 ]
<2 years 13%  13%  [ 4 ]
<3 years 10%  10%  [ 3 ]
<5 years 0%  0%  [ 0 ]
never 7%  7%  [ 2 ]
The Terminator Skynet takes over the world first. 7%  7%  [ 2 ]
Total votes : 30
Author Message
Offline
 Post subject: Computers reach 5d on KGS
Post #1 Posted: Wed Jun 01, 2011 2:33 pm 
Lives in gote

Posts: 653
Location: Austin, Texas, USA
Liked others: 54
Was liked: 216
Computer Go continues to improve, and recently two programs on KGS have reached 5d on KGS! First CrazyStone, using the account 'bonobot', although it disappeared after a few days and drifted back down to 4d. Next Zen19D appeared and reached 5d, and it seems to be holding that level consistently.

How long do you think it will be until the first bot reaches a consistent 6d on KGS? It was only August 2010 that Zen was the first bot to consistently hold a 3d rating, and now less than a year later it is 5d!

Here is a history of bot ratings over time: http://senseis.xmp.net/?KGSBotRatings

Top
 Profile  
 
Offline
 Post subject: Re: Computers reach 5d on KGS
Post #2 Posted: Wed Jun 01, 2011 3:32 pm 
Oza
User avatar

Posts: 2644
Liked others: 304
Was liked: 631
Rank: kgs 6k
I'm confused. If so, why couldn't they get a computer to beat that low-dan player this past winter? Are the KGS bots using extremely expensive hardware?

Top
 Profile  
 
Offline
 Post subject: Re: Computers reach 5d on KGS
Post #3 Posted: Wed Jun 01, 2011 3:36 pm 
Gosei
User avatar

Posts: 2116
Location: Silicon Valley
Liked others: 152
Was liked: 330
Rank: 2d AGA
GD Posts: 1193
KGS: lavalamp
Tygem: imapenguin
IGS: lavalamp
OGS: daniel_the_smith
Are they playing with low time limits?

_________________
That which can be destroyed by the truth should be.
--
My (sadly neglected, but not forgotten) project: http://dailyjoseki.com

Top
 Profile  
 
Offline
 Post subject: Re: Computers reach 5d on KGS
Post #4 Posted: Wed Jun 01, 2011 3:37 pm 
Tengen

Posts: 4380
Location: North Carolina
Liked others: 499
Was liked: 733
Rank: AGA 3k
GD Posts: 65
OGS: Hyperpape 4k
Part of the idea behind the challenge was that a human could learn the computer's weaknesses, thus beating a bot that might maintain a higher rating against a large field of (undedicated) opponents.

Also, these bots are not the one that was chosen, though I don't know if they're substantially better than MFoG or not.

An older thread had a great deal of discussion: viewtopic.php?f=18&t=2646&hilit=shodan+bet

_________________
Occupy Babel!

Top
 Profile  
 
Offline
 Post subject: Re: Computers reach 5d on KGS
Post #5 Posted: Wed Jun 01, 2011 3:59 pm 
Lives in gote

Posts: 653
Location: Austin, Texas, USA
Liked others: 54
Was liked: 216
Yes these bots are playing with fast times -- 9x:15. Typically they lose about 1 stone when they play something like 30min main + 5x:30 overtime.

About the Tromp bet, the hardware Zen19D is running on is too expensive to qualify for that bet. Also the time controls would favor Tromp even more than 30min main. And finally a huge factor is Tromp would be playing much more seriously than the typical opponent on KGS!

Despite the caveat about blitz time controls, 5d is still quite amazing! Less than two years ago Zen was 3d under similar time controls.

Top
 Profile  
 
Offline
 Post subject:
Post #6 Posted: Wed Jun 01, 2011 4:00 pm 
Honinbo
User avatar

Posts: 8859
Location: Santa Barbara, CA
Liked others: 349
Was liked: 2076
GD Posts: 312
daniel_the_smith wrote:
Are they playing with low time limits?
Yes.

Top
 Profile  
 
Offline
 Post subject: Re: Computers reach 5d on KGS
Post #7 Posted: Wed Jun 01, 2011 4:12 pm 
Tengen

Posts: 4380
Location: North Carolina
Liked others: 499
Was liked: 733
Rank: AGA 3k
GD Posts: 65
OGS: Hyperpape 4k
This makes me wonder: are bots allowed on DGS?

_________________
Occupy Babel!

Top
 Profile  
 
Offline
 Post subject: Re: Computers reach 5d on KGS
Post #8 Posted: Wed Jun 01, 2011 4:16 pm 
Lives in sente
User avatar

Posts: 761
Liked others: 152
Was liked: 204
Rank: the k-word
Zen reached 1d only about two years ago. The progress the bots are making is stunning. I believe better-than-human play is not that far off, maybe 10 years.

6d this year won't surprise me.

Top
 Profile  
 
Offline
 Post subject: Re: Computers reach 5d on KGS
Post #9 Posted: Wed Jun 01, 2011 4:16 pm 
Oza
User avatar

Posts: 2401
Location: Tokyo, Japan
Liked others: 2340
Was liked: 1332
Rank: Jp 6 dan
KGS: ez4u
jts wrote:
I'm confused. If so, why couldn't they get a computer to beat that low-dan player this past winter? Are the KGS bots using extremely expensive hardware?


This is from the Zen19D info... ("me" = someone named Hideki Katoh)
Q: What is Zen19D?
A: Zen19D is a version of Zen19, runs on a mini-cluster of 6 pcs (a 6-core Xeon W5680/4 GHz, two 4-core i7 920/3.2 GHz, and three 4-core Core2Quad/3 GHz) connected via a GbE LAN. Although Zen19 is a prototype of a commercial product, Zen19D is being developed for academic research by team DeepZen, a joint project of ZenAuthor and me.

Q: What does D stand for?
A: Distributed version, or DeepZen.

Q: How strong is it?
A: Estimated 5d for blitz and 4d for longer games

_________________
Dave Sigaty
"Short-lived are both the praiser and the praised, and rememberer and the remembered..."
- Marcus Aurelius; Meditations, VIII 21

Top
 Profile  
 
Offline
 Post subject: Re: Computers reach 5d on KGS
Post #10 Posted: Wed Jun 01, 2011 4:31 pm 
Lives in sente

Posts: 706
Liked others: 252
Was liked: 251
GD Posts: 846
It would be fun to see a Malkovich game with Zen19D if it has any kind of tracing on how it is weighting its moves.

Top
 Profile  
 
Offline
 Post subject: Re: Computers reach 5d on KGS
Post #11 Posted: Thu Jun 02, 2011 1:07 am 
Lives with ko

Posts: 198
Liked others: 4
Was liked: 23
Rank: lol
KGS: DrBobC
Tygem: 35kyu
this is IMO very sad.... Chess lost all sparkle for me once I realised computers were becoming dominant.

Top
 Profile  
 
Offline
 Post subject: Re: Computers reach 5d on KGS
Post #12 Posted: Thu Jun 02, 2011 4:11 am 
Judan

Posts: 6162
Liked others: 0
Was liked: 789
Nothing changes ALA programs do only use sheer calculation power. Humans will have to "justify" their superiority only when computers start to explain their decisions by human-readable reasoning and can maintain their hard- and software alone.

Top
 Profile  
 
Offline
 Post subject: Re: Computers reach 5d on KGS
Post #13 Posted: Thu Jun 02, 2011 4:31 am 
Lives in gote
User avatar

Posts: 324
Location: Dresden
Liked others: 26
Was liked: 22
Rank: KGS 7 kyu
KGS: Mnemonic, dude13
Ray Kurzweil wrote:
Another prediction I made in The Age of Intelligent Machines was that once computers did perform as well or better as humans in chess, we would either think more of computer intelligence, less of human intelligence, or less of chess, and that if history is a guide, the last of these would be the likely outcome. Indeed, that is precisely what happened. Soon after Deep Blue's victory we began to hear a lot about how chess is really just a simple game of calculating combinations and that the computer victory just demonstrated that it was a better calculator.

_________________
While I was teaching the game to a friend of mine, my mother from the other room:
"Cutting? Killing? Poking out eyes? What the hell are you playing?"

Top
 Profile  
 
Offline
 Post subject: Re: Computers reach 5d on KGS
Post #14 Posted: Thu Jun 02, 2011 4:45 am 
Tengen

Posts: 4380
Location: North Carolina
Liked others: 499
Was liked: 733
Rank: AGA 3k
GD Posts: 65
OGS: Hyperpape 4k
What goes unmentioned in Kurzweil's comment is that people once thought that once we had a chess playing computer, we would have computers that recognized speech, had vision and could write a novel. But it turned out that chess was vastly easier than those, and really didn't lead to much progress on those fronts. So the earlier valuation of a chess playing computer was based on massive factual errors.

_________________
Occupy Babel!


This post by hyperpape was liked by: wms
Top
 Profile  
 
Offline
 Post subject: Re: Computers reach 5d on KGS
Post #15 Posted: Thu Jun 02, 2011 5:04 am 
Lives in sente

Posts: 1037
Liked others: 0
Was liked: 180
Robert, that's a somewhat naive way to think about intelligence, whether natural or artificial. You are making some assumptions both about the current state of the art and the possibilities.

a) explain "why" in human understandable terms
You are assuming that none of the existing programs can do this? Just because few of the programs have been given this capability doesn't make that so. What I believe isn't possible at the present time is giving a why for "why is move A (which has x, y, z "go reasons" behind it) better than move B (which has u, v, w go reasons behind it)". In other words, in human understandable terms, why in this instance are x, y, and z more important than u, v, and w. This of course assumes that you don't consider "human understandable" the concept that if out of 100 games played between opponents of equal skill from position A if one side wins more often than out of 100 games played from position B then for that side position A is likely better than position B (and even more likely if that is true for 1000 games).

Regardless of how a go playing program has selected X as its next move (the move it thinks best) it could then turn around and "waste time" analyzing X in terms of the possible "go reasons" for the move. Feature could be added even to the "pure" MCTS programs if somebody wanted to so.

b) Some forms of AI are essentially "programming themselves" and cannot possibly explain why/how. To understand this you need to understand that a "program" can be the combination of "code" (process and/or function evaluation) and "data" and the behavior of the program might depend very heavily on the data.

You are perhaps going to assume that this data is supplied by us humans? Not necessarily so. Look up the form of AI that goes by the designation "neural net". Here all that is necessary is some way to judge/evaluate how well the "program" has performed its assigned task (the task it is supposed to learn) and then random peturbations of the data can lead to evolution of better and better performance as the neural net learns to perform the task. Not meaningful in this case to ask "why" this set of data works (other sets might work equally well).

You think not? You think a justification of "why does this set of data work" necessary to prove intelligence? Then kindly explain what about the details of the connections between the nerve cells in your brain lets you perform some task. More than "as I learned the task connections were broken and made until now, with what remains, it just works".

Top
 Profile  
 
Offline
 Post subject: Re: Computers reach 5d on KGS
Post #16 Posted: Thu Jun 02, 2011 5:05 am 
Beginner

Posts: 16
Liked others: 6
Was liked: 0
Rank: 9k
KGS: iazzi
RobertJasiek wrote:
Nothing changes ALA programs do only use sheer calculation power. Humans will have to "justify" their superiority only when computers start to explain their decisions by human-readable reasoning and can maintain their hard- and software alone.


Actually the goal in computer chess has shifted to use less power than before. Computers stronger than Deep Blue now run on mobile phones. Pocket Fritz 4 is at Grand Master level and analyses (if I remember correctly) a few million times less positions than Deep Blue.

Computers can and do train people by showing variations and giving positional judgement. Even champions use them.

Most people would like to think otherwise of course, that computers are dumb and sheer power.

I think it is a safer and more relaxed attitude to just admit that computers are better chess players and "understand" chess better, and that this will apply to go at some point. Board games are a minor use for human intelligence. If we take it too badly that computers are better than us here, what will happen when they will surpass humans in the really important stuff?

Top
 Profile  
 
Offline
 Post subject: Re: Computers reach 5d on KGS
Post #17 Posted: Thu Jun 02, 2011 5:25 am 
Lives in sente

Posts: 1037
Liked others: 0
Was liked: 180
More generally (on task that require intelligence)

Yes, back then we thought we'd soon have computers that could interpet speech, etc. But that was because we were rather naive about the difficulty of the task. In the process we have learned a great deal about human languages and how in practice they depend on far more than rules of language and the meaning of words.

An example?

"The chickens are ready to eat"
"The steaks are ready to eat"

The first you find ambiguous but the second not. But it's not by any meaning of words or rules of language by which you determine that the steaks must be cooked, couldn't be hungry. You've just called your entire knowledge about how things behave in the real world into play.

Top
 Profile  
 
Offline
 Post subject: Re: Computers reach 5d on KGS
Post #18 Posted: Thu Jun 02, 2011 5:49 am 
Lives in gote
User avatar

Posts: 324
Location: Dresden
Liked others: 26
Was liked: 22
Rank: KGS 7 kyu
KGS: Mnemonic, dude13
hyperpape wrote:
What goes unmentioned in Kurzweil's comment is that people once thought that once we had a chess playing computer, we would have computers that recognized speech, had vision and could write a novel. But it turned out that chess was vastly easier than those, and really didn't lead to much progress on those fronts. So the earlier valuation of a chess playing computer was based on massive factual errors.

Kurzweil does comment on this belief in his book, but the professional community has long since abandoned the notion that chess (or go for that matter) are the Holy Grail or computing or AI. Sure, they are important steppingstones, but the accepted test for intelligence is still the Turing Test (or variations thereof) According to Kurzweil 'Strong AI' will have been developed by 2030 and will have surpassed all (unaugmented) human intelligence by 2040.

_________________
While I was teaching the game to a friend of mine, my mother from the other room:
"Cutting? Killing? Poking out eyes? What the hell are you playing?"

Top
 Profile  
 
Offline
 Post subject: Re: Computers reach 5d on KGS
Post #19 Posted: Thu Jun 02, 2011 5:52 am 
Tengen

Posts: 4380
Location: North Carolina
Liked others: 499
Was liked: 733
Rank: AGA 3k
GD Posts: 65
OGS: Hyperpape 4k
I have a hard time seeing the point you're making, Mike. I agree that we had naive expectations about how hard those problems would be.

Alternately, you can say that we simplified the problem space with chess. Very early on, I think people assumed you would teach a computer to play chess by teaching it to think it like a human.

In one way or another, people had assumed problems like chess were more tightly coupled to general purpose AI, and they weren't.

(Btw: that last paragraph steps into a minefield in philosophy of language. You could argue forever about whether you can understand words like 'steak' and 'eat' without realizing that a steak couldn't be hungry. I recommend against such discussions unless you take a perverse pleasure in them. Without stepping further into that minefield--we haven't even really taught computers the meaning of words, or the rules of language, so I think you're not getting the obstacles quite right).

_________________
Occupy Babel!

Top
 Profile  
 
Offline
 Post subject: Re: Computers reach 5d on KGS
Post #20 Posted: Thu Jun 02, 2011 5:55 am 
Tengen

Posts: 4380
Location: North Carolina
Liked others: 499
Was liked: 733
Rank: AGA 3k
GD Posts: 65
OGS: Hyperpape 4k
@Mnemonic Well, that's the reason why the importance of chess was downgraded. And it's a good reason!

_________________
Occupy Babel!

Top
 Profile  
 
Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 79 posts ]  Go to page 1, 2, 3, 4  Next

All times are UTC - 8 hours [ DST ]


Who is online

Users browsing this forum: No registered users and 1 guest


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Search for:
Jump to:  
Powered by phpBB © 2000, 2002, 2005, 2007 phpBB Group