DeepMind give AlphaGo strength graph, and it will shock you!

For discussing go computing, software announcements, etc.
pookpooi
Lives in sente
Posts: 727
Joined: Sat Aug 21, 2010 12:26 pm
GD Posts: 10
Has thanked: 44 times
Been thanked: 218 times

DeepMind give AlphaGo strength graph, and it will shock you!

Post by pookpooi »

Image
RobertJasiek
Judan
Posts: 6272
Joined: Tue Apr 27, 2010 8:54 pm
GD Posts: 0
Been thanked: 797 times
Contact:

Re: DeepMind give AlphaGo strength graph, and it will shock

Post by RobertJasiek »

They continue the same mistake of setting amateur 9d below professional 1p. If AlphaGo v.18 were much stronger than human 9p, it would not have lost any game against Lee Sedol.
pookpooi
Lives in sente
Posts: 727
Joined: Sat Aug 21, 2010 12:26 pm
GD Posts: 10
Has thanked: 44 times
Been thanked: 218 times

Re: DeepMind give AlphaGo strength graph, and it will shock

Post by pookpooi »

RobertJasiek wrote:They continue the same mistake of setting amateur 9d below professional 1p. If AlphaGo v.18 were much stronger than human 9p, it would not have lost any game against Lee Sedol.

Agree, this is my version of the graph, I don't claim it's 100% accurate though cause professional dan work in different way than kyu - amateur dan.

Image
Uberdude
Judan
Posts: 6727
Joined: Thu Nov 24, 2011 11:35 am
Rank: UK 4 dan
GD Posts: 0
KGS: Uberdude 4d
OGS: Uberdude 7d
Location: Cambridge, UK
Has thanked: 436 times
Been thanked: 3718 times

Re: DeepMind give AlphaGo strength graph, and it will shock

Post by Uberdude »

Gosh, beating Nature/Fan Hui AlphaGo with 4 stones is impressive, but I reserve my judgement about the meaning of that in actual strength given bots may have trouble playing with/against handicap. A better test would be could/did it give 4 stones to Fan Hui? If AlphaGo v18 were 4000 Elo and Lee Sedol 3500 then it should win a single game 95% of the time and the match 5-0 with 78% chance so it doesn't look 4000 let alone 4500. Having said that it only lost game 4 due to one move far below the usual high standard of its moves (and subsequent monte carlo nonsense which can sort of be dismissed, though not entirely as the ability to play sensibly and well when behind is important, though perhaps not so much if AlphaGo fixes that bug and is then never behind in any game against a human ever!) so if they could fix that bug/blunder/weakness then such high Elos might be plausible. However, I expect humans to improve how they do against AlphaGo with practice if Deepmind make it more widely available, though of course AlphaGo will also likely keep improving. We can already see than in just 5 games Lee Sedol was able to learn and adapt how to play against AlphaGo with some success, whilst AlphaGo v13 needed 60 million positions and games to get to its level (plus scores of clever developers/researchers) and AlphaGo v18 probably used far more, so humans are still pretty good at this learning thing.

P.S. ajahuang was on KGS yesterday testing the gtp interface for an AlphaGoBot to play on KGS, subject to Google's permission. Said it would likely first play in some arranged matches against some pros / 9ds before (if) being more widely available. Exciting!
pookpooi
Lives in sente
Posts: 727
Joined: Sat Aug 21, 2010 12:26 pm
GD Posts: 10
Has thanked: 44 times
Been thanked: 218 times

Re: DeepMind give AlphaGo strength graph, and it will shock

Post by pookpooi »

Uberdude wrote:P.S. ajahuang was on KGS yesterday testing the gtp interface for an AlphaGoBot to play on KGS, subject to Google's permission. Said it would likely first play in some arranged matches against some pros / 9ds before (if) being more widely available. Exciting!

I was also there, very exciting time even it's a false positive
uPWarrior
Lives with ko
Posts: 199
Joined: Mon Jan 17, 2011 1:59 pm
Rank: KGS 3 kyu
GD Posts: 0
Has thanked: 6 times
Been thanked: 55 times

Re: DeepMind give AlphaGo strength graph, and it will shock

Post by uPWarrior »

I think that graph is believable is you treat "9d" as "average 9d". In that case, Lee Sedol himself would not be 3500 but probably 3800+.

Remember that these scales are arbitrary anyway.
yoyoma
Lives in gote
Posts: 653
Joined: Mon Apr 19, 2010 8:45 pm
GD Posts: 0
Location: Austin, Texas, USA
Has thanked: 54 times
Been thanked: 213 times

Re: DeepMind give AlphaGo strength graph, and it will shock

Post by yoyoma »

Well I can certainly see why they were "quietly confident" going into the Lee Sedol match!

BTW it played 7 games on Tygem today and won all 7.
Krama
Lives in gote
Posts: 436
Joined: Mon Jan 06, 2014 3:46 am
Rank: KGS 5 kyu
GD Posts: 0
Has thanked: 1 time
Been thanked: 38 times

Re: DeepMind give AlphaGo strength graph, and it will shock

Post by Krama »

yoyoma wrote:Well I can certainly see why they were "quietly confident" going into the Lee Sedol match!

BTW it played 7 games on Tygem today and won all 7.


What nickname is it on tygem?

The "deepmind" account actually has something like 40 wins 20 loses.
yoyoma
Lives in gote
Posts: 653
Joined: Mon Apr 19, 2010 8:45 pm
GD Posts: 0
Location: Austin, Texas, USA
Has thanked: 54 times
Been thanked: 213 times

Re: DeepMind give AlphaGo strength graph, and it will shock

Post by yoyoma »

Krama wrote:
yoyoma wrote:Well I can certainly see why they were "quietly confident" going into the Lee Sedol match!

BTW it played 7 games on Tygem today and won all 7.


What nickname is it on tygem?

The "deepmind" account actually has something like 40 wins 20 loses.


Yes the deepmind account. I just meant it's most recent 7 games.
Krama
Lives in gote
Posts: 436
Joined: Mon Jan 06, 2014 3:46 am
Rank: KGS 5 kyu
GD Posts: 0
Has thanked: 1 time
Been thanked: 38 times

Re: DeepMind give AlphaGo strength graph, and it will shock

Post by Krama »

yoyoma wrote:
Krama wrote:
yoyoma wrote:Well I can certainly see why they were "quietly confident" going into the Lee Sedol match!

BTW it played 7 games on Tygem today and won all 7.


What nickname is it on tygem?

The "deepmind" account actually has something like 40 wins 20 loses.


Yes the deepmind account. I just meant it's most recent 7 games.


But in last 7 games it won 2 and lost 5 or was it won 3 lost 4
yoyoma
Lives in gote
Posts: 653
Joined: Mon Apr 19, 2010 8:45 pm
GD Posts: 0
Location: Austin, Texas, USA
Has thanked: 54 times
Been thanked: 213 times

Re: DeepMind give AlphaGo strength graph, and it will shock

Post by yoyoma »

I'm at work now so I can't check with the client, I'm going off this reddit post https://www.reddit.com/r/baduk/comments ... ns_so_far/ which has this image linked: http://postimg.org/image/rvxwwof93/

There is has seven red circles in a row at the end, and below you can see those games played on March 25.
sorin
Lives in gote
Posts: 389
Joined: Wed Apr 21, 2010 9:14 pm
Has thanked: 418 times
Been thanked: 198 times

Re: DeepMind give AlphaGo strength graph, and it will shock

Post by sorin »

yoyoma wrote:I'm at work now so I can't check with the client, I'm going off this reddit post https://www.reddit.com/r/baduk/comments ... ns_so_far/ which has this image linked: http://postimg.org/image/rvxwwof93/

There is has seven red circles in a row at the end, and below you can see those games played on March 25.


Given that Aja Huang said he didn't get Google approval to play on KGS yet, I doubt that the deepmind account on Tygem is AlphaGo, at least it won't be the latest version.
Why would they give approval for Tygem, but not for KGS?
Kirby
Honinbo
Posts: 9553
Joined: Wed Feb 24, 2010 6:04 pm
GD Posts: 0
KGS: Kirby
Tygem: 커비라고해
Has thanked: 1583 times
Been thanked: 1707 times

Re: DeepMind give AlphaGo strength graph, and it will shock

Post by Kirby »

sorin wrote:Given that Aja Huang said he didn't get Google approval to play on KGS yet, I doubt that the deepmind account on Tygem is AlphaGo, at least it won't be the latest version.
Why would they give approval for Tygem, but not for KGS?


Didn't Aja Huang also say that 'deepmind' on Tygem was his account [1]? Is it possible that 'deepmind' on Tygem is not "pure AlphaGo", but rather Aja Huang + AlphaGo - maybe experimenting a bit, or just playing around?

Just a theory, but it could explain things.

---
[1] https://www.reddit.com/r/baduk/comments ... _on_tygem/
KillerDucky wrote:It's Aja Huang. He said so himself in the youtube stream, and denied that AlphaGo played on the account.
be immersed
yoyoma
Lives in gote
Posts: 653
Joined: Mon Apr 19, 2010 8:45 pm
GD Posts: 0
Location: Austin, Texas, USA
Has thanked: 54 times
Been thanked: 213 times

Re: DeepMind give AlphaGo strength graph, and it will shock

Post by yoyoma »

They aren't exactly straightforward about it. Yes earlier Aja Hwang had said that deepmind was his own personal account. But later there was a Korean article with a picture of Demis Hassibis and the CEO of Tygem. The title was something like "Thanks Tygem!". Even in that article it's sorta like Demis is saying it's Aja's account, but he sorta "indirectly" confirmed it. It's like they are saying it's Aja's personal account, but they are no longer directly denying that he used it for AlphaGo anymore.

I want to be careful about this too but at this point is just seems overwhelmingly likely that AlphaGo is playing on that account, just for some reason Deepmind just doesn't want to publicize this. That's my take at least.
Kirby
Honinbo
Posts: 9553
Joined: Wed Feb 24, 2010 6:04 pm
GD Posts: 0
KGS: Kirby
Tygem: 커비라고해
Has thanked: 1583 times
Been thanked: 1707 times

Re: DeepMind give AlphaGo strength graph, and it will shock

Post by Kirby »

be immersed
Post Reply