It is currently Wed Apr 24, 2024 5:01 pm

All times are UTC - 8 hours [ DST ]




Post new topic Reply to topic  [ 20 posts ] 

How many bots?
0 8%  8%  [ 2 ]
1 8%  8%  [ 2 ]
2 35%  35%  [ 9 ]
3 27%  27%  [ 7 ]
4 15%  15%  [ 4 ]
5 8%  8%  [ 2 ]
6 0%  0%  [ 0 ]
Total votes : 26
Author Message
Offline
 Post subject: Are we humans or are we bots?
Post #1 Posted: Thu Jan 03, 2013 4:06 pm 
Gosei
User avatar

Posts: 1848
Location: Bellevue, WA
Liked others: 90
Was liked: 837
Rank: AGA 5d
KGS: Capsule 4d
Tygem: 치킨까스 5d
So I hear a lot of people claim that bots play "differently" than humans, that they have a different style and just play like bots. But I wonder if such people can tell, so a small exercise to them and those interested in participating:

Below I've posted three games, non-blitz and all dan-level. The question is, can you tell how many of the players are bots and which ones are the bots? Games could be human vs. human, human vs. bot, or bot vs. bot. Should be easy right?







This post by Solomon was liked by 5 people: Akura, emeraldemon, Joaz Banbeck, Kirby, wineandgolover
Top
 Profile  
 
Offline
 Post subject: Re: Are we humans or are we bots?
Post #2 Posted: Thu Jan 03, 2013 4:23 pm 
Lives in gote

Posts: 460
Liked others: 149
Was liked: 101
Rank: 3 kyu
Universal go server handle: billywoods
My guess is going to be:

1. Black bot, white human
2. Black human, white human
3. Black bot, white bot

Top
 Profile  
 
Offline
 Post subject: Re: Are we humans or are we bots?
Post #3 Posted: Thu Jan 03, 2013 4:25 pm 
Lives with ko

Posts: 289
Liked others: 7
Was liked: 42
Rank: 100
GD Posts: 100
I think when people talk about how 'bots' play differently, its that they have very specific flaws in their playing styles that can be exploited repeatedly until the author can update the code. This of course requires repeated playing that you won't see in this test.

You won't be able to derive any conclusions here then. A better test is to show a 10 or 20 game series and ask which player is bot or human.

Top
 Profile  
 
Offline
 Post subject: Re: Are we humans or are we bots?
Post #4 Posted: Thu Jan 03, 2013 5:03 pm 
Dies in gote

Posts: 62
Location: Granada, Spain | Osaka, Japan | Turku, Finland | Tokyo, Japan
Liked others: 50
Was liked: 22
Rank: KGS 3 kyu
KGS: Ellyster
I was going to say "All bots"... but in second thoughts:

1. Black bot, White bot
2. Black bot, White bot
3. Black human, White human

My twisted mind tells me that are the oposite that it looks


Last edited by Ellyster on Thu Jan 03, 2013 7:46 pm, edited 1 time in total.
Top
 Profile  
 
Offline
 Post subject: Re: Are we humans or are we bots?
Post #5 Posted: Thu Jan 03, 2013 5:58 pm 
Judan
User avatar

Posts: 5539
Location: Banbeck Vale
Liked others: 1103
Was liked: 1456
Rank: 1D AGA
GD Posts: 1512
Kaya handle: Test
I only have two guesses about the six

1. Black = bot
2. White = human


This is a great thread. :clap:

_________________
Help make L19 more organized. Make an index: https://lifein19x19.com/viewtopic.php?f=14&t=5207

Top
 Profile  
 
Offline
 Post subject: Re: Are we humans or are we bots?
Post #6 Posted: Thu Jan 03, 2013 6:30 pm 
Lives in sente

Posts: 706
Liked others: 252
Was liked: 251
GD Posts: 846
I don't think it's that easy if you've actually included some bots here.

Game 1

Black is not a bot. Moves :b11: are :b13: are too fashionable. For the same reason, I think white :w12: indicates a non-bot player. No further analysis.

Game 2

The :w12: high enclosure strikes me as a very human thing to do. It smells of ego. I think maybe white is not a bot. Also, :w18: shows jealously, a very non-bot trait. The sequence :b45: to :b49: is odd, but I'm not sure I'd attribute it to irrationality? I will assume so, therefore, not a bot.

Game 3

Some funny tenukis lead me to suspect that both players are bots.

Top
 Profile  
 
Offline
 Post subject: Re: Are we humans or are we bots?
Post #7 Posted: Thu Jan 03, 2013 8:31 pm 
Lives in gote
User avatar

Posts: 477
Liked others: 192
Was liked: 357
Rank: 5d
Haha, interesting idea :)

I think one factor that's still different is consistency (at whatever level). Even strong bots still seem to play a bit phrenetically.

It's been awhile since I've watched bots play though, so let's see if I'm right...

My guesses:

Game 1: Both players are human. There seems to be too much creativity and interplay between both players. As far as I know bots still don't play like that.

Game 2: Black seems like a bot, I think white's a human.

Game 3: White's a bot (or someone who's high). I'm going to go out on a limb here and guess that black is Sol pretending to be a bot :) (bonus points maybe?).

_________________
David

Go Game Guru: Learn Go | How to Get Better at Go | Go Game Shop | Go Boards | Baduk TV

Top
 Profile  
 
Offline
 Post subject: Re: Are we humans or are we bots?
Post #8 Posted: Thu Jan 03, 2013 9:33 pm 
Tengen

Posts: 4380
Location: North Carolina
Liked others: 499
Was liked: 733
Rank: AGA 3k
GD Posts: 65
OGS: Hyperpape 4k
Answers:
The only one that says anything to me is White in the third game. This is hard.


Question:
How did you choose these?

_________________
Occupy Babel!

Top
 Profile  
 
Offline
 Post subject: Re: Are we humans or are we bots?
Post #9 Posted: Thu Jan 03, 2013 11:00 pm 
Lives in gote

Posts: 653
Location: Austin, Texas, USA
Liked others: 54
Was liked: 216
1. Black=bot, White=human
2. No idea
3. Both bots.

Top
 Profile  
 
Offline
 Post subject: Re: Are we humans or are we bots?
Post #10 Posted: Fri Jan 04, 2013 12:25 am 
Oza
User avatar

Posts: 2644
Liked others: 304
Was liked: 631
Rank: kgs 6k
1. I'm confident white's not a bot... I don't think even bad bots screw up and then immediately peep the way this W does. B probably isn't a bot. There are a few moves in the UL that seem weird, but it's probably just a joseki I don't know.

2. I'm not confident here. I plead not enough data. W12 is a move that bots are much more likely to play than humans, but W smacked around B so badly that there's nothing stylistically notable for either side.

3. White is a really bad human - there are "following B around" moves that I wouldn't expect from a computer, in addition to whimsical, meaningless moves that remind me of gnugo. I'm fairly confident B is a human too; B has laser-vision when it comes to following through on threats he has made.

Top
 Profile  
 
Offline
 Post subject: Re: Are we humans or are we bots?
Post #11 Posted: Fri Jan 04, 2013 6:19 am 
Lives in sente

Posts: 774
Liked others: 137
Was liked: 155
I agree with gogameguru.

What stands out to me as particularly bot-like moves are 33 in game 2 - Black could draw back and enclose White instead of letting the White group escape and move 34 in game 3 - tenuki from the unsettled lower right corner. Especially the second would not happen to any dan level player who played several moves with the intent to make life for the group to then suddenly tenuki with the group still unsettled. Also, White in 2nd and Black in 3rd game play as if they were confident to outread their opponents.

Top
 Profile  
 
Offline
 Post subject: Re: Are we humans or are we bots?
Post #12 Posted: Fri Jan 04, 2013 8:14 am 
Lives in sente

Posts: 1037
Liked others: 0
Was liked: 180
Please note.

We were told "dan level" so that means MCTS based programs not more than a couple years old. Older experience with how bots play is not going to be relevant.

Don't expect fixed patterns of play from the bots. MCTS doesn't work that way.

Don't rule out moves because particularly "fashionable" or diabolically clever. Only those programs using a go knowledge AI to prepare a plausible move set going to be limited in this way. Straightforward MCTS can find any "best move".

Do expect some "style" consistencies though these not might help much determining bot or human but then again might under certain circumstances. I haven't yet met a modern bot that played a "territorially tight" style so if you see that, guess human.

Top
 Profile  
 
Offline
 Post subject: Re: Are we humans or are we bots?
Post #13 Posted: Fri Jan 04, 2013 10:14 am 
Tengen

Posts: 4380
Location: North Carolina
Liked others: 499
Was liked: 733
Rank: AGA 3k
GD Posts: 65
OGS: Hyperpape 4k
Mike
Hidden, because I don't want to bias other players. The point about fashionable moves is actually accurate. You're right that what you don't have to worry about is an opening/joseki book that rules out fashionable plays. However, a MCTS bot is no more likely to play a move that is fashionable today than a move that was fashionable 100 years ago, unlike human players who follow trends. And of course the bot is more likely to play a move that was never fashionable. So it is a potential indicator.

_________________
Occupy Babel!

Top
 Profile  
 
Offline
 Post subject: Re: Are we humans or are we bots?
Post #14 Posted: Fri Jan 04, 2013 11:44 am 
Honinbo

Posts: 10905
Liked others: 3651
Was liked: 3374
Humans or bots?

The two are not mutually contradictory. ;)

_________________
The Adkins Principle:
At some point, doesn't thinking have to go on?
— Winona Adkins

Visualize whirled peas.

Everything with love. Stay safe.

Top
 Profile  
 
Offline
 Post subject: Re: Are we humans or are we bots?
Post #15 Posted: Fri Jan 04, 2013 11:47 am 
Lives in sente

Posts: 946
Liked others: 1
Was liked: 41
Rank: IGS 5kyu
KGS: KoDream
IGS: SmoothOper
1) Both are human 2) white is a bot 3) white is a bot

It is difficult to tell without knowing which bots were selected since I suspect that they can have styles as varied as the humans that code them, for example Monte Carlo vs. Many Faces or GNU go.

One of the signs that I would expect of a bot is to do very well in life and death situations such as white in 2 where a search would yield good results.

The other is to have a fuseki with many tenuki and and a conventional handicap fuseki as in three.

If the bots were trained on databases of prior professional games then they could be indistinguishable from the pros by me.

Top
 Profile  
 
Offline
 Post subject: Re: Are we humans or are we bots?
Post #16 Posted: Sat Jan 05, 2013 12:56 pm 
Dies in gote
User avatar

Posts: 28
Liked others: 48
Was liked: 5
Rank: 3-5k
KGS: jenj
Kaya handle: genych
My guesses:
    1. Human − Human
    2. Human(B) − Bot(W)
    3. Human(B) − Bot(W)

Top
 Profile  
 
Offline
 Post subject: Re: Are we humans or are we bots?
Post #17 Posted: Sat Jan 05, 2013 2:19 pm 
Lives in gote
User avatar

Posts: 447
Liked others: 137
Was liked: 68
Rank: kgs 5kyu
KGS: Unusedname
answers
the first game feels like two humans

the second one is too short for me to tell but i'm leaning towards human

the third one feels like it has at least one bot


then again i'm only accustomed to playing against low level bots

edit: cool my guesses weren't that far off of everyone elses.

Top
 Profile  
 
Offline
 Post subject: Re: Are we humans or are we bots?
Post #18 Posted: Mon Jan 14, 2013 1:30 pm 
Gosei
User avatar

Posts: 1848
Location: Bellevue, WA
Liked others: 90
Was liked: 837
Rank: AGA 5d
KGS: Capsule 4d
Tygem: 치킨까스 5d
Solutions:

Game 1: Human vs. Human (bigbadwolf vs. zchen)
Game 2: Human vs. Human (Me vs. KGS 3d)
Game 3: Bot vs. Bot


This post by Solomon was liked by 4 people: emeraldemon, topazg, Unusedname, v00d00
Top
 Profile  
 
Offline
 Post subject: Re: Are we humans or are we bots?
Post #19 Posted: Fri Jan 25, 2013 8:57 pm 
Lives in gote

Posts: 460
Liked others: 149
Was liked: 101
Rank: 3 kyu
Universal go server handle: billywoods
Yay, 5/6 right!

Top
 Profile  
 
Offline
 Post subject: Re: Are we humans or are we bots?
Post #20 Posted: Mon Jan 28, 2013 9:38 am 
Lives in sente
User avatar

Posts: 866
Liked others: 318
Was liked: 345
Great post. Nice to see that the most popular poll answer was correct. I wonder if bots would have guessed so well?

Stuff like this will help this board live up to its potential, and grow.

_________________
- Brady
Want to see videos of low-dan mistakes and what to learn from them? Brady's Blunders

Top
 Profile  
 
Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 20 posts ] 

All times are UTC - 8 hours [ DST ]


Who is online

Users browsing this forum: No registered users and 1 guest


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Search for:
Jump to:  
Powered by phpBB © 2000, 2002, 2005, 2007 phpBB Group