Life In 19x19
http://www.lifein19x19.com/

Downloadable trained neural net for Go
http://www.lifein19x19.com/viewtopic.php?f=18&t=13066		 Page 1 of 1
Author:  John Tilley [ Sun Apr 10, 2016 2:19 pm ]
Post subject:  Downloadable trained neural net for Go
There is a website that allows you to play Go against a deep neural network - all implemented in javascript. The website is powered by jgoboard and the ConvNetjs libraries.

Their trained downloadable neural net for Go is available, which might be of interest to some.It was trained on GoGoD games

"This neural net was trained to make moves similar to the moves made by professional players in a dataset of over 80,000 professional Go games."

https://chrisc36.github.io/deep-go/

Everything is written in javascript, runs in the browser and uses CPUs <not GPUs> - which keeps things simple.

The paper that describes all this was written by Amos Storkey (Edinburgh University) and Christopher Clark (Allen Institue for Artificial Intelligence) - presented in 2015 - on training Deep Convolutional Neural Networks to Play Go.

There is a good intro to Deep Learning on the ConvNetjs page
Author:  Krama [ Mon Apr 11, 2016 3:56 am ]
Post subject:  Re: Downloadable trained neural net for Go
If you implement these "shape" moves that this NN provides into MCTS so it doesn't pick random moves but moves suggested by NN you get something similar to Alphago?
Author:  uPWarrior [ Mon Apr 11, 2016 4:00 am ]
Post subject:  Re: Downloadable trained neural net for Go
You would be 2/3 of the way, you also need the value network.

(AlphaGo also used 2 distinct policy networks, one fast (less accurate) and one slow (more accurate).)
Author:  Uberdude [ Mon Apr 11, 2016 4:59 am ]
Post subject:  Re: Downloadable trained neural net for Go
Krama wrote:
If you implement these "shape" moves that this NN provides into MCTS so it doesn't pick random moves but moves suggested by NN you get something similar to Alphago?

Nope, you would get something similar to the latest versions of Zen, Crazystone, Aya, etc which are MCTS bots which have recently added Neural Nets, or darkforest (from Facebook) which has always used neural nets.

uPWarrior wrote:
You would be 2/3 of the way, you also need the value network.

It's worth adding that that missing third is the hardest and most innovative part of AlphaGo. There was this nice chart from the AlphaGo paper (Fan Hui version, it's gotten stronger since) showing the strengths using various combinations of the components:
Attachment:
AlphaGo components.png
AlphaGo components.png [ 14.22 KiB | Viewed 14127 times ]
Author:  macelee [ Mon Apr 11, 2016 5:02 am ]
Post subject:  Re: Downloadable trained neural net for Go
This program plays beautiful opening, definitely better than shodan level. It is rather weak in mid-game which is to be expected.
Author:  uPWarrior [ Mon Apr 11, 2016 5:47 am ]
Post subject:  Re: Downloadable trained neural net for Go
Uberdude wrote:
It's worth adding that that missing third is the hardest and most innovative part of AlphaGo.


Definitely. I think it is not only the hardest to conceptually figure out how to obtain (the RL idea was great), but also the hardest to implement without proper hardware.

On the other hand, it requires the previous building blocks to be in place, so it is nice that there is an open source effort moving forward.
Author:  Mike Novack [ Mon Apr 11, 2016 6:54 am ]
Post subject:  Re: Downloadable trained neural net for Go
Since people are probably interested in the development of a NN program that does not require much in the way of resources, we perhaps should be opening a thread to talk about Julie (which just appeared on the scene). OK, not a very strong player in the machine tournament. But it would be good if we had some information about how it might do against some of us not so strong humans. The reason is that it appears to be able to run fast on very modest hardware.

So yes it got beat by most the other programs there, but considering the minimal hardware and the minimal time it used, able to do what it did with more than two orders of magnitude less resources.
Author:  Pippen [ Mon Apr 11, 2016 7:19 am ]
Post subject:  Re: Downloadable trained neural net for Go
macelee wrote:
This program plays beautiful opening, definitely better than shodan level. It is rather weak in mid-game which is to be expected.


I played it (with Black), won relatively easily and I estimate it at 1k-level. I think with a little bit of work (like how to pass or resign) this could become the best free-available bot. And with a little bit more work this could become the best free available 4-5d Bot.

Attachments:
test.jpg
test.jpg [ 94.62 KiB | Viewed 14077 times ]
Author:  macelee [ Mon Apr 11, 2016 7:33 am ]
Post subject:  Re: Downloadable trained neural net for Go
Pippen wrote:
macelee wrote:
This program plays beautiful opening, definitely better than shodan level. It is rather weak in mid-game which is to be expected.


I played it (with Black), won relatively easily and I estimate it at 1k-level. I think with a little bit of work (like how to pass or resign) this could become the best free-available bot. And with a little bit more work this could become the best free available 4-5d Bot.


Agreed. Combine it with a reasonable 'score estimator' type of code so that it knows when to resign. Should be quite easy.
Author:  Krama [ Mon Apr 11, 2016 7:42 am ]
Post subject:  Re: Downloadable trained neural net for Go
Pippen wrote:
macelee wrote:
This program plays beautiful opening, definitely better than shodan level. It is rather weak in mid-game which is to be expected.


I played it (with Black), won relatively easily and I estimate it at 1k-level. I think with a little bit of work (like how to pass or resign) this could become the best free-available bot. And with a little bit more work this could become the best free available 4-5d Bot.


Try to disable auto move and show analysis of the moves then play on your own against someone else and use the moves it suggests. However if it suggests a blunder type of move then you play a move you think is correct.
Author:  Joaz Banbeck [ Mon Apr 11, 2016 7:47 am ]
Post subject:  Re: Downloadable trained neural net for Go
macelee wrote:
...It is rather weak in mid-game...


Exceptionally so. I tried playing it and after about 100 to 150 moves it starts giving away groups.
Author:  bayu [ Mon Apr 11, 2016 10:37 am ]
Post subject:  Re: Downloadable trained neural net for Go
Very nice. I needed an undo in a corner. At the end though, it started to make pointless moves. And at some stage claimed that suicide isn't allowed (I think it tried to suicide itself) and switched colours. That's a fine tesuji, indeed. Is there a way to score or is this no-pass go?
Author:  Uberdude [ Mon Apr 11, 2016 11:31 am ]
Post subject:  Re: Downloadable trained neural net for Go
I started off with a common opening pattern of the fighting Chinese and it copied standard play for a while, but when I started a semeai in a corner it got confused and even after it was my 3 libs to its 2, it continued surrounding one of the outside groups (which was eyeless with about 7 libs but alive due to the semeai) whilst I proceeded to claim the rest of the board and win by loads. It also amusingly made the following local mistake (which some MCTS should fix):

Click Here To Show Diagram Code
[go]$$B
$$ . O . . |
$$ . O 3 . |
$$ . X O 2 |
$$ , X O 1 |
$$ X O X . |
$$ X O X . |
$$ . . . . |
$$ --------+[/go]
Author:  GoEye2012 [ Tue Apr 12, 2016 8:27 am ]
Post subject:  Re: Downloadable trained neural net for Go
Kill all stones of the AI in sente :)

Attachments:
Screen Shot 2016-04-12 at 11.25.53 PM.png
Screen Shot 2016-04-12 at 11.25.53 PM.png [ 407.87 KiB | Viewed 13926 times ]
Author:  wauske [ Tue Apr 12, 2016 11:31 am ]
Post subject:  Re: Downloadable trained neural net for Go
Well, you guys are a lot stronger than I am so I have yet to win :clap:

Luckily I am a lot more tech-savvy than I am a Go player. I noticed that the site only offered the net.js as a download, not the other pre-requisite files. So, I downloaded them in their original format and zipped it. For those wanting to play with it offline or on their own (private) webspace, here is the download link: http://millsf.home.xs4all.nl/Deepgo.zip

This is a direct, 1-on-1 download of the page. All credit goes to its creator.

To use it: unzip it to any directory and open the index.html (Chrome or Edge work fine, IE11 doesn't). I also uploaded it to a private webserver which works too.

I'll also ask the owner for permission, should he decide not to grant it I'll remove the link right away.
Author:  Krama [ Wed Apr 13, 2016 4:05 am ]
Post subject:  Re: Downloadable trained neural net for Go
I noticed it can't read out ladders so you might want to play a ladder breaker and win :)
Author:  wauske [ Fri May 20, 2016 7:56 am ]
Post subject:  Re: Downloadable trained neural net for Go
wauske wrote:
Well, you guys are a lot stronger than I am so I have yet to win :clap:

Luckily I am a lot more tech-savvy than I am a Go player. I noticed that the site only offered the net.js as a download, not the other pre-requisite files. So, I downloaded them in their original format and zipped it. For those wanting to play with it offline or on their own (private) webspace, here is the download link: http://millsf.home.xs4all.nl/Deepgo.zip

This is a direct, 1-on-1 download of the page. All credit goes to its creator.

To use it: unzip it to any directory and open the index.html (Chrome or Edge work fine, IE11 doesn't). I also uploaded it to a private webserver which works too.

I'll also ask the owner for permission, should he decide not to grant it I'll remove the link right away.


Download has been updated.
Added functionality is that when opening the website on an Android Phone with Chrome 39 or newer you can choose "Add to home screen" from the menu. As far as I know this only works when running from webspace and not from internal storage but i haven't tried running it from internal storage.
The website will then behave like an app and appears to stay in memory longer which means you can open other apps and return to the DCNN without losing your game.

This is mostly experimental and I won't vouch for it working on every Android Phone but it works on my Moto X but doesn't from my Galaxy Tab 2 my guess would be that memory is the cuplprit.
Author:  Krama [ Fri May 20, 2016 10:08 am ]
Post subject:  Re: Downloadable trained neural net for Go
Would someone be willing to take any free go software that is open sourced and embed this neural network to it's MCTS?

I am wondering how strong can such a basic thing become.
Author:  yoyoma [ Fri May 20, 2016 11:26 am ]
Post subject:  Re: Downloadable trained neural net for Go
Krama wrote:
Would someone be willing to take any free go software that is open sourced and embed this neural network to it's MCTS?

I am wondering how strong can such a basic thing become.


Someone already added some limited DCNN capability to Pachi -- only the root node. Pasky is not actively developing Pachi anymore but he is supporting pull requests.

https://github.com/pasky/pachi/pull/28
Page 1 of 1 All times are UTC - 8 hours [ DST ]
Powered by phpBB © 2000, 2002, 2005, 2007 phpBB Group
http://www.phpbb.com/