Zen no longer gaining much from processing power

For discussing go computing, software announcements, etc.
Post Reply
hyperpape
Tengen
Posts: 4382
Joined: Thu May 06, 2010 3:24 pm
Rank: AGA 3k
GD Posts: 65
OGS: Hyperpape 4k
Location: Caldas da Rainha, Portugal
Has thanked: 499 times
Been thanked: 727 times

Zen no longer gaining much from processing power

Post by hyperpape »

I thought I'd highlight a post by Hideki Kato on the computer go mailing list. It seems that some of the same ideas that have made Zen so strong actually make it less able to benefit from increased processing power. http://computer-go.org/pipermail/comput ... 04894.html
pookpooi
Lives in sente
Posts: 727
Joined: Sat Aug 21, 2010 12:26 pm
GD Posts: 10
Has thanked: 44 times
Been thanked: 218 times

Re: Zen no longer gaining much from processing power

Post by pookpooi »

While it's not directly stronger, it can play faster without drop in strength. Playing fast always put pressure to the opponent, even in normal or long time setting. Imagine Zen used less than a second to make a move. But in the end, what make Zen so strong is software which is still develop continuously. Hardware is really not the point here.
badukJr
Lives with ko
Posts: 289
Joined: Sat Jan 07, 2012 1:00 pm
Rank: 100
GD Posts: 100
Has thanked: 7 times
Been thanked: 42 times

Re: Zen no longer gaining much from processing power

Post by badukJr »

Also hideki is talking about massive parallel processing, which is different than raw processing power. A lot of computational problems become slow when divided between 100 s of cores. Single core flops may be different but he didn't say anything about it.
LexC
Dies with sente
Posts: 89
Joined: Wed Mar 07, 2012 11:19 am
Rank: KGS 3 kyu
GD Posts: 0
Location: France
Has thanked: 5 times
Been thanked: 1 time

Re: Zen no longer gaining much from processing power

Post by LexC »

He speak specifically of parrallezing on cluster mode ie with adding computers. But the montecarlo algorithm scale well with the number of core in the same computer
hyperpape
Tengen
Posts: 4382
Joined: Thu May 06, 2010 3:24 pm
Rank: AGA 3k
GD Posts: 65
OGS: Hyperpape 4k
Location: Caldas da Rainha, Portugal
Has thanked: 499 times
Been thanked: 727 times

Re: Zen no longer gaining much from processing power

Post by hyperpape »

badukJr: this is true, but I thought MCTS did pretty well in parallelization in the past. Also, aren't the biggest advances in computer speed coming from parallelization these days? (edit) Meaning that this would still slow down progress from more processing power.

Lex: what does he mean by "and the hardware" then?
Last edited by hyperpape on Thu Mar 22, 2012 1:47 pm, edited 1 time in total.
Mike Novack
Lives in sente
Posts: 1045
Joined: Mon Aug 09, 2010 9:36 am
GD Posts: 0
Been thanked: 182 times

Re: Zen no longer gaining much from processing power

Post by Mike Novack »

badukJr wrote:...... A lot of computational problems become slow when divided between 100 s of cores. Single core flops may be different but he didn't say anything about it.


But that wouldn't be the case with this computatonal problem. If you turned a "monitor" on to see where the program was spending its time you'd see that would be in conducting the individual playouts. And each of these is a computation independent of any other playout and the tree grows from each node independent of its growth from other nodes.

This is a good sort of problem in the sense of the work being easily divided among parallel processers. Possibly even one "executive" managing the tree with a lot of "workers" doing the playouts it assigns them (that depends upon the ratio of the work involved in managing and then later evaluating the tree compared to the work of each playout). Once that limit were reached the problem remains easily subdivided with the "chief executive" assigning a portion of the tree (separate nodes close to the root) to different "assistant executives" each with their staff of "workers".

For many other sorts of computational problems not so nicely divided up.
LexC
Dies with sente
Posts: 89
Joined: Wed Mar 07, 2012 11:19 am
Rank: KGS 3 kyu
GD Posts: 0
Location: France
Has thanked: 5 times
Been thanked: 1 time

Re: Zen no longer gaining much from processing power

Post by LexC »

Lex: what does he mean by "and the hardware" then?


He means additional computer
Post Reply