What you like / dislike about Leela 0.8.0?

[goame]

For example:
I really like the gpu support
How many gpus and cpus can Leela use?

But the heatmap needs a lot improvements.

[pnprog]

Hi,

What I like the most with Leela, per order of preference:

1. There is a gtp version. For me, this is THE killer feature (and plenty of other informations are available through its stderr)
2. Leela is so strong, because... yeah... GnuGo as well has a gtp mode
3. There is a dedicated Linux version, no need for me to use wine
4. Leela is free (but not opensource)

[goame]

Hi,

What I like the most with Leela, per order of preference:

1. There is a gtp version. For me, this is THE killer feature (and plenty of other informations are available through its stderr)
2. Leela is so strong, because... yeah... GnuGo as well has a gtp mode
3. There is a dedicated Linux version, no need for me to use wine
4. Leela is free (but not opensource)

I love killer features
It makes me really happy to find moves which Leela 5 dan(ok it's even stronger on my hardware) hasn't seen or evaluated as not so good in the first moment.

It would be nice to get an improved heatmap for example:
3 different colors for the 3 best Win% moves.
3 different colors for the 3 best Net Prob% moves.
And one golden color for the move which has the best Win% + Net Prob%
Of course only for the 5 or 10 first moves which have the highest simulations.

[Krama]

On 20000 rolls (I use medium GPU) how strong is this version compared to EGF player?

[pookpooi]

The site is down for so long that Leela had already released version 0.90 which is two stones stronger than 0.80.

[Gomoto]

Have you seen LeelaX on KGS, please release .......
I am very exited on this one.

Very cool job on Leela by Gian-Carlo.

[Garf]

Have you seen LeelaX on KGS, please release .......
I am very exited on this one.

Very cool job on Leela by Gian-Carlo.

SGF files have:

GTP Engine for LeelaX (white): Leela version 0.9.0. I will resign when I have lost. If you are sure you are winning but I haven't resigned yet, the status of some groups is not yet clear to me. I will pass out the game when I have won. You can download the latest stable version at https://sjeng.org/leela

Version number is the same as the new public release.

[Gomoto]

Leela is great.

Single most important feature still missing: variation tree.

I have to use two go programms for now, when I analyze with Leela: One for the variations, and Leela running on the side used to reload the sgf for each variation

[goame]

Leela is great.

Single most important feature still missing: variation tree.

I have to use two go programms for now, when I analyze with Leela: One for the variations, and Leela running on the side used to reload the sgf for each variation

A variantion tree is also very important.
But even more important for me is to have a super heatmap. I mean you can compare it with Zens heatmap. Heatmap ranking: Leela 1 kyu vs Zen 10 dan.

[Gomoto]

I feel Leela 0.9 is stronger than Zen 6 because its neural net is superior. The win percentages of the neural network seem to help a lot. Leela has got a very good intuition.

I do not feel Zens Heatmap is superior to Leelas move probabilities.

One feature of Leela I like a lot: Click in the analysis window on a line and the variation is shown with move numbers on the board. (an option to show the numbers & stones would be nice).

An further option to show the 5 best moves colored by winning percentage instead of move probability would also be good.

[goame]

I feel Leela 0.9 is stronger than Zen 6 because its neural net is superior. The win percentages of the neural network seem to help a lot. Leela has got a very good intuition.

I do not feel Zens Heatmap is superior to Leelas move probabilities.

One feature of Leela I like a lot: Click in the analysis window on a line and the variation is shown with move numbers on the board. (an option to show the numbers & stones would be nice).

An further option to show the 5 best moves colored by winning percentage instead of move probability would also be good.

But Zens heatmap has a structure (different colors).
Leelas move probabilities has only 3x the same color
Everytime with a 1% difference.
And you can see that 10% of the whole board are marked in this color.
Maybe this is a bug and he doesn't know how to solve it?

The analysis window feature is great.
Zen has an option to show the numbers on the stones. Should be also made for Leela.

You last point is a MUST HAVE.
But better to have this 5x for Win% and 5% for best human pros moves. With the option to switch both or one of them, on and off.

[pnprog]

Hi Gomoto,

One feature of Leela I like a lot: Click in the analysis window on a line and the variation is shown with move numbers on the board. (an option to show the numbers & stones would be nice).

An further option to show the 5 best moves colored by winning percentage instead of move probability would also be good.

You may want to check my other thread in the announcement forum. Maybe one step closer to what you needs.

Best regards,
pnprog

[Dontbtme]

What I like about Leela? Pretty much every thing.
What I don't like about Leela? This:

$$ White's dead at top right... Really??? :shock:
$$ ------------------
$$ | . . O O X . P P P |
$$ | . . O X X X X X P |
$$ | . . O O O X X X . |
$$ | . . . O O O O X X |
$$ | O O O X X X O O O |
$$ | X O X . . X O . . |
$$ | X X . X X . X O . |
$$ | . . . . X . X O . |
$$ | . . . . . X X O . |
$$ -------------------

Click Here To Show Diagram Code

[go]$$ White's dead at top right... Really??? :shock:
$$ ------------------
$$ | . . O O X . P P P |
$$ | . . O X X X X X P |
$$ | . . O O O X X X . |
$$ | . . . O O O O X X |
$$ | O O O X X X O O O |
$$ | X O X . . X O . . |
$$ | X X . X X . X O . |
$$ | . . . . X . X O . |
$$ | . . . . . X X O . |
$$ -------------------[/go]

Oh, but this is what the 0.10.0 version thinks... Don't know about the 0.8.0 one, sorry... -_-

[lightvector]

Keep in mind that Leela is only strong on 19x19. On all board sizes other than 19x19, it's fairly weak as it uses no neural nets, and the author seems to be completely focused only on improving the 19x19 play for now.

Of course, on 19x19, the playouts will make the same mistake as they do on the small board and probably judge white's stones there as dead. However, possibly the neural net will have learned better and will help compensate. Overall, Leela is pretty bad at understanding semeai, seki, and local tactics because its search and playouts are poor, far worse than either of Zen 6 or Crazystone. All of its strength comes from the things that neural nets are good at - whole board judgment and shape instinct in open-space fights.

[Dontbtme]

So...
I tried laying out different seki and dead groups on a 19x19 board using Drago, to see if the board size would change anything.

Here's the sgf in case anyone would want to try this on his own Leela:


Then I opened the file on Leela and asked her to score it. Here's what she thinks is alive and dead:

]$$ Test on 19x19 -_-
$$ ------------------
$$ | X . P X . X O . O . Z . Z O X . P P P |
$$ | X . P X X X O O O O Z Z Z O X X X X P |
$$ | X X P X . X X X X X O O O O O O O X . |
$$ | O O X X X X . . . . . . O . O . O X X |
$$ | . O O X . . . . . . . . O O O O O O O |
$$ | O . O X . . . . . . . . . . . . . . . |
$$ | X O O X . . . . . . . . . . . . . . . |
$$ | X X O X . . . . . . . . . . . . . . . |
$$ | . X O X . . . . . . . . . . . . . . . |
$$ | X X O X . . . . . . . . . . . . . . . |
$$ | . X O X . . . . . . . . . . . O O O O |
$$ | P P X X . . . . . . . . . . O O X X X |
$$ | . X O X . . . . . . . . . . O X X . . |
$$ | X X O X . . . . . . . . . . O X . P . |
$$ | . X O X . . . . . . . . . . O X X X X |
$$ | X X O X O O . . . . . . O O O O O X O |
$$ | O O O O . O O O O O O O O Z Z Z O O O |
$$ | Z Z Z O O O Z Z Z Z Z O Z Z . Z Z O . |
$$ | . . Z O . O Z . O . Z O Z . O . Z O . |
$$ -------------------

Click Here To Show Diagram Code

[go]]$$ Test on 19x19 -_-
$$ ------------------
$$ | X . P X . X O . O . Z . Z O X . P P P |
$$ | X . P X X X O O O O Z Z Z O X X X X P |
$$ | X X P X . X X X X X O O O O O O O X . |
$$ | O O X X X X . . . . . . O . O . O X X |
$$ | . O O X . . . . . . . . O O O O O O O |
$$ | O . O X . . . . . . . . . . . . . . . |
$$ | X O O X . . . . . . . . . . . . . . . |
$$ | X X O X . . . . . . . . . . . . . . . |
$$ | . X O X . . . . . . . . . . . . . . . |
$$ | X X O X . . . . . . . . . . . . . . . |
$$ | . X O X . . . . . . . . . . . O O O O |
$$ | P P X X . . . . . . . . . . O O X X X |
$$ | . X O X . . . . . . . . . . O X X . . |
$$ | X X O X . . . . . . . . . . O X . P . |
$$ | . X O X . . . . . . . . . . O X X X X |
$$ | X X O X O O . . . . . . O O O O O X O |
$$ | O O O O . O O O O O O O O Z Z Z O O O |
$$ | Z Z Z O O O Z Z Z Z Z O Z Z . Z Z O . |
$$ | . . Z O . O Z . O . Z O Z . O . Z O . |
$$ -------------------[/go]

Anyway, my conclusion is that Leela knows MOSTLY what a dead group is (she missed the black one on the right ), but doesn't understand seki AT ALL
Don't get me wrong, I still like Leela a lot (she's my master after all ) but, err... I wish she hadn't that kind of awkward shortcoming...