Let me try a new thread, now that the previous one ended a bit sadly.
The past few days I added another 3000 games to the collection at
http://homepages.cwi.nl/~aeb/go/games/index.html

I wondered what fraction this is of the Japanese tournament games that
are available in SGF form.
Look at the Japanese tournaments where go4go has at least 100 games.

Gobase is asleep, I count 11268 games there (for these tournaments).
Remains the question about statistics for GoGoD.

Part of the required infrastructure was a list of pro names
with their rank development over time, see
http://homepages.cwi.nl/~aeb/go/misc/progression.html
Comments are welcome.

Maybe this more or less completes the Japanese tournament part.
It will take a nontrivial amount of time to do China/Korea in a similar way.

You might want to have a look at Gosei/Gos32/14.sgf. This game is not on Nihonkiin's Gosei page. On the other hand, there is a game in Kisei tournament having the same date and the same players. Please verify your source. If you rely on certain Asian servers' record, they mix up tournaments quite often.

Thanks! Fixed.
Good that someone checks the details carefully.
(In fact this was on my todo list: I had 11 sources for this game, 6 called it Gosei and 5 called it Kisei.)

Now that I write anyway, I can update the sentence "Gobase is asleep". It woke up for a short while, and today it has 88642 games.

Shinjin-O/ShO36/P12.sgf and Shinjin-O/ShO36/P13.sgf are the same game. The former contains incorrect player name - should be removed.

In the same tournament Shinjin-O/ShO36/P6.sgf's kifu is broken. In fact it is the same game as P7.sgf. P6 should be removed.

Thanks again! Fixed.

On http://homepages.cwi.nl/~aeb/go/games/index.html one can find
a freely available collection of Japanese professional go games
in SGF format.

Last time I published stats was when it had about 30000 games.
Today this collection has some 35000 games, mostly from Japanese
pro tournaments. There are a few older games as well.

I think this is the most extensive resource on Japanese games
but I may be unaware of recent or Asiatic sources.

An attempt to compare with gogod and go4go:

The Winter 2015 GoGoD collection has 86093 SGF files. There is no easy
way to sort them into Japanese / Chinese / Korean / other.
My collection has a bit over 10000 games from before 2016 not in GoGoD.
(JF, or anybody else, is of course free to take them.)

Go4Go reports 55831 games today. It is very uptodate, and always has
the latest games. It does not often add old games. Statistics of the
difference between aeb and go4go are similar to last time: go4go
has almost 18000 games in Japanese tournaments, and for these same
tournaments my collection has somewhat more than 24000 games.
The games missing in go4go are mostly older games.

Are the individual games which you posted there separately also included in the big archive?

_________________
“The only difference between me and a madman is that I’m not mad.” — Salvador Dali ★ Play a slooooow correspondence game with me on OGS?

Yes. The many smaller per-tournament archives are updated more frequently, but eventually all ends up in the single big archive.

A moment ago I sorted some Meijin games and noticed that some sources give
2016-06-15 Nishi Takenobu vs Yukawa Mitsuhisa
as 42nd Meijin, and other sources call it 43rd Tengen.
I think it should be Tengen, but go4go says Meijin. Am I mistaken?

I understand everyone wishes to be very careful with their own database, but I look at this and see opportunities for collaboration.

_________________
Occupy Babel!

You are right this is a Tengen game. My original source 新浪围棋 was wrong. This is a Kansai Kiin game - they do not keep tournament records as well as Nihon Kiin. They only get three static web pages covering tournament games from previous 3 weeks. These pages then get overwritten when new data is available. Luckily from about a year ago I started using a script to collect and save these pages. So I have an official record to check against.

On the one hand, it is unclear how cooperation between an open source project and a commercial project should be organized.
On the other hand, to each the existence of the other is somewhat useful.
Let me take the opportunity to mention that more Ibero-Japan Cup games are available.

Your collection is public domain, so that by itself opens up some potential--I don't know whether you thought about the possibility of some other database incorporating yours, and whether you'd welcome it or regard it as a bit rude (the law isn't everything).

Anyway, I'm not trying to tell anyone what to do. That would be completely unreasonable, since you two are doing the legwork of creating those collections, not me.

_________________
Occupy Babel!

I would welcome it, of course. It happened several times, sometimes because I suggested it.

That was half a year ago. The first published collection was on 2000-01-01 and had 1111 games, probably the only largish public domain collection. Yesterday the count passed 40000.

Thank you!

aeb: Michael Redmond recently did a video and sgf review of a Dosaku game, and his sgf differs from yours at http://homepages.cwi.nl/~aeb/go/games/g ... ku/052.sgf with info
1670-05-06 Kanbun 10-3-17 Kikugawa Yuseki Honinbo Dosaku 2 W+R 143

His record at http://www.usgo.org/news/wp-content/upl ... edited.sgf has black 66 at d2 as a tesuji instead of the more natural e3 block, to prevent c4 atari being sente which is where black wants to link up. When someone linked your collection (thanks!) before the Redmond sgf was available I did wonder when replaying it why white didn't atari there (maybe black ignores and pushes in the centre?).

Yes, thanks. I saw that sgf (but not the video). Concerning this game, I have five versions, and
(where the Redmond version is 4.sgf and my published version is 5.sgf).
The reason that I picked 5.sgf was purely formal: it is the "middle" one: two versions differ from it in move 66, two other versions in move 68.

Andrew

The traditional version of this game (i.e. the version known the longest) has just 99 moves and 66 is at E3 and 68 at B5. When Go Seigen gave his commentary on it, he raised no query about 66 (but did discuss the alternative of 67 at 69 - he concluded 67 was "inevitable"). But he did say 68 (at B5) was a mistake, though in the sense that it was a bad play rather than a typo (or brusho).

When Sakai Takeshi published his more recent book on Dosaku he gave a version with 143 moves and with 66 at D2 and 68 at B7. This version was also used by the Nihon Ki-in in a complete collected of Dosaku's games but they added a note to say that this record was full of misprints.

For that reason, the GoGoD version retains the Go Seigen moves up to 99 and adds the other moves, with a suitable note, but that was an arbitrary choice, swayed no doubt by Go's eminence! However, Go came in for some criticism for his Dosaku book. I can't remember if it was Sakai who led the chorus

I have seen no discussion of reasons for favouring one version over the other, though I imagine it would always be normal to plump for the longer one.

The game also comes with two different dates. All the versions simply give the result as W+ (not W+R), and some specifically say that the rest of the moves are unknown (this is very common with games of this era, both in Japan and China).

The AGA/Redmond version gives Black as Kikukawa. This is a possible reading but Hayashi Yutaro researched these things by going to family registration records and he gives Kikugawa, which is also the commoner reading anyway.

At least a dozen Dosaku game records have major discrepancies and there are a few that may not even be genuine.

Good! Your 99-move version is my 1.sgf, the GoGoD version is my 2.sgf, and you explain the status of this latter version: it is a GoGoD construct combining the start of 1.sgf with the tail of 4.sgf. In that case I should probably follow Redmond with 4.sgf.
Redmond writes LB[of:A][qi:B]C[White is alive with A or B. Black can only resign at this point.], suggesting that there are no further moves.