Go4Go database update

General conversations about Go belong here.
macelee
Lives in sente
Posts: 928
Joined: Mon Dec 31, 2012 1:46 pm
Rank: 5 dan
GD Posts: 0
KGS: macelee
Location: UK
Has thanked: 72 times
Been thanked: 480 times
Contact:

Go4Go database update

Post by macelee »

Go4Go database just reached the milestone of 40000 games earlier today. I've improved my procedure and managed to compile 8416 games, including many historical games during year 2013. I hope to keep working at this pace in 2014.
Last edited by macelee on Tue Feb 25, 2014 2:25 pm, edited 1 time in total.
User avatar
Rowen
Lives with ko
Posts: 194
Joined: Sat Nov 09, 2013 9:35 am
GD Posts: 0
KGS: Rowen
Tygem: Kotaru
IGS: Rowen
Been thanked: 21 times

Re: 40000 game records at Go4Go!

Post by Rowen »

Nice! Ill be checking this out for sure.
happysocks
Lives with ko
Posts: 155
Joined: Sun Jun 02, 2013 2:41 am
Rank: DDK
GD Posts: 0
Universal go server handle: happysocks
Has thanked: 153 times
Been thanked: 41 times

Re: 40000 game records at Go4Go!

Post by happysocks »

That's a lot of smileys, congratulations Go4Go!
Image
"Tsumegos are for reading power and Tesujis for knowing which moves to read"
macelee
Lives in sente
Posts: 928
Joined: Mon Dec 31, 2012 1:46 pm
Rank: 5 dan
GD Posts: 0
KGS: macelee
Location: UK
Has thanked: 72 times
Been thanked: 480 times
Contact:

Go4Go database update: 41000 games now

Post by macelee »

Just added the 41,000th games to Go4Go database. It took me 40 days to add the latest 1,000 games - slower than I expected. This is because I have been crawling through a lot of Chinese Go literatures to validate game information - hundreds of games now contain more accurate information.
macelee
Lives in sente
Posts: 928
Joined: Mon Dec 31, 2012 1:46 pm
Rank: 5 dan
GD Posts: 0
KGS: macelee
Location: UK
Has thanked: 72 times
Been thanked: 480 times
Contact:

Re: Go4Go database update

Post by macelee »

Just added the 46,000th game to the Go4Go database. Since the introduction of the Go News section of the site, I use it to guide my compilation which results in improved efficiency. And as of today there are 1128 tournament score charts.
macelee
Lives in sente
Posts: 928
Joined: Mon Dec 31, 2012 1:46 pm
Rank: 5 dan
GD Posts: 0
KGS: macelee
Location: UK
Has thanked: 72 times
Been thanked: 480 times
Contact:

Re: Go4Go database update

Post by macelee »

A fan here at lifein19x19 asked me to create a new page to show games played between professional and amateur players. Please find this in the newly created 'Special Topics' from the menu. Or here is the link: http://www.go4go.net/go/games/special
macelee
Lives in sente
Posts: 928
Joined: Mon Dec 31, 2012 1:46 pm
Rank: 5 dan
GD Posts: 0
KGS: macelee
Location: UK
Has thanked: 72 times
Been thanked: 480 times
Contact:

Re: Go4Go database update

Post by macelee »

Since I last posted here in February, I've added 4000 more games to the database. I've just reached the 50,000 milestone earlier today. Quality is very important - during the same period 1728 games were updated with more accurate information.
macelee
Lives in sente
Posts: 928
Joined: Mon Dec 31, 2012 1:46 pm
Rank: 5 dan
GD Posts: 0
KGS: macelee
Location: UK
Has thanked: 72 times
Been thanked: 480 times
Contact:

Re: Go4Go database update

Post by macelee »

Some of you with eagle eyes may have noticed minor changes to the Go4Go site. It is not just some small tweaks to the layout, but the introduction of a so-called responsive theme, making the site shown much better on smartphones. Try it on your phones, most pages should look reasonably good now particularly in landscape view.
macelee
Lives in sente
Posts: 928
Joined: Mon Dec 31, 2012 1:46 pm
Rank: 5 dan
GD Posts: 0
KGS: macelee
Location: UK
Has thanked: 72 times
Been thanked: 480 times
Contact:

Re: Go4Go database update

Post by macelee »

Go4Go database just keeps getting better! I just designed a new database to hold information on games with known outcome but no game record. In the future, score charts will no longer have question marks for those missing games so you will have the full picture of how a tournament progressed. It will take a while to input all the data but I am designing a powerful back-end system to help that.

Later I will also share the data with goratings.org so that better player ratings can be generated using the additional information.
screen.png
screen.png (40.49 KiB) Viewed 21608 times
Also note the small improvement that names of female players in mixed tournament are in red color now (something Nihon Kiin and Mr Kin's sites have been doing all the time).
hyperpape
Tengen
Posts: 4382
Joined: Thu May 06, 2010 3:24 pm
Rank: AGA 3k
GD Posts: 65
OGS: Hyperpape 4k
Location: Caldas da Rainha, Portugal
Has thanked: 499 times
Been thanked: 727 times

Re: Go4Go database update

Post by hyperpape »

macelee wrote:Go4Go database just keeps getting better! I just designed a new database to hold information on games with known outcome but no game record. In the future, score charts will no longer have question marks for those missing games so you will have the full picture of how a tournament progressed. It will take a while to input all the data but I am designing a powerful back-end system to help that.

Later I will also share the data with goratings.org so that better player ratings can be generated using the additional information.
screen.png
Also note the small improvement that names of female players in mixed tournament are in red color now (something Nihon Kiin and Mr Kin's sites have been doing all the time).
Is any of this publicly visible?
macelee
Lives in sente
Posts: 928
Joined: Mon Dec 31, 2012 1:46 pm
Rank: 5 dan
GD Posts: 0
KGS: macelee
Location: UK
Has thanked: 72 times
Been thanked: 480 times
Contact:

Re: Go4Go database update

Post by macelee »

Just added the 57,000th game to Go4Go database. The recent additions include many games from 1980's and 1990's.
aeb
Dies with sente
Posts: 101
Joined: Wed Dec 04, 2013 7:08 pm
GD Posts: 0
Has thanked: 5 times
Been thanked: 36 times

Re: Go4Go database update

Post by aeb »

macelee wrote:Just added the 57,000th game to Go4Go database. The recent additions include many games from 1980's and 1990's.
Nice!

(Let me quickly compare our statistics. Last time go4go had 55831, today 57030.
Last time I had published about 35000 games, today about 36600.
In the category "Japanese Tournaments" go4go has roughly 18400, aeb 24700.
The difference remained about the same. I added 470 Shusaku games.)

Maybe I can convince you to open up your collection, for example the part
that is at least two years old. Then we can compare not only numbers but also
the games themselves.
macelee
Lives in sente
Posts: 928
Joined: Mon Dec 31, 2012 1:46 pm
Rank: 5 dan
GD Posts: 0
KGS: macelee
Location: UK
Has thanked: 72 times
Been thanked: 480 times
Contact:

Re: Go4Go database update

Post by macelee »

Merry Christmas everyone.

I haven't updated this thread for quite a while. Just at this moment on Christmas Eve, I have compiled the 70000th game for the Go4Go database. Here are some interesting statistics:

For the past year, I have made 12345 changes to my database, including adding
8661 new games and updating information for 3684 existing games, the latter being extremely important and I am always proud of the quality of the Go4Go database.

For those readers who are new to this Forum, Go4Go database provides the underlying data of the popular GoRatings site for player ranking. Go4Go also provides a large proportion of data underlying the recently released AlphaGo teaching tool.

Hopefully I can keep improving this database for many years to come. And I take this opportunity to thank you for all the supports.
macelee
Lives in sente
Posts: 928
Joined: Mon Dec 31, 2012 1:46 pm
Rank: 5 dan
GD Posts: 0
KGS: macelee
Location: UK
Has thanked: 72 times
Been thanked: 480 times
Contact:

Re: Go4Go database update

Post by macelee »

The count of game now stands at 70950.

I have just added a long overdue feature that links games played by players under different names.
Screenshot from 2018-01-21 10-46-33.png
Screenshot from 2018-01-21 10-46-33.png (18.53 KiB) Viewed 20243 times
This supports formal change of names, but not those variation of names (mainly due to translating errors, e.g. Chun Guangya instead of Wu Guangya). Go4Go uses the names consistently so it doesn't suffer from that problem any way.
macelee
Lives in sente
Posts: 928
Joined: Mon Dec 31, 2012 1:46 pm
Rank: 5 dan
GD Posts: 0
KGS: macelee
Location: UK
Has thanked: 72 times
Been thanked: 480 times
Contact:

Re: Go4Go database update

Post by macelee »

Just added the 73,000th game to Go4Go database.
Post Reply