It is currently Sat Jun 08, 2024 6:56 pm

All times are UTC - 8 hours [ DST ]




Post new topic Reply to topic  [ 52 posts ]  Go to page 1, 2, 3  Next
Author Message
Offline
 Post subject: GoGoD is back online
Post #1 Posted: Sun Jan 19, 2014 11:03 am 
Oza

Posts: 3665
Liked others: 20
Was liked: 4641
Now that T Mark Hall is safely and benignly looking down on the rest of us, I am glad to say I can make the first step in a promise to him to try to keep his beloved GoGoD going.

There are, however, quite a few changes. I have very little time, and have had to trim, and also call on the help of one of my daughters (who is not a go player).

The most important are:

1. We have a new site: www.gogodonline.co.uk
2. We no longer offer CDs - downloads only
3. The only item being offered now is the database of sgf games. The Encyclopaedia (including the Names Dictionary) has been removed from this package. You will need to provide your own support programs (e.g. Kombilo).
4. The price has been drastically reduced to US$15.

Continuation of this version of the project depends on it being a hassle-free operation. I personally will not be involved in any admin.

The present version has over 79,000 games. Mark left a fairly large backlog of games for me to process, and the only era which was left significantly underdone was the 1920s. I am working on that, but I am a tortoise compared to Mark's hare.

Our original aim was to get to 100,000 then stop. Our calculation was that by then we would have covered almost everything old, so that then mostly only new games would need to be added, which is a relatively trivial exercise. That 100k remains the target (with at least two updates a year), but instead of being five or six years away, we may need to learn to wait for the nightingale to sing.

Note that the database is and will be incorporated in various SmartGo products, in this case along with the Names Dictionary. There the games are heavily compressed and so are not usable by other programs, but of course you do get all the other SmartGo features.

In that connection you may wish to note that work "From the GoGoD Archives" also continues and our newest book "New Ways in Go" (a translation of Honinbo Shuho's Hoen Shinpo) has just been published as a SmartGo book. The next book, the Meijin Inseki's "Today We Have a Splendid Feast", is essentially just awaiting a cover design.


This post by John Fairbairn was liked by 18 people: betterlife, Bill Spight, Boidhre, cuetzpalin, emeraldemon, ez4u, gasana, gowan, Hushfield, hyperpape, imabuddha, mipli, Monadology, nagano, RBerenguel, SoDesuNe, wineandgolover, xed_over
Top
 Profile  
 
Offline
 Post subject: Re: GoGoD is back online
Post #2 Posted: Sun Jan 19, 2014 11:38 am 
Gosei
User avatar

Posts: 1744
Liked others: 704
Was liked: 288
KGS: greendemon
Tygem: greendemon
DGS: smaragdaemon
OGS: emeraldemon
Thanks again for providing this terrific go database.

Top
 Profile  
 
Offline
 Post subject: Re: GoGoD is back online
Post #3 Posted: Sun Jan 19, 2014 11:55 am 
Oza

Posts: 2495
Location: DC
Liked others: 157
Was liked: 443
Universal go server handle: skydyr
Online playing schedule: When my wife is out.
I do have one question that doesn't seem to be answered on the site:

Will future updates be provided free or at a discount once the archive has been purchased?

Top
 Profile  
 
Offline
 Post subject: Re: GoGoD is back online
Post #4 Posted: Sun Jan 19, 2014 12:12 pm 
Oza

Posts: 3665
Liked others: 20
Was liked: 4641
Quote:
Will future updates be provided free or at a discount once the archive has been purchased?


A reasonable question. I thought it was covered by the FAQ but the answer is no - we want no hassle and think the price (which equates to $30 a year) is low enough already. However, if that aspect is important to you it may well (I haven't personally checked) be a feature offered by SmartGo.

Top
 Profile  
 
Offline
 Post subject: Re: GoGoD is back online
Post #5 Posted: Sun Jan 19, 2014 12:26 pm 
Oza

Posts: 2356
Location: Ireland
Liked others: 662
Was liked: 442
Universal go server handle: Boidhre
Thank you for your continued work on the project.

Top
 Profile  
 
Offline
 Post subject: Re: GoGoD is back online
Post #6 Posted: Sun Jan 19, 2014 4:29 pm 
Gosei

Posts: 1628
Liked others: 544
Was liked: 450
Rank: senior player
GD Posts: 1000
Glad to learn that GoGoD is back. And thanks to your daughter for stepping in to help.

Top
 Profile  
 
Offline
 Post subject: Re: GoGoD is back online
Post #7 Posted: Mon Jan 20, 2014 6:24 am 
Lives in sente
User avatar

Posts: 866
Liked others: 318
Was liked: 345
John,

I am not your man, but I hope you get an offer of a modest partnership from a web-savvy developer, who can maintain what you've already accomplished, and make GoGoD even more useful going forward.

Thank you (and your daughter) very much for trying to maintain it as best you can. Best wishes!

_________________
- Brady
Want to see videos of low-dan mistakes and what to learn from them? Brady's Blunders

Top
 Profile  
 
Offline
 Post subject: Re: GoGoD is back online
Post #8 Posted: Mon Jan 20, 2014 8:43 am 
Oza
User avatar

Posts: 2508
Liked others: 1304
Was liked: 1128
What are your plans for the encyclopedia?

_________________
Patience, grasshopper.

Top
 Profile  
 
Offline
 Post subject: Re: GoGoD is back online
Post #9 Posted: Mon Jan 20, 2014 10:13 am 
Oza

Posts: 3665
Liked others: 20
Was liked: 4641
Quote:
What are your plans for the encyclopedia?


Nothing specific, beyond not maintaining it and spelling it as encyclopaedia :) However, I extract bits to make into e-books, and I also had a brief chat with macelee at Mark's funeral and suggested there may be a possible collaboration there. But it's far too early to make any commitments.

Now a question to you. Why?

Quote:
Sounds like a very good incentive to transcribe games. So if you would like some help with entering games, I'd like to offer assistance. (I'm living in Vienna, Austria.)


By all means, thank you, and if it comes to more than a row of beans we can talk about free updates (which would apply to others). But you'll have to provide your own sources. The ones I'm using at the moment (ancient Kidos) are too valuable to leave my side.

Top
 Profile  
 
Offline
 Post subject: Re: GoGoD is back online
Post #10 Posted: Mon Jan 20, 2014 2:53 pm 
Oza
User avatar

Posts: 2221
Location: Germany
Liked others: 8262
Was liked: 924
Rank: OGS 9k
OGS: trohde
Universal go server handle: trohde
John Fairbairn wrote:
[..] you'll have to provide your own sources. The ones I'm using at the moment (ancient Kidos) are too valuable to leave my side.
Wouldn’t photocopies/scans/photos of these preciosities do as well?


Grtz, Tom

_________________
“The only difference between me and a madman is that I’m not mad.” — Salvador Dali ★ Play a slooooow correspondence game with me on OGS? :)

Top
 Profile  
 
Offline
 Post subject: Re: GoGoD is back online
Post #11 Posted: Mon Jan 20, 2014 3:01 pm 
Oza

Posts: 3665
Liked others: 20
Was liked: 4641
Quote:
Wouldn’t photocopies/scans/photos of these preciosities do as well?


Leaving aside the considerable time that would be involved, the volumes are tightly bound and are impossible to open anywhere near flat for copying. Photos don't come close, either, and there are problems with Chinese numerals, poor print copy and disintegrating paper. Even just reading the original leads to crickitis of the neck.

Top
 Profile  
 
Offline
 Post subject: Re: GoGoD is back online
Post #12 Posted: Mon Jan 20, 2014 4:27 pm 
Lives in gote

Posts: 553
Liked others: 61
Was liked: 250
Rank: AGA 5 dan
If you are really considering manually transcribing data from 20000 games over a several year period, it might make more sense to spend a year or more automating the process, so that a computer program can do the tedious work for you. A good camera on a tripod could capture the images better and more quickly than a person with a bent neck. If the images are distorted because the pages are not flat, that can be corrected. I don't know the state of Optical Character Recognition for Chinese, but it might automate a good part of the process. Maybe Google would even be interested in this effort, perhaps as a trial or demonstration project: http://books.google.com/googlebooks/library/index.html.


This post by mitsun was liked by: Bonobo
Top
 Profile  
 
Offline
 Post subject: Re: GoGoD is back online
Post #13 Posted: Mon Jan 20, 2014 5:02 pm 
Oza
User avatar

Posts: 2221
Location: Germany
Liked others: 8262
Was liked: 924
Rank: OGS 9k
OGS: trohde
Universal go server handle: trohde
John Fairbairn wrote:
Quote:
Wouldn’t photocopies/scans/photos of these preciosities do as well?


Leaving aside the considerable time that would be involved,
yes. Time and work.

Quote:
the volumes are tightly bound and are impossible to open anywhere near flat for copying.
OK, so no scanning.

Quote:
Photos don't come close, either, and there are problems with Chinese numerals, poor print copy
With all respect, John, are you familiar with the current state of photography and image manipulation? I for one have some experience with making photos that show “nothing” show “something”, and something recognizable for that. And anybody with a little experience with Photoshop or Gimp can do that, using “levels” and “curves”.

Quote:
and disintegrating paper.
One more, severe, reason to digitalize it, lest they get lost for all future :-)

Greetings, Tom

_________________
“The only difference between me and a madman is that I’m not mad.” — Salvador Dali ★ Play a slooooow correspondence game with me on OGS? :)

Top
 Profile  
 
Offline
 Post subject: Re: GoGoD is back online
Post #14 Posted: Mon Jan 20, 2014 10:55 pm 
Lives in sente

Posts: 923
Location: UK
Liked others: 72
Was liked: 479
Rank: 5 dan
KGS: macelee
While many people have good intentions to help, probably few understand the nature and the challenge of the work John is about to take. Transcribing games manually is only part of the job. In addition to hard work and a lot of patience, the following are also required:

1) Good knowledge of Go history. It takes time to investigate the background information for old games and tournaments. Remember we rarely have any internet-based reference materials for old Go stuff. John's brain is better than Google here.
2) Mastering oriental languages, as the materials are mainly in Japanese (possibly some in Chinese and Korean). Even the moves themselves are most likely to be in Chinese characters.
3) Dan-level playing strength. When compiling old games it is often necessary to use judgement to correct mistakes in the raw materials. Remember game records in old books are not created with computers and errors get into them easily (many errors are fixable with good Go-playing skills).

Very few people possess all the expertise mentioned above but John is certainly one of them. In my opinion, the single most important thing for John is to gradually improve efficiency by improving procedures while going through the old materials. Sophisticated IT systems can help, but only to a certain degree.

On the other hand, a good IT system can surely be set up to save most contents in the encyclopaedia. (John I'll contact you in private to make a few suggestions).


This post by macelee was liked by 3 people: Mef, Monadology, wineandgolover
Top
 Profile  
 
Offline
 Post subject: Re: GoGoD is back online
Post #15 Posted: Tue Jan 21, 2014 5:08 am 
Oza
User avatar

Posts: 2508
Liked others: 1304
Was liked: 1128
John Fairbairn wrote:
Quote:
What are your plans for the encyclopedia?
Nothing specific, beyond not maintaining it and spelling it as encyclopaedia :) However, I extract bits to make into e-books, and I also had a brief chat with macelee at Mark's funeral and suggested there may be a possible collaboration there. But it's far too early to make any commitments.

Now a question to you. Why?

It's just that aside from the database, the wealth of assorted goodies that was on the CD was alone worth the price. While I am looking forward to any new books you may produce, much of the material in the encyclopedia does not seem suitable to be incorporated in book form, and I was just a little saddened to see it go out of print. Good luck with your future endeavors - I hope the collaboration with Mace Lee works out.

Bonobo wrote:
Quote:
the volumes are tightly bound and are impossible to open anywhere near flat for copying.
OK, so no scanning.

http://www.amazon.com/VuPoint-Solutions ... B002R0BFAA

_________________
Patience, grasshopper.


This post by daal was liked by: ez4u
Top
 Profile  
 
Offline
 Post subject: Re: GoGoD is back online
Post #16 Posted: Tue Jan 21, 2014 5:35 am 
Oza

Posts: 3665
Liked others: 20
Was liked: 4641
RE Magic Wand scanner: got one and it's very good, but it doesn't reach far enough in to the spine.

But all these "solutions" involve extra hassle for me, so they won't happen. Sorry. (There is a significant difference between hassle and work as far as I'm concerned.)

Top
 Profile  
 
Offline
 Post subject: Re: GoGoD is back online
Post #17 Posted: Tue Jan 21, 2014 6:19 am 
Gosei
User avatar

Posts: 1585
Location: Barcelona, Spain (GMT+1)
Liked others: 577
Was liked: 298
Rank: KGS 5k
KGS: RBerenguel
Tygem: rberenguel
Wbaduk: JohnKeats
Kaya handle: RBerenguel
Online playing schedule: KGS on Saturday I use to be online, but I can be if needed from 20-23 GMT+1
John Fairbairn wrote:
[...] There is a significant difference between hassle and work as far as I'm concerned[....]

I isolated this line because I know a lot of people who don't see the difference between "working" and "doing stuff." It's a pity the part of distributing the work is not possible, though, but understandable.

_________________
Geek of all trades, master of none: the motto for my blog mostlymaths.net

Top
 Profile  
 
Offline
 Post subject: Re: GoGoD is back online
Post #18 Posted: Tue Jan 21, 2014 6:33 am 
Oza

Posts: 2356
Location: Ireland
Liked others: 662
Was liked: 442
Universal go server handle: Boidhre
RBerenguel wrote:
John Fairbairn wrote:
[...] There is a significant difference between hassle and work as far as I'm concerned[....]

I isolated this line because I know a lot of people who don't see the difference between "working" and "doing stuff." It's a pity the part of distributing the work is not possible, though, but understandable.


Digitising older books and manuscripts which aren't amenable to normal commercial tools can involve anything from specialist equipment generally only found in universities and similar research outfits which is not open to public use normally or taking a book apart, scanning its pages one by one and then rebuilding and repairing its binding as close to the original as possible (obviously not suitable for many/most works and requiring some very skilled individuals) and even if you can get scans out OCR doesn't work that well so you need to go through any OCR output manually anyway correcting usually many mistakes (assuming OCR even exists for the kind of text you're dealing with).

I can understand why John is calling it hassle not work. I asked my wife about this as she works in a related area to the above and her opinion was that scanning is nice but you often end up having to manually transcribe it anyway and given macelee's point this doesn't help as much as one might like.

Top
 Profile  
 
Offline
 Post subject: Re: GoGoD is back online
Post #19 Posted: Thu Mar 20, 2014 3:45 am 
Gosei
User avatar

Posts: 1585
Location: Barcelona, Spain (GMT+1)
Liked others: 577
Was liked: 298
Rank: KGS 5k
KGS: RBerenguel
Tygem: rberenguel
Wbaduk: JohnKeats
Kaya handle: RBerenguel
Online playing schedule: KGS on Saturday I use to be online, but I can be if needed from 20-23 GMT+1
Hi John,

a quick question, since I can't find the answer in the website: how many 9x9 game records are in the database? (yeah, I know it's a slightly weird question :D)

_________________
Geek of all trades, master of none: the motto for my blog mostlymaths.net

Top
 Profile  
 
Offline
 Post subject: Re: GoGoD is back online
Post #20 Posted: Thu Mar 20, 2014 11:08 am 
Oza
User avatar

Posts: 2508
Liked others: 1304
Was liked: 1128
My copy from 2010 has 117 9x9 games.

_________________
Patience, grasshopper.

Top
 Profile  
 
Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 52 posts ]  Go to page 1, 2, 3  Next

All times are UTC - 8 hours [ DST ]


Who is online

Users browsing this forum: Google [Bot] and 1 guest


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Search for:
Jump to:  
Powered by phpBB © 2000, 2002, 2005, 2007 phpBB Group