It is currently Wed May 07, 2025 8:45 am

All times are UTC - 8 hours [ DST ]




Post new topic Reply to topic  [ 13 posts ] 
Author Message
Offline
 Post subject: L19 network graph
Post #1 Posted: Sat Jan 29, 2011 11:24 pm 
Gosei
User avatar

Posts: 1758
Liked others: 378
Was liked: 375
Rank: 4d
Inspired by the High-dan game network thread, I decided to try to graph the interaction between members of the forum (i.e. how often two members post in the same thread). It seemed like a fun weekend project, and I had just written a simplified html parser in Scheme for school so it was a good chance to put that to further use.

So, after writing some Python scripts to download threads from the forum to my computer and extract the names of the authors of each post, I had to figure out a way to graph it all. This took by far the longest time, as I had never done anything like this before so I had to research my options. After narrowing it down to igraph (which walleye used in the thread above) and Gephi, I decided Gephi would be easier to use. Finally, after figuring out how to format my data so it could be imported into Gephi, I was able to make the graphs below.

(Note: Click on an image to get the full size)

http://upload.wikimedia.org/wikipedia/commons/3/34/L19_January_png.png This is the graph for January. Every member with at least one post is represented, but a line is drawn between two members only if one member has posted in the same thread another member has at least three times. A larger line corresponds with more posts in common threads. The lines are also color-coded: yellow represents only slight interaction between two members, cyan represents moderate interaction, and purple represents a large amount of interaction. Nodes are sized and color-coded similarly. There is one caveat with this data: the information was gathered from only the first 20 posts of each thread.

http://upload.wikimedia.org/wikipedia/commons/c/ca/L19_alltime_png.png This is the graph for all time. Once again, every member with at least one post is represented, but a line is drawn between two members only if they have 30 posts in common threads.

This information may not be too practically useful, but I found it quite interesting to look at.

_________________
We don't know who we are; we don't know where we are.
Each of us woke up one moment and here we were in the darkness.
We're nameless things with no memory; no knowledge of what went before,
No understanding of what is now, no knowledge of what will be.


This post by Dusk Eagle was liked by 10 people: apetresc, Chew Terr, Gresil, Joaz Banbeck, ketchup, Phelan, Redundant, schultz, Solomon, topazg
Top
 Profile  
 
Offline
 Post subject: Re: L19 network graph
Post #2 Posted: Sun Jan 30, 2011 4:07 am 
Lives with ko

Posts: 232
Liked others: 103
Was liked: 39
Rank: KGS 1D
It looked to me as if we form basically one population, rather than a split one. That's nice. :)

Top
 Profile  
 
Offline
 Post subject: Re: L19 network graph
Post #3 Posted: Sun Jan 30, 2011 10:44 am 
Gosei
User avatar

Posts: 2116
Location: Silicon Valley
Liked others: 152
Was liked: 330
Rank: 2d AGA
GD Posts: 1193
KGS: lavalamp
Tygem: imapenguin
IGS: lavalamp
OGS: daniel_the_smith
That's pretty cool!

_________________
That which can be destroyed by the truth should be.
--
My (sadly neglected, but not forgotten) project: http://dailyjoseki.com

Top
 Profile  
 
Offline
 Post subject: Re: L19 network graph
Post #4 Posted: Sun Jan 30, 2011 11:01 am 
Lives in gote
User avatar

Posts: 399
Location: Shanghai, China
Liked others: 5
Was liked: 35
Rank: EGF 2d KGS 3d
GD Posts: 353
KGS: freegame
Stable wrote:
It looked to me as if we form basically one population, rather than a split one. That's nice. :)


yup seems like it.
looking at the all time graph it's also clear a small amount (core) of people is responsible for the vast majority of posts.
Of course I already knew this from looking at the member list, but this make shows it in a nice visual way.

I wanted to create some graphs myself this weekend.
But decided to go to participate in a (real life) Go tournament instead.
I ended in second place so I guess I made a good choice :D

_________________
Laurens
Go school: freegame's Teaching School
Author of: The Next Move a book for 15-3kyu players.

Top
 Profile  
 
Offline
 Post subject: Re: L19 network graph
Post #5 Posted: Sun Jan 30, 2011 2:05 pm 
Tengen
User avatar

Posts: 4511
Location: Chatteris, UK
Liked others: 1589
Was liked: 656
Rank: Nebulous
GD Posts: 918
KGS: topazg
I need a life!


This post by topazg was liked by: gaius
Top
 Profile  
 
Offline
 Post subject: Re: L19 network graph
Post #6 Posted: Sun Jan 30, 2011 3:46 pm 
Oza
User avatar

Posts: 2508
Liked others: 1304
Was liked: 1128
topazg wrote:
I need a life!


Be happy, you have 2.

_________________
Patience, grasshopper.


This post by daal was liked by: topazg
Top
 Profile  
 
Offline
 Post subject: Re: L19 network graph
Post #7 Posted: Sun Jan 30, 2011 7:06 pm 
Judan
User avatar

Posts: 5546
Location: Banbeck Vale
Liked others: 1104
Was liked: 1457
Rank: 1D AGA
GD Posts: 1512
Kaya handle: Test
@Dusk Eagle: Thanks for doing this. Would it be possible to have a variation with the Malkovich games not counted?

_________________
Help make L19 more organized. Make an index: https://lifein19x19.com/viewtopic.php?f=14&t=5207

Top
 Profile  
 
Offline
 Post subject: Re: L19 network graph
Post #8 Posted: Sun Jan 30, 2011 7:23 pm 
Lives in gote
User avatar

Posts: 348
Liked others: 16
Was liked: 31
Rank: KGS4k
KGS: CSamurai
Joaz Banbeck wrote:
@Dusk Eagle: Thanks for doing this. Would it be possible to have a variation with the Malkovich games not counted?


I'm sure it would be, but then I'd have almost no connections at all!

Top
 Profile  
 
Offline
 Post subject: Re: L19 network graph
Post #9 Posted: Mon Jan 31, 2011 4:33 am 
Gosei
User avatar

Posts: 1758
Liked others: 378
Was liked: 375
Rank: 4d
@Joaz, I should be able to find a bit of time to do that before the end of today.

_________________
We don't know who we are; we don't know where we are.
Each of us woke up one moment and here we were in the darkness.
We're nameless things with no memory; no knowledge of what went before,
No understanding of what is now, no knowledge of what will be.

Top
 Profile  
 
Offline
 Post subject: Re: L19 network graph
Post #10 Posted: Mon Jan 31, 2011 1:12 pm 
Gosei
User avatar

Posts: 1758
Liked others: 378
Was liked: 375
Rank: 4d
January's graph without Malkovich games.

The alltime graph without Malkovich games. I'm going to speculate that the weakening of the relationship (no pun intended) between Kirby and Magicwand (due to removing all the Malkovich games between them) boosted others relationships proportionally from yellow to cyan.

Enjoy!

_________________
We don't know who we are; we don't know where we are.
Each of us woke up one moment and here we were in the darkness.
We're nameless things with no memory; no knowledge of what went before,
No understanding of what is now, no knowledge of what will be.


This post by Dusk Eagle was liked by 3 people: Joaz Banbeck, ketchup, rubin427
Top
 Profile  
 
Offline
 Post subject: Re: L19 network graph
Post #11 Posted: Wed Feb 02, 2011 6:11 pm 
Dies with sente

Posts: 124
Liked others: 5
Was liked: 13
Rank: IGS 1k
A couple of technical questions.

Dusk Eagle wrote:
http://upload.wikimedia.org/wikipedia/commons/3/34/L19_January_png.png This is the graph for January. Every member with at least one post is represented, but a line is drawn between two members only if one member has posted in the same thread another member has at least three times.

Do you mean to say you draw a line if they both have one or more posts (in the first 20) in at least three threads? Or, there is at least one thread where they both have three posts (in the first 20)? Or, is it three posts for just one member? In which case, it doesn't matter which one since your graph is undirected, does it?


Dusk Eagle wrote:
There is one caveat with this data: the information was gathered from only the first 20 posts of each thread.

Fortunately, most non-Malkovich threads have fewer than twenty posts. Still, it's an annoying limitation.

Dusk Eagle wrote:
http://upload.wikimedia.org/wikipedia/commons/c/ca/L19_alltime_png.png This is the graph for all time. Once again, every member with at least one post is represented, but a line is drawn between two members only if they have 30 posts in common threads.

According to what you are doing, a thread is common to two members if they both have one or more posts (in the first 20) in the thread. Right? So what you do is you find all common threads and then count the total number of posts that they have in those threads (only using the first 20 posts in each thread). Then you draw a line if they both have 30 or more total posts thus counted. Is this correct?

Top
 Profile  
 
Offline
 Post subject: Re: L19 network graph
Post #12 Posted: Thu Feb 03, 2011 2:34 pm 
Gosei
User avatar

Posts: 1758
Liked others: 378
Was liked: 375
Rank: 4d
Quote:
Do you mean to say you draw a line if they both have one or more posts (in the first 20) in at least three threads? Or, there is at least one thread where they both have three posts (in the first 20)? Or, is it three posts for just one member? In which case, it doesn't matter which one since your graph is undirected, does it?

For each post in a thread, that author gets one "interaction point" with the author of each subsequent post in that thread. A member can not score interaction points with themself.

So for the January graphs, two members have a line between them if they have at least 3 "interaction points" between them. For the all-time graphs, two members must have at least 30 "interaction points" between them to be have a line displayed.

I gathered the forum data by first observing that all the URLs of threads on this forum are of the form:
Code:
http://lifein19x19.com/forum/viewtopic.php?t=%d%

where %d% is an integer. So, I just used a for loop to download each page. But since threads are limited to 20 posts/page for non-logged-in users, and I didn't know how to have the tool I used to download pages use my log-in (where I could change the posts/page preferences), the 20 posts per thread was the best I could do. However, as I write this, I've just thought of a way to do that which I'm almost certain will work, so were I to do this again at some point I should be able to include all posts, not just the first 20.

_________________
We don't know who we are; we don't know where we are.
Each of us woke up one moment and here we were in the darkness.
We're nameless things with no memory; no knowledge of what went before,
No understanding of what is now, no knowledge of what will be.

Top
 Profile  
 
Offline
 Post subject: Re: L19 network graph
Post #13 Posted: Sat Feb 12, 2011 12:53 pm 
Lives in gote
User avatar

Posts: 505
Location: Montana
Liked others: 80
Was liked: 62
Hey, late to the party, but wanted to say this is really cool.

And glad to see that I actually made an appearance, even if only for the all-time graphs. ;)

_________________
KGS: schultz [?].

Top
 Profile  
 
Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 13 posts ] 

All times are UTC - 8 hours [ DST ]


Who is online

Users browsing this forum: No registered users and 1 guest


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Search for:
Jump to:  
Powered by phpBB © 2000, 2002, 2005, 2007 phpBB Group