It is currently Thu Apr 18, 2024 3:15 pm

All times are UTC - 8 hours [ DST ]




Post new topic Reply to topic  [ 12 posts ] 
Author Message
Offline
 Post subject: create forum for restoring old GoDiscussion threads?
Post #1 Posted: Fri Sep 16, 2011 5:31 pm 
Oza

Posts: 2264
Liked others: 1180
Was liked: 552
I'm wondering (out loud), if we should have a special forum section for restored GoDiscussions threads.

I doubt I'll be able to figure out fully (or within a reasonable time period) how to import all the threads, but I can probably manually restore a select few old "stuck" threads.

If nothing else, this section might be a good practice stepping stone to figuring out how to fully restore all the threads (maybe). And then if that ever happens, then this can be deleted, right?

I've got a thread I'm trying to restore for Bill Spight now. viewtopic.php?f=15&t=4668
I'll just add it somewhere in the General section for now. Then if we decide to create a special place, you guys can move it there, right?

Top
 Profile  
 
Offline
 Post subject: Re: create forum for restoring old GoDiscussion threads?
Post #2 Posted: Fri Sep 16, 2011 9:30 pm 
Oza

Posts: 2264
Liked others: 1180
Was liked: 552
first restored thread: viewtopic.php?f=10&t=4678

mysql -BN -e "select username, title, from_unixtime(dateline), pagetext from vb_post where threadid = '5728' order by dateline;" > thread-5728.tsv

(plus some not yet programed text massaging -- quoting quote tag names, unquoting url strings, replacing \r\n and \n with real newlines)


This post by xed_over was liked by: hyperpape
Top
 Profile  
 
Offline
 Post subject: Re: create forum for restoring old GoDiscussion threads?
Post #3 Posted: Sat Oct 01, 2011 7:41 am 
Judan
User avatar

Posts: 5539
Location: Banbeck Vale
Liked others: 1103
Was liked: 1456
Rank: 1D AGA
GD Posts: 1512
Kaya handle: Test
xed_over wrote:
I'm wondering (out loud), if we should have a special forum section for restored GoDiscussions threads...
I'll just add it somewhere in the General section for now. Then if we decide to create a special place, you guys can move it there, right?


We can create a new place, and we can move threads. Just let us know when you need the room.

_________________
Help make L19 more organized. Make an index: https://lifein19x19.com/viewtopic.php?f=14&t=5207

Top
 Profile  
 
Offline
 Post subject: Re: create forum for restoring old GoDiscussion threads?
Post #4 Posted: Sat Oct 01, 2011 7:47 am 
Gosei
User avatar

Posts: 1581
Location: Hong Kong
Liked others: 54
Was liked: 544
GD Posts: 1292
Please do not restore my books threads from GD here. Read my blog instead.

_________________
http://tchan001.wordpress.com
A blog on Asian go books, go sightings, and interesting tidbits
Go is such a beautiful game.

Top
 Profile  
 
Offline
 Post subject: Re: create forum for restoring old GoDiscussion threads?
Post #5 Posted: Sat Oct 01, 2011 9:47 am 
Gosei
User avatar

Posts: 1758
Liked others: 378
Was liked: 375
Rank: 4d
tchan, do you realize that many pages of your book threads are still available on GoDiscussions?

e.g. https://godiscussions.com/forum/showthr ... 529&page=2

_________________
We don't know who we are; we don't know where we are.
Each of us woke up one moment and here we were in the darkness.
We're nameless things with no memory; no knowledge of what went before,
No understanding of what is now, no knowledge of what will be.

Top
 Profile  
 
Offline
 Post subject: Re: create forum for restoring old GoDiscussion threads?
Post #6 Posted: Sun Oct 02, 2011 5:03 am 
Gosei
User avatar

Posts: 1581
Location: Hong Kong
Liked others: 54
Was liked: 544
GD Posts: 1292
Yes I know they are currently available on GD. But I still have the option of logging into GD and modifying them to point to my blog once I finish transferring updated entries into my blog. But for now, I don't mind them being on GD. Having a further copy floating around on L19 is not the same.

_________________
http://tchan001.wordpress.com
A blog on Asian go books, go sightings, and interesting tidbits
Go is such a beautiful game.

Top
 Profile  
 
Offline
 Post subject: Re: create forum for restoring old GoDiscussion threads?
Post #7 Posted: Sat Oct 08, 2011 12:25 pm 
Oza

Posts: 2264
Liked others: 1180
Was liked: 552
I don't really like the one thread I've restored so far -- each post by me.
Not to mention, it was quite time consuming to manually recreate it.

but one of the problems is the usernames may not match from there to here, or may not even exist.

Perhaps it would be better if I created a generic "godiscussions" user for each of the posts, including the original author in the post as I did here.

next, in order to automate it, I need to ask the admins here for at lest read access to the db here so I can map the schemas in order to generate some backend sql datafix scripts to better automate posting the newly restored threads. Then I can hand those to the admins here for the restoration.


This post by xed_over was liked by: jts
Top
 Profile  
 
Offline
 Post subject: Re: create forum for restoring old GoDiscussion threads?
Post #8 Posted: Sat Oct 08, 2011 1:55 pm 
Judan
User avatar

Posts: 5539
Location: Banbeck Vale
Liked others: 1103
Was liked: 1456
Rank: 1D AGA
GD Posts: 1512
Kaya handle: Test
xed_over wrote:
...
Perhaps it would be better if I created a generic "godiscussions" user for each of the posts, including the original author in the post as I did here...


Surely you don't mean one ID for all of them? That spoils the conversational aspects of some threads. Maybe just create GD001, GD002, etc, and map the non-migrated users on to them.

_________________
Help make L19 more organized. Make an index: https://lifein19x19.com/viewtopic.php?f=14&t=5207

Top
 Profile  
 
Offline
 Post subject: Re: create forum for restoring old GoDiscussion threads?
Post #9 Posted: Sat Oct 08, 2011 2:11 pm 
Oza

Posts: 2264
Liked others: 1180
Was liked: 552
Joaz Banbeck wrote:
xed_over wrote:
...
Perhaps it would be better if I created a generic "godiscussions" user for each of the posts, including the original author in the post as I did here...


Surely you don't mean one ID for all of them? That spoils the conversational aspects of some threads. Maybe just create GD001, GD002, etc, and map the non-migrated users on to them.

well, that is what I was thinking, but your idea could work too

it'll be a little more work mapping usernames, so I was almost hoping I could skip that part.

Top
 Profile  
 
Offline
 Post subject: Re: create forum for restoring old GoDiscussion threads?
Post #10 Posted: Tue Apr 17, 2012 12:43 pm 
Tengen

Posts: 4380
Location: North Carolina
Liked others: 499
Was liked: 733
Rank: AGA 3k
GD Posts: 65
OGS: Hyperpape 4k
How badly is the database mangled? Say you just wanted the text of all posts, without worrying about who wrote what. How hard would it be to provide that?

_________________
Occupy Babel!

Top
 Profile  
 
Offline
 Post subject: Re: create forum for restoring old GoDiscussion threads?
Post #11 Posted: Tue May 08, 2012 10:42 am 
Oza

Posts: 2264
Liked others: 1180
Was liked: 552
hyperpape wrote:
How badly is the database mangled? Say you just wanted the text of all posts, without worrying about who wrote what. How hard would it be to provide that?

its actually not that hard -- the only hard part is figuring out how to display the posts: 1) reformat to fit with this forum's structure (and what to do with mismatched/changed/nonexisting usernames, etc); 2) host the older original style forum; 3) just plain html format; 4) just plain text

life take over :(

Top
 Profile  
 
Offline
 Post subject: Re: create forum for restoring old GoDiscussion threads?
Post #12 Posted: Sun Nov 04, 2012 4:21 pm 
Oza

Posts: 2264
Liked others: 1180
Was liked: 552
here's a start:
http://www.eskimo.com/~wheelers/godiscussions_archive/


This post by xed_over was liked by: Bonobo
Top
 Profile  
 
Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 12 posts ] 

All times are UTC - 8 hours [ DST ]


Who is online

Users browsing this forum: No registered users and 1 guest


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Search for:
Jump to:  
Powered by phpBB © 2000, 2002, 2005, 2007 phpBB Group