Page 5 of 6

Re: Question about Daily Joseki method

Posted: Wed Jul 13, 2011 3:51 pm
by daniel_the_smith
paulus_germanus wrote:...also, it tells me that the next stone is supposed to be white, but the wrong-move-indicator displayed is black (see enclosed image). ...and I'm stuck again :(


Hopefully I will be able to fix it tonight, really sorry it's happening to you :(

Re: Question about Daily Joseki method

Posted: Wed Jul 13, 2011 6:53 pm
by daniel_the_smith
OK, I fixed the bug causing paulus_germanus's problem. :) Thanks for the report, let me know if anything else goes wrong.

Re: Question about Daily Joseki method

Posted: Wed Jul 13, 2011 11:03 pm
by BobC
daniel_the_smith wrote:
BobC wrote:yes TLS and SSL are both on.

There doesn't seem to be certificate from the site= whats it called.- dont think it's cached.


Very weird-- Can you paste the message? Does it say it expired or is it invalid for some other reason?


hum.. now it's working on Chrome. :scratch:

Re: Question about Daily Joseki method

Posted: Wed Jul 13, 2011 11:37 pm
by paulus_germanus
OK, I fixed the bug causing paulus_germanus's problem. :) Thanks for the report, let me know if anything else goes wrong.

Thank you Sir! :)

Now I got some questions (suggestions?, don't wanna be too impudent here ;) regarding your teaching method:
1. You should name it the "Smith method" (or whatever your real second name is) of learning joseki, I bet it would stick to "dailyjoseki.com" as the site/method grows more popular, as it surely will - making yourself more popular among players. And I think you are fully entitled to do that: even though the methods of learning (joseki, srs) existed before dailyjoseki.com, combining two into one was your brainchild.
2. Are you planning to make similar learning engine for tesuji? (this time based maybe on goproblems.com),
3. Could you tell us how many people subscribed, and how many page-views dailyjoseki.com gets daily/weekly/since the beginning?
4. Will dailyjoseki.com be available off-line?

Re: Question about Daily Joseki method

Posted: Thu Jul 14, 2011 6:00 am
by daniel_the_smith
paulus_germanus wrote:Now I got some questions (suggestions?, don't wanna be too impudent here ;) regarding your teaching method:
1. You should name it the "Smith method" (or whatever your real second name is) of learning joseki, I bet it would stick to "dailyjoseki.com" as the site/method grows more popular, as it surely will - making yourself more popular among players. And I think you are fully entitled to do that: even though the methods of learning (joseki, srs) existed before dailyjoseki.com, combining two into one was your brainchild.
2. Are you planning to make similar learning engine for tesuji? (this time based maybe on goproblems.com),
3. Could you tell us how many people subscribed, and how many page-views dailyjoseki.com gets daily/weekly/since the beginning?
4. Will dailyjoseki.com be available off-line?


Lol :)

1. Honestly, I'm not sure if I thought of it first or not. Some of the good folks here were trying to do this with anki and static images, which sounded like a lot of work to me. I thought of this as soon as I discovered Anki, but I have no idea when that was. :)

2. In the future, I plan on allowing members to upload any sgf they want for inclusion in the system.

3. I haven't been aggressively marketing (yet), so I don't think I'm quite ready to make all the stats public. I will say the site has administered 4,500 tests as of last night. I'll also say that there have been enough upgraded accounts this year to pay for hosting so far (many thanks to everyone who has, you know who you are!), which is good because the set of data I'm working on will probably require a server upgrade.

4. I'm afraid that's not likely to happen unless it seems like dailyjoseki.com would allow me to quit my day job. I currently don't think the market is big enough to allow that.

Bonus: I have *really* awesome features planned. Unfortunately it's taking a long time to get the next version of my data together, and it is going to require some re-writing. I hope to at least have a demo of the new data available before (the US) go congress. :)

Re: Question about Daily Joseki method

Posted: Fri Jul 15, 2011 1:08 pm
by jts
I just wanted to give you another example of an error message I got just minutes ago. This one I got on the 4th move of a joseki, on the second joseki of the day. It could be some sort of time out message (I did the first three moves, realized I had real work to do, came back a while later), but I did have "keep me logged in" selected.

ProcessPage /please_login/do/login/login: login: session ID problem
sids don't match: vs: CZJjt5ie7aG4EZy3INvlVOTCFLoCW6Xbcm51q1fiSdgPe5jVph

Chrome would ignore this error page if this text weren't here.
Chrome would ignore this error page if this text weren't here.
Chrome would ignore this error page if this text weren't here.
Chrome would ignore this error page if this text weren't here.
Chrome would ignore this error page if this text weren't here.
Chrome would ignore this error page if this text weren't here.
Chrome would ignore this error page if this text weren't here.
Chrome would ignore this error page if this text weren't here.
Chrome would ignore this error page if this text weren't here.
Chrome would ignore this error page if this text weren't here.
Chrome would ignore this error page if this text weren't here.
Chrome would ignore this error page if this text weren't here.
Chrome would ignore this error page if this text weren't here.
Chrome would ignore this error page if this text weren't here.

Re: Question about Daily Joseki method

Posted: Fri Jul 15, 2011 1:15 pm
by daniel_the_smith
It's definitely caused by timing out plus a missing session ID. I'll try and revisit that code this weekend. :)

Re: Question about Daily Joseki method

Posted: Sun Jul 17, 2011 2:57 am
by paulus_germanus
Thanks for all the answears daniel_the_smith :) It seems that we're gonna get even more goodies in the future :)

Re: Question about Daily Joseki method

Posted: Mon Jul 18, 2011 12:55 pm
by daniel_the_smith
Well, I spent the weekend fighting with ubuntu over a new monitor, and then comcast broke my internet. So, I didn't accomplish much, I'm afraid. But I haven't forgotten. :)

Re: Question about Daily Joseki method

Posted: Wed Jul 20, 2011 5:38 pm
by daniel_the_smith
If anyone observes the thing jts reported, could you post it here? I haven't yet fixed it, but the server should now be emailing me (with a call stack!) when it happens. Also, I've noticed a couple of you have gotten crashes in the queue page-- next time it happens I should get enough info in my email to find my logic error. :)

Re: Question about Daily Joseki method

Posted: Sun Jul 24, 2011 9:20 pm
by jts
Once more: (this one was definitely not timing out, although as best I can tell the message is identical)

ProcessPage /please_login/do/login/login: login: session ID problem
sids don't match: vs: gTN4FQFCJvUgE8A1B6NkAxtMzZbwXNTmTov1pvvLvmWd6MpqwH

Chrome would ignore this error page if this text weren't here.
Chrome would ignore this error page if this text weren't here.
Chrome would ignore this error page if this text weren't here.
Chrome would ignore this error page if this text weren't here.
Chrome would ignore this error page if this text weren't here.
Chrome would ignore this error page if this text weren't here.
Chrome would ignore this error page if this text weren't here.
Chrome would ignore this error page if this text weren't here.
Chrome would ignore this error page if this text weren't here.
Chrome would ignore this error page if this text weren't here.
Chrome would ignore this error page if this text weren't here.
Chrome would ignore this error page if this text weren't here.
Chrome would ignore this error page if this text weren't here.
Chrome would ignore this error page if this text weren't here.

Re: Question about Daily Joseki method

Posted: Mon Jul 25, 2011 6:20 am
by daniel_the_smith
jts wrote:Once more: (this one was definitely not timing out, although as best I can tell the message is identical)

ProcessPage /please_login/do/login/login: login: session ID problem
sids don't match: vs: gTN4FQFCJvUgE8A1B6NkAxtMzZbwXNTmTov1pvvLvmWd6MpqwH

Chrome would ignore this error page if this text weren't here.
Chrome would ignore this error page if this text weren't here.
Chrome would ignore this error page if this text weren't here.
Chrome would ignore this error page if this text weren't here.
Chrome would ignore this error page if this text weren't here.
Chrome would ignore this error page if this text weren't here.
Chrome would ignore this error page if this text weren't here.
Chrome would ignore this error page if this text weren't here.
Chrome would ignore this error page if this text weren't here.
Chrome would ignore this error page if this text weren't here.
Chrome would ignore this error page if this text weren't here.
Chrome would ignore this error page if this text weren't here.
Chrome would ignore this error page if this text weren't here.
Chrome would ignore this error page if this text weren't here.


Fascinating, thank you. Apparently my guess as to what is causing this was not even close. :scratch: Well, I at least can see the sequence of events in the log. I may or may not be able to try and sneak a fix in before I leave for go congress on Saturday.

Re: Question about Daily Joseki method

Posted: Mon Aug 15, 2011 2:00 am
by perceval
Here a re a couple new suggestions.

First a couple cosmetic suggestions:

1- when some stones are added outside the joseki , numbered them. It is interesting to see the added move stand out, and it is might be useful to sees the actual sequence.
2- at the end of a joseki, you can highlight the whole joseki sequence with number: for weaker player like me the end shape is not enough to retrieve the whole seq and when i leran something i like to consider the whoel seq from start to finish. numbers would help.
You could even highlight in another color the move where an erro was made.


Something more ambitious:
First a bit of offtopic: i used to work on statistical translations engine, and we had similar data mining problems: how to automatically extract decent translations of phrases from a (huge ) corpus of human translated sentences.

It is key to have a control mechanism over the extracted data, otherwise it is really easy to miss something.
This kind of control is even more important if you allow used to upload their own sgf: you risk adding junk into your db (unless you plan that the added sgf are only for use by the one who upload them but then thats a bit of a waste: it would be cool to add then to your db)
A good way to check automatically extracted data is to compare to a human created "golden set". for automatic translations, you would compare to human translations.
Here i would suggest to compare (if possible ie if open source) to josekipedia.
For example some of your extracted sequence might be marked as "good" in josekipedia meaning "good in special cases" so indeed the surrounding stones are very important.
on the other hand "ideal" moves are usually good without a too special surrounding.

it is also possible that some moves would be marked as bad in josekipedia but are present in your data because they are super-special cases.
So adding the josekipedia flags to a joseki would be and interesting cross-check.
You can also have a wrong move due to an error in the sgf (you need 3 occurences so it shouldnt really be a problem but who knows ?)
if josekipedia data is not available, the existence of the line in a joseki dictionary is also of interest.

Also of interes would be the date of first/last appearance of a joseki in the DB:it will show new or outdated joseki?

Re: Question about Daily Joseki method

Posted: Wed Aug 17, 2011 5:48 pm
by daniel_the_smith
Thanks for the comments, perceval.

Are your cosmetic suggestions intended for the study interface? Or the browse page?

I've considered trying to make a link swap arrangement with josekipedia, but I've been busy with other things and haven't pursued it.

The new data I'm working on should be much more authoritative than the data I have at the moment. One thing I eventually want to have is a rating by difficulty. I'm not sure whether it'll be best to crowdsource that or come up with some simple rules. Or maybe I could get my hands on some kgs games of various levels and scan them with my tool to see what "joseki" are popular at what levels.

What I'm doing right now:

Screenshot-System Monitor.png
Screenshot-System Monitor.png (87.7 KiB) Viewed 8748 times


That's my tree building program using more than 6 cores and 3gb of ram. The GoGoD database has only 68k games, but when you consider rotations et cetera, it's something like 350 million positions I have to examine to build the tree. It was a bit of a trick just getting this to run. It will use about 120gb of hard drive space while it's working.

But I'm not building the whole thing right now, I'm building part of it to test with. Ah, ok, it's done...

Re: Question about Daily Joseki method

Posted: Tue Aug 30, 2011 6:36 pm
by daniel_the_smith
I know you guys haven't seen much new from me lately, but I really am working on the website and making decent progress. :)