It is currently Thu Mar 28, 2024 6:58 pm

All times are UTC - 8 hours [ DST ]




Post new topic Reply to topic  [ 11 posts ] 
Author Message
Offline
 Post subject: swim into the dark forest
Post #1 Posted: Tue Oct 04, 2016 9:11 pm 
Lives in gote
User avatar

Posts: 392
Liked others: 23
Was liked: 43
Rank: NR
curiosity. that's what drives science and technology innovation.

mcts is better at Go than alpha-beta. and dcnn is better at Go than stone pattern reflex reactions.

so dcnn+mcts is the best so far.


Last edited by djhbrown on Tue May 02, 2017 12:30 am, edited 1 time in total.

This post by djhbrown was liked by: daal
Top
 Profile  
 
Offline
 Post subject: Re: swim into the dark forest
Post #2 Posted: Wed Oct 05, 2016 9:08 am 
Oza
User avatar

Posts: 2777
Location: Seattle, WA
Liked others: 251
Was liked: 549
KGS: oren
Tygem: oren740, orenl
IGS: oren
Wbaduk: oren
djhbrown wrote:
it's commonsense that swim is better than dcnn, because swim is thoughtful, whereas dcnn is just a bunch of reflexes.


This has to be proven. If there's anything about commonsense, it's often not common and it's often wrong.


This post by oren was liked by 4 people: Bonobo, gamesorry, sparky314, Waylon
Top
 Profile  
 
Offline
 Post subject: Re: swim into the dark forest
Post #3 Posted: Wed Oct 05, 2016 9:47 am 
Gosei
User avatar

Posts: 1744
Liked others: 702
Was liked: 288
KGS: greendemon
Tygem: greendemon
DGS: smaragdaemon
OGS: emeraldemon
This is the 4th thread by djhbrown on "Commonsense Go". See one, two, three.
djhbrown, if you are serious: what you have is a hypothesis. Test it. Making claims without evidence only hurts your credibility.

Even a slow bad python script that plays at 20k level would at least show that your "commonsense go" can exist outside your own head. If you're thinking "I think I have a great idea, but I need help figuring out how to implement it," just say that.


This post by emeraldemon was liked by 3 people: Bonobo, Drew, Waylon
Top
 Profile  
 
Offline
 Post subject: Re: swim into the dark forest
Post #4 Posted: Wed Oct 05, 2016 10:41 am 
Lives with ko

Posts: 202
Location: Santiago, Chile
Liked others: 39
Was liked: 44
Rank: EGF 1d
Universal go server handle: Jhyn
There is a saying among computer scientists (and mathematicians), that the fastest way to find the deepest problems or mistakes in a scientific paper is to check all the sentences starting by "it is obvious", "it is clear", "we can easily see that".

Anyway, in this case, the commensense statement looks to me wrong by common sense: if a bot is able to explain his moves in plain English using existing concepts, then it means that it has been programmed using existing manmade theory, and is thus unable to do brilliant moves that expand the field of what is considered playable in the way that AlphaGo did - moves that "just work", but make little sense or are blind spots to the top pros (see pro commentary https://deepmind.com/research/alphago/alphago-games-english/.

Looking into making the computer "more human" in his thought process have obvious applications in teaching and commenting, but the belief that human-like thinking will make it stronger is very much to be proven (and, I would say, on its way to be proven wrong).

_________________
La victoire est un hasard, la défaite une nécessité.


This post by Jhyn was liked by: Waylon
Top
 Profile  
 
Offline
 Post subject: Re: swim into the dark forest
Post #5 Posted: Wed Oct 05, 2016 12:00 pm 
Oza
User avatar

Posts: 2508
Liked others: 1304
Was liked: 1128
djhbrown wrote:
it's commonsense that swim is better than dcnn, because swim is thoughtful, whereas dcnn is just a bunch of reflexes.
I play rather thoughtfully, but not very well.

_________________
Patience, grasshopper.


This post by daal was liked by 2 people: Bonobo, Uberdude
Top
 Profile  
 
Offline
 Post subject: Re: swim into the dark forest
Post #6 Posted: Wed Oct 05, 2016 3:45 pm 
Lives in sente

Posts: 757
Liked others: 114
Was liked: 916
Rank: maybe 2d
Simply having the idea like "swim" is great, but by itself it only gets you a tiny, tiny fraction of the way there, and everyone else has their own ideas already too. If you're serious about developing the idea and making a genuine contribution, get your hands dirty and go for it!

The MCTS part is even written for you already, so you don't even have to do all that work yourself! Go clone Darkforest or Pachi or any other open source Go engine, and build your own logic right on top of their existing MCTS algorithms. If you can make an improvement, that would be really cool and speak volumes. If you don't really know how to code or haven't done a serious project before, there's no better way or time to learn than to jump in to something that you're invested in and excited about. :)


This post by lightvector was liked by 2 people: Bonobo, Waylon
Top
 Profile  
 
Offline
 Post subject: Re: swim into the dark forest
Post #7 Posted: Wed Oct 05, 2016 6:07 pm 
Lives in gote
User avatar

Posts: 392
Liked others: 23
Was liked: 43
Rank: NR
lightvector wrote:
If you don't really know how to code or haven't done a serious project before,

as it happens, i have done a couple of serious projects before, starting with a PhD in machine learning (my cv is at the bottom of link).


Last edited by djhbrown on Tue May 02, 2017 12:31 am, edited 1 time in total.

This post by djhbrown was liked by 2 people: lobotommy, Waylon
Top
 Profile  
 
Offline
 Post subject: Re: swim into the dark forest
Post #8 Posted: Thu Oct 06, 2016 6:34 am 
Lives in sente

Posts: 1037
Liked others: 0
Was liked: 180
But I think the concern of some of us about this common sense idea that "knowing" is somehow superior to being able to "simply do" is that this is NOT obvious.

WHY? (except for being able to explain how")

I think you should take a closer look at those two approaches "by reflex" to understand what their limitations actually are.

MCTS ---- what would be the result of this approach WITHOUT the limitation of time controls? In other words, what if one did NOT have to (in "practical implementations") use pruning, etc. Yes, not practical in the real world (because time IS bounded) but hasn't this been shown to solve the problem "what is the best next move" at lower complexity (less time) that exhaustive search? In other words, isn't this algorithm a "cracking" of the problem, even if not yet a cracking that is practical?

DCNN ---- neural nets are trained to evaluate a function. A program implements the neural net but then the neural net still has to be trained. The function in this case being "given a board position, return the best next move". When dealing with neural nets there are TWO very separate questions. First, is the net of sufficient size and complexity of potentioal connections that it COULD be trained to evaluate the function. Second, even if possible, has its training achieved that (yet).

That you seem to think of "training to correctly recognize one more input-output pair" as the same as making a hard coded change to an AI program means that you are misunderstanding the (extremely interesting) property of neural nets that they DO seem to generalize form the learning process. In other words, training for "one more pair" results in MORE than one pair being learned.

I would also like you to look at your "common sense" idea that being able to EXPLAIN the solution implies a superior solution to the "play go" problem. WHY? Would your cat's ability to catch mice be improved by your cat being able to explain its thinking process to you? What thought processes it is going through from the first "sense something there" to the satisfying crunch of the first bite after the captured toy has broken and no more fun to simply play with?


This post by Mike Novack was liked by: Waylon
Top
 Profile  
 
Offline
 Post subject: Re: swim into the dark forest
Post #9 Posted: Thu Oct 06, 2016 7:53 pm 
Lives in gote
User avatar

Posts: 392
Liked others: 23
Was liked: 43
Rank: NR
Polya’s First Principle: Understand the problem


Polya’s Second Principle: Devise a plan


Last edited by djhbrown on Tue May 02, 2017 12:33 am, edited 1 time in total.
Top
 Profile  
 
Offline
 Post subject: Re: swim into the dark forest
Post #10 Posted: Fri Oct 07, 2016 6:00 am 
Lives in sente

Posts: 1037
Liked others: 0
Was liked: 180
I think going into the philosophy of knowledge/problem solving not going to help except to see some of the underlying assumptions we each make.

For example, I do NOT believe in "intelligent design" (that the natural order did not just "evolve"). Thus I do not accept what seems to be your underlying assumption that a PLANNED route to the solution of a problem is necessarily superior to one that is EVOLVED. I would doubt that trying to plan/design the "program" that makes the cat very good at catching mice would result in a superior mouser than the one that has evolved.

The current problem, in this case, is "play a very strong game of go". It's OK to suggest we attack instead a different problem, "play a very good game of go AND be able to help humans understand why played as did". OK to suggest that this would be a more useful problem for us to tackle. My objection is to the claim that this would ALSO lead to a better "very good game" than the current problem. That is very far from obvious.

The training of a DCNN is not completely unlike an evolutionary process.

Top
 Profile  
 
Offline
 Post subject: Re: swim into the dark forest
Post #11 Posted: Fri Oct 07, 2016 8:59 am 
Lives with ko

Posts: 202
Location: Santiago, Chile
Liked others: 39
Was liked: 44
Rank: EGF 1d
Universal go server handle: Jhyn
May I add that the Polya advice is destined to students, who I assume are supposed to have a teacher. It's all well to be given a map to your destination instead of going blindly - but it means that somebody else have to go there first to draw the map! From there you must explore, and how can you have a map when you explore? In other words, how can you get stronger that human players if you use the exact same thought processes than them?

_________________
La victoire est un hasard, la défaite une nécessité.

Top
 Profile  
 
Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 11 posts ] 

All times are UTC - 8 hours [ DST ]


Who is online

Users browsing this forum: No registered users and 1 guest


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Search for:
Jump to:  
Powered by phpBB © 2000, 2002, 2005, 2007 phpBB Group