It is currently Tue Apr 30, 2024 6:23 am

All times are UTC - 8 hours [ DST ]




Post new topic Reply to topic  [ 6 posts ] 
Author Message
Offline
 Post subject: New chess program
Post #1 Posted: Tue Sep 15, 2015 4:23 pm 
Lives in gote

Posts: 389
Liked others: 81
Was liked: 128
KGS: lepore
I know this is a Go forum, but the link below makes it seem like computer chess intelligence is changing. Are they becoming more like strong Go programs?

http://www.technologyreview.com/view/54 ... al-master/

Top
 Profile  
 
Offline
 Post subject: Re: New chess program
Post #2 Posted: Tue Sep 15, 2015 4:56 pm 
Honinbo

Posts: 9545
Liked others: 1600
Was liked: 1711
KGS: Kirby
Tygem: 커비라고해
Thanks for the article, mhlepore.

As far as I know, Remi's approach with CrazyStone (Monte Carlo Tree Search) is what has worked best for Go so far. In that sense, a neural network is a little different, since it's more like trained pattern recognition than search.

The paper suggests that the same approach could be extended to Go. There's some discussion on Neural Nets and Go on SL: http://senseis.xmp.net/?NeuralNetworksAndGo

As far as I know, Remi's approach has been better so far.

But I guess that this type of statement can always be proven wrong when somebody develops a stronger go program :-)

_________________
be immersed

Top
 Profile  
 
Offline
 Post subject: Re: New chess program
Post #3 Posted: Wed Sep 16, 2015 2:30 am 
Lives in gote

Posts: 436
Liked others: 1
Was liked: 38
Rank: KGS 5 kyu
A neural network trained by using pro games + MCTS :)

This is how I imagine the future should look like, and with this we could probably get to insei level.

Top
 Profile  
 
Offline
 Post subject: Re: New chess program
Post #4 Posted: Wed Sep 16, 2015 6:42 am 
Lives in sente

Posts: 1037
Liked others: 0
Was liked: 181
Krama wrote:
A neural network trained by using pro games + MCTS :)
This is how I imagine the future should look like, and with this we could probably get to insei level.


This bears discussion. First we should remember the history of the MCTS approach. While immediately obvious that major advance from the then strongest "go knowledge" based AI porgrams, the "infant" MCTS programs weren't stronger than the infant neural net programs. And MCTS may have "hit the wall" (because computationally intensive).

The current neural net programs are trained to attempt to predict THE move that an expert would make and play on that basis alone. With this training based on just the record of games between experts. There are a number of possibilities.

1) "add" training based on problems. I believe it is possible to have placements for the rest of the board (outside the problem area) such that ONLY correctly solving the problem brings victory. I put "add" in quotes because back and forth training (on different bases) could be used for "annealing" << if you don't know how neural nets are trained, won't make much sense >>

2) Returning the BEST single move (what percentage success with that) is not the same thing as returning a small set of moves and asking what the percentage success that this set contain the best move. Needs to be investigated, because if that set is small (for a very high percentage of success) MCTS could then be used as an evaluator to choose between them. Potential for significant time gain. Remember, there are TWO ways that a MCTS program can fail to find the best move. One is to incorrectly identify the best from the set that was the root of the trees. But the other is not having the best move in that set.

Top
 Profile  
 
Offline
 Post subject: Re: New chess program
Post #5 Posted: Fri Sep 18, 2015 9:11 am 
Lives in gote

Posts: 436
Liked others: 1
Was liked: 38
Rank: KGS 5 kyu
Mike Novack wrote:
Krama wrote:
A neural network trained by using pro games + MCTS :)
This is how I imagine the future should look like, and with this we could probably get to insei level.


This bears discussion. First we should remember the history of the MCTS approach. While immediately obvious that major advance from the then strongest "go knowledge" based AI porgrams, the "infant" MCTS programs weren't stronger than the infant neural net programs. And MCTS may have "hit the wall" (because computationally intensive).

The current neural net programs are trained to attempt to predict THE move that an expert would make and play on that basis alone. With this training based on just the record of games between experts. There are a number of possibilities.

1) "add" training based on problems. I believe it is possible to have placements for the rest of the board (outside the problem area) such that ONLY correctly solving the problem brings victory. I put "add" in quotes because back and forth training (on different bases) could be used for "annealing" << if you don't know how neural nets are trained, won't make much sense >>

2) Returning the BEST single move (what percentage success with that) is not the same thing as returning a small set of moves and asking what the percentage success that this set contain the best move. Needs to be investigated, because if that set is small (for a very high percentage of success) MCTS could then be used as an evaluator to choose between them. Potential for significant time gain. Remember, there are TWO ways that a MCTS program can fail to find the best move. One is to incorrectly identify the best from the set that was the root of the trees. But the other is not having the best move in that set.


This is why a NN would give top 3 moves that it thinks are the best and then MCTS could play using those three moves and find out which should be the best.

Also what happens if you take top 3 moves from NN and then ask it to find top 3 moves for each of those moves (this time playing as opponent) and then repeat again. then out of them evaluate those 27 moves somehow and pick the best few and let it run in MCTS.

Also on your idea to train NN with L&D problems is something I have been thinking of and it shouldn't be hard.

Setup a L&D problem in one part of the board and setup the rest of the board with live groups that have eyes and make the score such that L&D problem needs to be solved in order to win the game.

Top
 Profile  
 
Offline
 Post subject: Re: New chess program
Post #6 Posted: Fri Sep 18, 2015 9:26 am 
Tengen

Posts: 4380
Location: North Carolina
Liked others: 499
Was liked: 733
Rank: AGA 3k
GD Posts: 65
OGS: Hyperpape 4k
Mike Novack wrote:
Remember, there are TWO ways that a MCTS program can fail to find the best move. One is to incorrectly identify the best from the set that was the root of the trees. But the other is not having the best move in that set.
Do you have a feel for which problem is more of an issue for contemporary programs? I can't remember if I've seen any discussion of that before.

_________________
Occupy Babel!

Top
 Profile  
 
Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 6 posts ] 

All times are UTC - 8 hours [ DST ]


Who is online

Users browsing this forum: No registered users and 1 guest


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Search for:
Jump to:  
Powered by phpBB © 2000, 2002, 2005, 2007 phpBB Group