It is currently Sun Apr 28, 2024 5:32 am

All times are UTC - 8 hours [ DST ]




Post new topic Reply to topic  [ 20 posts ] 
Author Message
Offline
 Post subject: Prediction for the upcoming tournament?
Post #1 Posted: Tue Jul 21, 2015 3:18 pm 
Lives in sente

Posts: 1037
Liked others: 0
Was liked: 181
Next week, at the European Congress. I don't know whose idea this was, but the competing programs are required to use the same cpu (i5-4590, machines being provided) and this is something rather affordable. So not only do we get to see which program strongest under this limitation, but should give us an idea of the strength of the programs on our own machines.

My guess is that aya and oakfoam will place higher than they have been doing. The machines those two have been running on in recent tournaments not much more powerful than what they will be running on in this tournament. But several of the other programs have been running on much more powerful machines.


This post by Mike Novack was liked by 2 people: Bonobo, ez4u
Top
 Profile  
 
Offline
 Post subject:
Post #2 Posted: Tue Jul 21, 2015 6:45 pm 
Honinbo
User avatar

Posts: 8859
Location: Santa Barbara, CA
Liked others: 349
Was liked: 2076
GD Posts: 312
Quote:
required to use the same cpu, machines being provided
:tmbup:

Top
 Profile  
 
Offline
 Post subject: Re:
Post #3 Posted: Tue Jul 21, 2015 6:49 pm 
Oza
User avatar

Posts: 2401
Location: Tokyo, Japan
Liked others: 2340
Was liked: 1332
Rank: Jp 6 dan
KGS: ez4u
EdLee wrote:
Quote:
required to use the same cpu, machines being provided
:tmbup:

Second that! :tmbup: :tmbup:

_________________
Dave Sigaty
"Short-lived are both the praiser and the praised, and rememberer and the remembered..."
- Marcus Aurelius; Meditations, VIII 21

Top
 Profile  
 
Offline
 Post subject: Re: Prediction for the upcoming tournament?
Post #4 Posted: Tue Jul 21, 2015 6:58 pm 
Oza

Posts: 2180
Location: ʍoquıɐɹ ǝɥʇ ɹǝʌo 'ǝɹǝɥʍǝɯos
Liked others: 237
Was liked: 662
Rank: AGA 5d
GD Posts: 4312
Online playing schedule: Every tenth February 29th from 20:00-20:01 (if time permits)
Isn't that a little bit like asking Einstein to use the brain of an average physics professor?

_________________
Still officially AGA 5d but I play so irregularly these days that I am probably only 3d or 4d over the board (but hopefully still 5d in terms of knowledge, theory and the ability to contribute).

Top
 Profile  
 
Offline
 Post subject: Re: Prediction for the upcoming tournament?
Post #5 Posted: Tue Jul 21, 2015 7:22 pm 
Gosei
User avatar

Posts: 1639
Location: Ponte Vedra
Liked others: 642
Was liked: 490
Universal go server handle: Bantari
DrStraw wrote:
Isn't that a little bit like asking Einstein to use the brain of an average physics professor?

Nope.

_________________
- Bantari
______________________________________________
WARNING: This post might contain Opinions!!


This post by Bantari was liked by: hyperpape
Top
 Profile  
 
Offline
 Post subject: Re: Prediction for the upcoming tournament?
Post #6 Posted: Wed Jul 22, 2015 6:08 am 
Lives in sente

Posts: 1037
Liked others: 0
Was liked: 181
No for several reasons:

1) Even for the programs using MCTS there are issues related to proper modification of the basic algorithm to optimize for the time control + crunch power situation. Ideally the designers of the programs should have that adjustable. But maybe some of then aren't readily adjustable.

For the marketers of such software, I'd call it an honesty issue (remember, some of these are free, others not). The buyers (or free users) of the software don't have machines more powerful (or not much more powerful) than the machines that will be used in this tournament. They may even have portable devices this strong. So it is of great interest how strong go can be played by bots running on that amount of hardware.

2) Not all of these programs are MCTS. For example, the oakfoam engine is a neural net. Simply doesn't have such high computational requirements. I think we all might want to see how this compares to MCTS limited to the same amount of crunch because one of the suggestions I have seen made is to have the neural net return not one but a small set of moves and then apply MCTS to this narrowed tree. The difference between the small machine used here and the most powerful machines otherwise used in these tournaments would be available for that.

3) Limiting some factor in contests is fairly common and does not prevent development of all the other factors. For example, limits on engine size, fuel used, etc. in auto racing simply means that the other factors determine who is fastest.


This post by Mike Novack was liked by: ez4u
Top
 Profile  
 
Offline
 Post subject: Re: Prediction for the upcoming tournament?
Post #7 Posted: Wed Jul 22, 2015 10:43 am 
Lives in gote

Posts: 436
Liked others: 1
Was liked: 38
Rank: KGS 5 kyu
Mike Novack wrote:
No for several reasons:

1) Even for the programs using MCTS there are issues related to proper modification of the basic algorithm to optimize for the time control + crunch power situation. Ideally the designers of the programs should have that adjustable. But maybe some of then aren't readily adjustable.

For the marketers of such software, I'd call it an honesty issue (remember, some of these are free, others not). The buyers (or free users) of the software don't have machines more powerful (or not much more powerful) than the machines that will be used in this tournament. They may even have portable devices this strong. So it is of great interest how strong go can be played by bots running on that amount of hardware.

2) Not all of these programs are MCTS. For example, the oakfoam engine is a neural net. Simply doesn't have such high computational requirements. I think we all might want to see how this compares to MCTS limited to the same amount of crunch because one of the suggestions I have seen made is to have the neural net return not one but a small set of moves and then apply MCTS to this narrowed tree. The difference between the small machine used here and the most powerful machines otherwise used in these tournaments would be available for that.

3) Limiting some factor in contests is fairly common and does not prevent development of all the other factors. For example, limits on engine size, fuel used, etc. in auto racing simply means that the other factors determine who is fastest.



Any more info on this neural network + MCTS ?

Top
 Profile  
 
Offline
 Post subject: Re: Prediction for the upcoming tournament?
Post #8 Posted: Wed Jul 22, 2015 3:30 pm 
Lives in sente

Posts: 1037
Liked others: 0
Was liked: 181
Krama wrote:

Any more info on this neural network + MCTS ?


I've seen it mentioned but don't know if it's being worked on yet.

Top
 Profile  
 
Offline
 Post subject: Re: Prediction for the upcoming tournament?
Post #9 Posted: Wed Jul 22, 2015 4:18 pm 
Dies in gote

Posts: 31
Liked others: 1
Was liked: 5
Rank: about 15k
KGS: ericf
Mike Novack wrote:
Krama wrote:

Any more info on this neural network + MCTS ?


I've seen it mentioned but don't know if it's being worked on yet.


This looked interesting:

http://leafcloud.com/research/decision- ... -learning/

Decision Forests for Computer Go Feature Learning
Author: Francois van Niekerk
Supervisor: Dr. Steve Kroon
Thesis for MSc (Computer Science) at Stellenbosch University

Abstract
In computer Go, moves are typically selected with the aid of a tree search algorithm. Monte-Carlo tree search (MCTS) is currently the dominant algorithm in computer Go. It has been shown that the inclusion of domain knowledge in MCTS is able to vastly improve the strength of MCTS engines. A successful approach to representing domain knowledge in computer Go is the use of appropriately weighted tactical features and pattern features, which are comprised of a number of hand-crafted heuristics and a collection of patterns respectively. However, tactical features are hand-crafted specifically for Go, and pattern features are Go-specific, making it unclear how they can be easily transferred to other domains.

As such, this work proposes a new approach to representing domain knowledge, decision tree features. These features evaluate a state-action pair by descending a decision tree, with queries recursively partitioning the state-action pair input space, and returning a weight corresponding to the partition element represented by the resultant leaf node. In this work, decision tree features are applied to computer Go, in order to determine their feasibility in comparison to state-of-the-art use of tactical and pattern features. In this application of decision tree features, each query in the decision tree descent path refines information about the board position surrounding a candidate move.

The results of this work showed that a feature instance with decision tree features is a feasible alternative to the state-of-the-art use of tactical and pattern features in computer Go, in terms of move prediction and playing strength, even though computer Go is a relatively well-developed research area. A move prediction rate of 35.9% was achieved with tactical and decision tree features, and they showed comparable performance to the state of the art when integrated into an MCTS engine with progressive widening.

We conclude that the decision tree feature approach shows potential as a method for automatically extracting domain knowledge in new domains. These features can be used to evaluate state-action pairs for guiding search-based techniques, such as MCTS, or for action-prediction tasks.

Top
 Profile  
 
Offline
 Post subject: Re: Prediction for the upcoming tournament?
Post #10 Posted: Wed Jul 22, 2015 11:57 pm 
Lives in sente
User avatar

Posts: 842
Liked others: 180
Was liked: 151
Rank: 3d
GD Posts: 422
KGS: komi
I chatted to Francois yesterday to get some insight into this. He confirmed that neural nets have been added to Oakfoam, but that he's not actively working on it anymore. The work is being done by Detlef Schmicker, who has forked Oakfoam. You can see his fork here: https://bitbucket.org/dsmic/oakfoam

Oakfoam with neural nets played in the recent computer olympiad (coming last): http://www.grappa.univ-lille3.fr/icga/t ... php?id=290

Top
 Profile  
 
Offline
 Post subject: Re: Prediction for the upcoming tournament?
Post #11 Posted: Fri Jul 31, 2015 1:00 pm 
Lives in sente

Posts: 1037
Liked others: 0
Was liked: 181
Only some of the usual programs took part. My guess here is that with the constraint of having to play on a machine much weaker than they usually played on, the teams for some of the programs didn't think they could adjust correctly to compensate for that, didn't want a poor result for that reason. It was not a surprise to me that Aya, which normally runs on a machine of approximately this power, did comparatively better than usual.

EGC2015 Computer Go Tournament
Players Position Name # Results Score Notes1234

1 AyaMC [-] X 1/1 1/1 1/1 3 Winner
2 ManyFaces1 [-] 0/1 X 1/1 1/1 2
3 pachi [2d] 0/1 0/1 X 1/1 1
4 jimmy [-] 0/1 0/1 0/1 X 0

So it was Aya that got to play the human

2015-07-29 Hajin Lee 3p vs AyaMC 19×19 Five stones 0-1 2015 European Go Congress
Played in Liberec, Czech Republic. The time-setting was 60 minutes each plus byoyomi. Japanese rules were used.


OOPS -- apparently I don't understand how to get an sgf file in here properly. Can somebody help with that so we can show the game.

Top
 Profile  
 
Offline
 Post subject: Re: Prediction for the upcoming tournament?
Post #12 Posted: Fri Jul 31, 2015 1:10 pm 
Lives in sente

Posts: 1037
Liked others: 0
Was liked: 181
[sgf-full]http://www.computer-go.info/h-c/sgf/2015/HayleeEGC-AyaMC.sgf[sgf-full]

Top
 Profile  
 
Offline
 Post subject: Re: Prediction for the upcoming tournament?
Post #13 Posted: Fri Jul 31, 2015 3:35 pm 
Oza
User avatar

Posts: 2401
Location: Tokyo, Japan
Liked others: 2340
Was liked: 1332
Rank: Jp 6 dan
KGS: ez4u
Mike Novack wrote:

_________________
Dave Sigaty
"Short-lived are both the praiser and the praised, and rememberer and the remembered..."
- Marcus Aurelius; Meditations, VIII 21

Top
 Profile  
 
Offline
 Post subject: Re: Prediction for the upcoming tournament?
Post #14 Posted: Fri Jul 31, 2015 5:20 pm 
Lives in sente

Posts: 1037
Liked others: 0
Was liked: 181
Thanks, though I would appreciate it if somebody explained what I was doing wrong.

Meanwhile, maybe somebody would put up the tournament game between AyaMC and ManyFaces1. Apparently a half point squeaker.

Top
 Profile  
 
Offline
 Post subject: Re: Prediction for the upcoming tournament?
Post #15 Posted: Fri Jul 31, 2015 5:44 pm 
Oza
User avatar

Posts: 2777
Location: Seattle, WA
Liked others: 251
Was liked: 549
KGS: oren
Tygem: oren740, orenl
IGS: oren
Wbaduk: oren
Mike Novack wrote:
Thanks, though I would appreciate it if somebody explained what I was doing wrong.


Hit "quote" on ez4u's post and you'll see.

Top
 Profile  
 
Offline
 Post subject: Re: Prediction for the upcoming tournament?
Post #16 Posted: Sat Aug 01, 2015 5:14 am 
Lives in gote

Posts: 436
Liked others: 1
Was liked: 38
Rank: KGS 5 kyu
I am interested in neural networks (which if I am correct can guess the pro move with ~40% accuracy) being implemented in MCTS engine...

However no advanced info can be found on that.

Top
 Profile  
 
Offline
 Post subject: Re: Prediction for the upcoming tournament?
Post #17 Posted: Sat Aug 01, 2015 6:32 am 
Gosei
User avatar

Posts: 1585
Location: Barcelona, Spain (GMT+1)
Liked others: 577
Was liked: 298
Rank: KGS 5k
KGS: RBerenguel
Tygem: rberenguel
Wbaduk: JohnKeats
Kaya handle: RBerenguel
Online playing schedule: KGS on Saturday I use to be online, but I can be if needed from 20-23 GMT+1
Krama wrote:
I am interested in neural networks (which if I am correct can guess the pro move with ~40% accuracy) being implemented in MCTS engine...

However no advanced info can be found on that.


What kind of info are you looking for? The papers on NN are available (IIRC there's a post here with links to them) but so far only mentioned about the possibility of using the NN as move generator for MC programs

_________________
Geek of all trades, master of none: the motto for my blog mostlymaths.net

Top
 Profile  
 
Offline
 Post subject: Re: Prediction for the upcoming tournament?
Post #18 Posted: Sat Aug 01, 2015 8:08 am 
Lives in sente

Posts: 1037
Liked others: 0
Was liked: 181

Top
 Profile  
 
Offline
 Post subject: Re: Prediction for the upcoming tournament?
Post #19 Posted: Sat Aug 01, 2015 8:25 am 
Lives in sente

Posts: 1037
Liked others: 0
Was liked: 181
oren wrote:
Hit "quote" on ez4u's post and you'll see.


Thank you, I see it (missing slash in the syntax for the terminator; "initiate sgf" and "terminate sgf" are not the same).

Please, if this ever happens again and I ask a question like that, just say what it is. If I wasn't seeing that "slash" in the example "how to post an sgf", why assume that just staring at it again would help?

Top
 Profile  
 
Offline
 Post subject: Re: Prediction for the upcoming tournament?
Post #20 Posted: Sat Aug 01, 2015 10:17 am 
Lives in gote

Posts: 436
Liked others: 1
Was liked: 38
Rank: KGS 5 kyu
RBerenguel wrote:
Krama wrote:
I am interested in neural networks (which if I am correct can guess the pro move with ~40% accuracy) being implemented in MCTS engine...

However no advanced info can be found on that.


What kind of info are you looking for? The papers on NN are available (IIRC there's a post here with links to them) but so far only mentioned about the possibility of using the NN as move generator for MC programs


I did read all the articles that can be found on NN and NN used in go.. I even looked at those games that someone posted where a NN is playing some basic go program?

But I am really interested in combining the NN with MCTS and some strong hardware.

Top
 Profile  
 
Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 20 posts ] 

All times are UTC - 8 hours [ DST ]


Who is online

Users browsing this forum: No registered users and 1 guest


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Search for:
Jump to:  
Powered by phpBB © 2000, 2002, 2005, 2007 phpBB Group