It is currently Tue Apr 30, 2024 6:07 pm

All times are UTC - 8 hours [ DST ]




Post new topic Reply to topic  [ 6 posts ] 
Author Message
Offline
 Post subject: Thinking time charts for AlphaGo vs Lee Sedol
Post #1 Posted: Fri Mar 11, 2016 9:22 am 
Lives in gote

Posts: 653
Location: Austin, Texas, USA
Liked others: 54
Was liked: 216
Credit https://www.reddit.com/user/junkwhinger

Reddit thread for Game 1
Reddit thread for Game 2

Inline images below, click the links for better resolution versions. On those you can see the move numbers but they are full-ply, multiply by 2 to get the traditional move numbers. y-axis is in seconds.

Game 1
Image
The biggest spike for Lee at move 52 was answering AlphaGo's invasion of the right side. You can also see that after that long think, AlphaGo answered very quickly. We know AlphaGo uses the opponent's time to continue thinking, and even though Lee though for a very long time his move was to be expected. So AlphaGo had enough time to decide that move already.

Game 2
Image
The spike for Lee's 19th move is him thinking how to respond to AlphaGo's unusual 5th line shoulder hit.

Game 3
Image
AlphaGo spent the most time on White 61 aka White 122 -- connecting 4 white stones in a squeeze on the right. Not sure why it would think so much at that point... AlphaGo's quickest move was 71 aka 142 -- blocking a push by Black. Makes sense that it could answer quickly there.

Game 4
Image

ETA: We don't have detailed information on AlphaGo's assessment of it' winning chances, but I wonder if you can tell something about the tailing off of time near the end. In Game 1 you can see a clear downward trend in time usage after White 71 aka White 142, which secured the life of white's corner in the lower right. This is also consistent with an article I saw that said the Google folks saw the evaluation of the game go up around 30 minutes before the end of the game. In Game 2 you see something similar with Black 80 aka Black 160, where Black initiates a sequence to seal off a good chunk of center territory.


Last edited by yoyoma on Sun Mar 13, 2016 1:44 pm, edited 3 times in total.

This post by yoyoma was liked by 13 people: betterlife, Bonobo, Calvin Clark, dohduhdah, Drew, ez4u, gamesorry, hyperpape, illluck, jeromie, Knotwilg, mhlepore, Uberdude
Top
 Profile  
 
Offline
 Post subject: Re: Thinking time charts for AlphaGo vs Lee Sedol
Post #2 Posted: Sat Mar 12, 2016 5:15 am 
Beginner

Posts: 11
Liked others: 1
Was liked: 0
Has there been any information or educated guesses as to how AlphaGo manages it's time? The commentators seemed to think it sometimes takes a lot of time to think about 'obvious' moves. I'm wondering if it has some set minimum limit per move (what has been the shortest time AlphaGo has used for a move in all it's games?) and how does it decide to stop searching for a better move.

Top
 Profile  
 
Offline
 Post subject: Re: Thinking time charts for AlphaGo vs Lee Sedol
Post #3 Posted: Sat Mar 12, 2016 9:10 am 
Honinbo

Posts: 9545
Liked others: 1600
Was liked: 1711
KGS: Kirby
Tygem: 커비라고해
Obvious moves aren't good enough for AlphaGo :-p

_________________
be immersed

Top
 Profile  
 
Offline
 Post subject: Re: Thinking time charts for AlphaGo vs Lee Sedol
Post #4 Posted: Sat Mar 12, 2016 9:35 am 
Lives in sente
User avatar

Posts: 1311
Liked others: 14
Was liked: 153
Rank: German 1 Kyu
Kirby wrote:
Obvious moves aren't good enough for AlphaGo :-p

Probably AlphaGo has to consider, whether locally "obvious" moves will be the best choice globally ?

_________________
The really most difficult Go problem ever: https://igohatsuyoron120.de/index.htm
Igo Hatsuyōron #120 (really solved by KataGo)

Top
 Profile  
 
Offline
 Post subject: Re: Thinking time charts for AlphaGo vs Lee Sedol
Post #5 Posted: Sun Mar 13, 2016 11:40 am 
Lives in sente

Posts: 757
Liked others: 114
Was liked: 916
Rank: maybe 2d
mika wrote:
Has there been any information or educated guesses as to how AlphaGo manages it's time? The commentators seemed to think it sometimes takes a lot of time to think about 'obvious' moves. I'm wondering if it has some set minimum limit per move (what has been the shortest time AlphaGo has used for a move in all it's games?) and how does it decide to stop searching for a better move.


I don't know what the time usage policy is, but I have experience writing bots for games, and my experience is that "good" time usage policy is fairly hard and unfruitful for how much gain it gives you over something simple. Particularly with AlphaGo only having only 1.5 years of development and on the heels of a breakthrough in other techniques that are likely producing all sorts of low hanging fruit, it's reasonably likely that the AlphaGo team did something not too complicated (at best, a mix of some heuristics about distance to game end, time available including pondering, and maybe entropy of its desire to play different moves) and instead devoted their effort to more valuable things.

I would be extremely surprised if the time usage policy ever became anywhere close to as nonuniform as Lee Sedol's. Doing so is very very dangerous for the playing strength of your bot - from an algorithmic perspective it's not easy to tell when a move is "obvious", so the risk of blundering due to moving way too fast is not worth it.

Top
 Profile  
 
Offline
 Post subject: Re: Thinking time charts for AlphaGo vs Lee Sedol
Post #6 Posted: Sun Mar 13, 2016 1:44 pm 
Lives in gote

Posts: 653
Location: Austin, Texas, USA
Liked others: 54
Was liked: 216
Added chart for Game 4 to the OP.

Top
 Profile  
 
Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 6 posts ] 

All times are UTC - 8 hours [ DST ]


Who is online

Users browsing this forum: No registered users and 1 guest


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Search for:
Jump to:  
cron
Powered by phpBB © 2000, 2002, 2005, 2007 phpBB Group