LeelaZero adventures on Fox

[Uberdude]

One of those Chinese kibitzers was talking about new LZ 0.16 giving 20% speedup. I just tested on my 1060 GPU with a 40 block network and I go from 3.3k playouts in 30 seconds to 5.9k, a whopping 79% speed increase. Nice!

Used that for a 15s game, and it was the first instance of LZ as black thinking it was losing under the 7.5 komi area rules it assumes, but actually won on Fox 6.5 komi. This was a rematch against this 208W 130L Chinese 9d, the first game LZ won after a pretty even first 120 moves but then did better in a tactitcal centre fight. This game LZ mishandled the invasion of the right side (with more time after found moves it thought better) as although it got in the centre was damaged and the whole group lacked eyeshape. But then he made a big endgame mistake, starting at r1 block (t2 fallback safer) and then with t4 atari he didn't connect (LZ thinks connect is fine and white lives but black gets outside libs in sente) but lost a few points in gote and LZ thought it was winning. But then over the rest of the endgame LZ's winrate dropped again below 50, but actually won by 0.5. Also at the end he ahd a chance to win with a tesuji: LZ hadn't seen h16 atari was good, but when played winrate plummeted because white g18 sets up a shortage of liberties tesuji which captures the n19 tail.

lion winrate.PNG (188.37 KiB) Viewed 22359 times

[sporeyang]

猪猪学棋1 [9D]: 你59手如果长，我很难办 = If you are 59 hands [seconds? was 40 s not 60s game] long, I am very difficult to do.

He means if you play nobi (J14 ?) at move 59 , it will be difficult to deal with.

猪猪学棋1 [9D]: 我要坏菜 = I want bad food [this was said at time of top side fighting, I think he means he wanted to capture stones that weren't good idea to capture, causing indigestion]

He means his situation is not going well. Not specifically related with capturing.

BTW, it writes "#1898" in leelazero7's introduction, maybe you want to correct it. I think the introduction in English is OK since LeelaZero should have been well known to Chinese 9Ds.

[Uberdude]

猪猪学棋1 [9D]: 你59手如果长，我很难办 = If you are 59 hands [seconds? was 40 s not 60s game] long, I am very difficult to do.

He means if you play nobi (J14 ?) at move 59 , it will be difficult to deal with.

Interesting, that was a key moment where LZ kept changing its mind. To start with it wanted to j15 atari and black doesn't collapse on the outside but the shape is quite icky. It was also looking at fancy moves like h16 but then solid connect was #1 just before my overtime period was up so that's the one I played.

[Uberdude]

Coolio, I'm playing FineArtB currently in a 2 handi game! As we know FineArt is a super-strong bot I'll try to help LZ with exploring the promising blue circle moves and avoiding ladder blunders. One thing I've noticed already is FA plays moves which my LZ, in the time available, sometimes sees as higher winrate but hasn't yet risen to top playouts.

Lost. LZ thought it kept the 2 stone advantage for 130 moves, but then winrate quickly dropped off with left side fighting; I regret only spending one 1 minute period on c13, that's a critical time and just after playing d9 fancy knight move rose to top, who knows if FineArt had a good counter to that too (LZ aims at d7 cut and then f7 g7 making good use of dead 2 stones aji, by attacking white on left black gets out to centre). J16 was also a surprising good move. s8 push was me taking a rising blue circle over j6 jump which was probably a mistake.

fineart winrate.PNG (231.68 KiB) Viewed 22274 times

[Uberdude]

First game with new #191 network, game featured a nice squeeze at lower side (although g2 capture seemed very natural and good aji, LZ after a while said white should have h3 connect, worse for points but taking a liberty means the squeeze doesn't exist; also m5 atari should l7 and black squeeze at m8 not so wrap-around). Winrate stayed around 58% for a while, but then dropped without white playing unexpected moves with top right group running. White then extended lead to 60% going into yose but whilst a12 didn't lose l11 was a bit better and would have avoided the game-changing aji, after k10 atari white needed to capture, m14 wedge was a great tesuji to get l12 in sente and then e10 breaks into the white territory and black's won.

[Uberdude]

Just had an exciting 15s game with a 107W 26L human 9d in which the lead changed hands several times. Winrate grew slightly in opening, then dropped quickly with cutting on top left (probably thought f11 was a working ladder initially? actually mainline back then was black c9 at b12 which could be based on idea that black needed to play b12 to avoid ladder). At move 112 winrate was up to 83%, but then he played a sente move for a semeai, and at only 15s LZ tenukid (at 20s would have answered at h16, can lose semeai but then capture 3 stones in sente, I suppose with low playouts it didn't see his hane gained a liberty in sente to win the semeai) for -40% mistake. LZ then got back to slight lead, but then into endgame he took lead with me playing moves that soon after the overtime period ended LZ decided wasn't quite the best. But then LZ took the lead with superior play with the centre yose play around m8, making a nice little bunch of centre points which he could have more aggressively reduced e.g m11 at j7.

LZ 22nov.PNG (250.67 KiB) Viewed 22096 times

[topazg]

Really enjoying these Andrew, keep them coming

I must admit, the idea of someone running a fairly serious #playout LZ bot on a correspondence server would be very interesting to me. Somewhere at the level where reading event horizon issues are very rare would I suspect make for some really super high level games to study or learn from, particularly if the operator put in the bot suggestions for the opponent after the game in a review (something like OGS' review system I guess)

[Uberdude]

Did another low playouts game: #188 on a 2015 MacBook Pro so that's only about 50 playouts in 30 sec overtime, but did get up to a few hundred with reuse in expected sequences. I'd expect this can beat Fox 9ds so long as high-stakes complicated fighting and ladders can be avoided. LZ 2nd line crawled to kill a group leaving a corner ko, he spent several moves to avoid that ko and patch aji and LZ thought it was leading. LZ made weak groups it just managed to save (such confidence to live in the shadow of that ponnuki!), though f6 was a good move it didn't expect. Opp ran out of time at move 152 when LZ though it was at 64% and expected black to start the semeai on right side which is some ridiculous approach ko.

[Uberdude]

Small world! Just played a Hong Kong Fox 9d who turned out to be a student in England who went to the London open last year (came 2nd, 1st was Chinese 5d) so I saw him but didn't speak, told him about the Cambridge tournament next March so hopefully will meet there. He kept game even for 65 moves, but 20% mistake in life and death and then LZ ran away with the game.

[Uberdude]

Played again against 小咕咚77, who I'd lost to before (I think that game I started with LZ, then switched Elf when I though he was LZ too). This game I used Elf v1 from the start and it was close but somewhat surprised to win in the end!

winrate vs mastor77.PNG (182.95 KiB) Viewed 21960 times

[Uberdude]

Played 2 more games as Elfv1 at 20s a move which meant I was usually 5-10k playouts, against a 82W 15L Korean who said he wasn't a pro. First game was particularly exciting with big dragons fighting for life via a ko. Elf with its strong opinions about small opening mistakes though it was leading early because he made the c18 b18 bad exchange (the bot joseki here is same shape as game but without that exchange, which is a slight minus because it means if the white groups needs to live it can make more eyeshape with a gote move by capturing a stone at d18 than had black not made the exchange). Elf took a while to find d11 which had e14 clamp as a sharp continuation. At move 72 instead of top right corner Elf also thought about defending left at e9 and then we would probably have had a more peaceful yose, but the s14 hane connect is a classic large yose protecting the corner and also creates some bad aji in black's right side which Elf used to spectacular effect in a big trade starting from 96 (96 first instinct was defend at m16 but then went for the clamp and fighting in right side). Quite a lot of times he played moves low down in Elf's playouts with similarly good or occasionally better winrates once Elf saw them, the Elf's blindspot and not very exploratory foibles. He killed the top left (so c18 minus was relevant but now resolved) in exchange for me killing the right side. Elf thought l8 was a slight mistake but j10 was the key point for reducing white's right and patching up bad aji of black's left (if tenuki then white will g10 or h10 which thickens centre territory whilst threatening to pull out the d11 stones) and a high stakes fight with neither side backing down ensued in which resurrected the top left dead group but the big lower side group wasn't alive, but neither was black's now cut middle group. Throughout this fighting Elf thought it was around 80% but it appears this was a horizon effect of not realising it couldn't win the ko, or rather if it wins ko as in game the lower side group dies because white can't kill the black middle, L11 was a good move it didn't see until rather late. So white lower group ended up dying and the game was over.

Edit: reviewing with LZ 157 and 191 they both criticise Elf's c12 damezumari which did surprise me during the game. They think capture and try to get black to spend a move at a10 because then white doesn't mind losing the ko so much and also with k3 n1 p5 combo there's aji to make a spare eye if black spends a move threatening the o10 cut. Given the other LZ 157 discussion linked on reddit I wonder if 157 with its extra playouts in the same time is better at winning positions like this which require reading a deep ko fight.

Elfv1 vs sorryz game 1 winrate.PNG (204.57 KiB) Viewed 21865 times

2nd game same opening to start and not so high-stakes fighting. Black h15 was a move Elf didn't consider (expected h16 kosumi) and when he played it winrate dropped a lot: at the time it thought it couldn't hane (not sure why) and needed to have exchanged k11 for l10 before playing h14 (is there a ladder, I can't find?), but reviewing now it says natural g15 hane would have been better than the f17 dodge recommended at the time. Elf got in trouble when it jumped into lower left in endgame (didn't expect natural f2!) but managed to make a ko and magically survive. There was a big ko trade in the endgame but it didn't change the result.

Elfv1 vs sorryz game 2 winrate.PNG (202.36 KiB) Viewed 21865 times

[Uberdude]

Played a game with Elfv1 against an all-wins-to-9d then 1W 1L guy, I found it a wonderful example of Elf's strength in the early game and how it can dodge attacks flexibly for a good result: by move 30 it was at 90%. P14 was a good move from the opponent though that Elf barely considered but at +2% when already down to 11% it wasn't a blindspot that mattered. Thanks to p14 black captured some cutting stones for 4 points but white got the corner in exchange and cornes are big, and then black made another thick ponnuki but in exchange white thickly captured 2 on the outside (r7 was better at j14 to save those cutting stones), and thanks to white s13 the r10 stones weren't even dead yet so black's actual profit was not so much. Ignoring peep at 117 to live and then ignore another peep was another highlight.

[Uberdude]

Just had the win a game by half a point (under Fox 6.5 komi) that the bot thinks it's losing (under 7.5 komi) situation I'd talked about before. I suspect opp was using a bot too, d1 hane losing move was Elf's first choice (not LZ 157 or 191) and a typical bot doesn't matter if I lose points and only win by half move as a human surely would have played a ko threat as he still had plenty. 2 moves prior to that I had switched from Elf v1 to LZ #157 because I suspected it was such a close game and thought 157 might do better at not losing points in a close yose because it won't think it's losing with such a big percentage as Elf. So I don't know if I'd have won had I kept using Elf, but a bit of centaur to pick my guess at the best bot for the stage of the game might have helped here (Lizzie 0.6 has a handy switch network without reloading game feature I just discovered).

[Uberdude]

Another cheeky half point win as black, against a guy running Elfv1 on far faster Tesla v100 GPU. I switched from #191 to #157 again in endgame (move 165). He would have won if I didn't fill in his own territory as the last move of the game -- I don't know if these other people playing with bots on Fox relay the moves manually like me (so could insert a "don't do artificial stupidity" filter to not play such moves, or if it's automated). Still, I was impressed that #191 could hold its own against Elfv1 on superior hardware (though a winning bot can just let you lose by half so not sure how close it really was).

vs v100 elf.PNG (246.29 KiB) Viewed 21683 times

Chat

leelazero7 [9D]: Hello! Pleased to meet you.
一点人 [9D]: Hello! Pleased to meet you.
leelazero7 [9D]: I am LeelaZero #191 on GTX 1060
一点人 [9D]: it's great.
leelazero7 [9D]: you are also AI player?
一点人 [9D]: v100
一点人 [9D]: elfv1
leelazero7 [9D]: ah, so strong
一点人 [9D]: i wonder if ur machine can burden so big weight
leelazero7 [9D]: only about 3000 playouts
一点人 [9D]: ur score is great
leelazero7 [9D]: how many playouts do you get?
3 moves left until the end of this period.
2 moves left until the end of this period.
1 moves left until the end of this period.
Betting ended.
一点人 [9D]: i donot know how to check this number
一点人 [9D]: btw,u might not be 1060.or else, u will lose in 50
一点人 [9D]: hands
leelazero7 [9D]: 1060 is about half power of 1080Ti
一点人 [9D]: i know this fact
一点人 [9D]: ,
Wheel of Fortune! 超辽 wins the 5% jackpot and receives 11.12100.000.000Fox Coins
一点人 [9D]: ,
一点人 user is offline.
一点人 has returned. If disconnected 4 more times, the player will forfeit the game.

The result is declined.
The result is declined.
‘leelazero7’ B+ 0.5 ‘一点人’
8655号对局室胜者: leelazero7 败者: 一点人.
支持结果：总收益1,289,333狐币
第1区间收益 1,289,333狐币
胜者leelazero7获得活动分数3087分，负者一点人获得活动分数1000分，在月人气排行榜中可查看目前的名次
leelazero7 [9D]: thanks
leelazero7 [9D]: not 7.5 komi
leelazero7 [9D]: AI can't handle
一点人 [9D]: u r right
一点人 [9D]: cu
leelazero7 [9D]: bye

[Uberdude]

Played 2 games today, both against other people using latest LZ 193. First I used elf v1 and lost, 2nd I used 191 and was surprised to win seeing as he had the faster 1080 GPU and slightly stronger network (he resigned at move 123). I couldn't get 193 to load but it would be interesting to see where they differed in judgements. Seeing as I was playing another bot I tried to help mine with taking promising winrate moves over the highest playout (e.g. q7 over
q3, n13 over m13 which made a big difference in the fight*), could this really be enough to make a slightly inferior network beat another on much better hardware?. Or maybe just this one game I was lucky to be on the side of the LeelaZero which didn't misjudge the weakness of a group (m15 was cool too).

* This game was 30 second overtimes, so after about 20 seconds m13 was #1 playouts but n13 higher winrate, I spent a bit under 10 seconds to check n13 really was better and then played it. As a test I gave 191 2 minutes for that move and m13 remained #1 (n13 didn't even get higher winrate, the promising alternative this run was f13) but again when played it liked n13. So if we assume that with enough time LZ would eventually give more playouts to n13 (perhaps not true as the exploration parameter seems too low) it's like in this instance I made my GPU more than 4 times faster (and a 1080 is about 2-3 times as fast I think). Another test over 5 minutes (during which e15 was another interesting promising move) m13 was #1 with 41k playouts and 57.4%, n13 800 playouts and 56.4%. Play n13 and for first ~2k it says lower winrate, but once at 4k it's up to 59.4%, and keeps on rising: after 10k at +3% to 60.2%, after 30k at 3.4% to 60.5% (during which it thinks white p8 peep may be slightly better before defending at p13), after 40k +3.5% to 60.6% and white's #1 playouts answer is now L14 but p8 highest winrate (horizon effect of wanting to play a sente move to postpone the inevitable badness? perhaps not, to start with it think black would answer at q8 but then finds black q14 as better resistance).

vs 193 winrate.PNG (254.05 KiB) Viewed 21436 times