Some recent posts motivated me to do at last something I've thought about doing for quite a while.
Mainly I was wondering how Go Seigen fared when compared to AI moves. But I was also still wondering about the alleged cheating case where a claim was made that someone used LZ by picking one of its three top moves. I wondered specifically how Go would fare when his move was compared to the top three.
For lack of time I did not let LZ run very long, but since I was also curious how feasible it was to run and use LZ in parallel with fairly quick time limits typical of servers, I treated that as a plus.
None of this is at all scientific, of course, but I was intrigued by a couple of unexpected things thrown up.
The game was Go Seigen as White against Rin Kaiho, chosen mainly because it had komi (but only 5.5. - GSG never used 6.5) but also because it was a significant game (Meijin; 1963-11-18). I looked only at the first 100 moves, i.e. 50 for each player.
Go had 37 of his 50 moves in LZ's top three; Rin had 34. There were no huge mistakes. Go won after 192 moves.
But that close parity masked some trends. Go was clearly more likely than Rin to choose better moves out of the three, because his winning ratio gradually climbed. Starting at 54%, he was at 64% by move 30 and by move 100 was at 84%.
The most fascinating thing for me was that quite often Go's move did not appear at all in LZ's first sweep of the board. But as time progressed his move did appear, and also typically move up to a high score. This phenomenon occurred just once for Rin. I tentatively infer from this that Go was seeing things at a deeper level. At any rate, his performance impressed me.
A further oddity was that on one occasion, Go's move did not appear at all in LZ's many candidates, even when I let it run a bit longer than usual, but once his actual move was played his winning ratio increased (I assume this means LZ approved). On another similar occasion Go's move was scored equal by LZ.
In addition, even when Go's move did not appear in the top three, he was almost always in the top four or five, and also, when his actual move was played, his winning ratio did not fall huge (max. about 4%). On a couple of occasions it instantly showed a big dip (10%) but as LZ searched more it re-adjusted that to 4% or less. Again a sign of Go seeing deeper?
I forgot to make a record but I think there were only two other occasions apart from the one above when Go's move did not appear at all. For Rin there were between 5 and 10.
The only thing this actually proved was that it is quite possible to cheat with LZ in a server game (not that I believed otherwise beforehand) even with fastish time limits, but there was quite a bit more that was suggestive. For example, if you want to play like Rin Kaiho, take LZ's early suggestions. If you want to play like GSG, let it run a bit longer.
Has anyone playing on the servers had a strong feeling yet that they are really playing Leela?
and 
(10% and 15% loss)
: Not on LZ radar, and she dislike this move ( -7% and still dropping)
: Not on LZ radar, and she dislike this move ( -4.2% but dislike it less with more playouts)
: Barely explored, and she think it's fine ( -0.2% so in the margin of error) 
: Not on LZ radar, and she's not a fan ( -2.2% )
: LZ 4th choice (with 20k+ playouts), but she like it more after being played with +1.8% 
: Barely explored, and she dislike this move (-6.5% )