It is currently Thu Mar 28, 2024 12:56 am

All times are UTC - 8 hours [ DST ]




Post new topic Reply to topic  [ 28 posts ]  Go to page 1, 2  Next
Author Message
Offline
 Post subject: AI vs Dummies - Dummies win?
Post #1 Posted: Mon Feb 04, 2019 6:25 am 
Oza

Posts: 3647
Liked others: 20
Was liked: 4626
I have long been suspicious that the AI bots can teach us anything. They can certainly beat us, and they can certainly stimulate us into our own research. But can they teach us anything?

I ran LeelaZero for some time on the following position.



LZ stuck to move A for Black as the best move even though there can be no possible justification for this, even with billions of teragurgles of extra computing power. Yet the problem is trivial for humans.

Even if another bot or another version of LZ came up with the right answer, they presumably "think" the same way as my LZ, and I'm guessing that the right answer would then be more a question of luck or randomisation in how the search starts.

It therefore seems that were the current AI bots to learn to speak that they will still not be able to explain even trivial moves like this, and a fortiori they could never explain complex concepts like thickness. All they can ever say is, in effect, "this is the best move in this particular position."

Is this right?


This post by John Fairbairn was liked by: sorin
Top
 Profile  
 
Offline
 Post subject: Re: AI vs Dummies - Dummies win?
Post #2 Posted: Mon Feb 04, 2019 6:31 am 
Gosei
User avatar

Posts: 1753
Liked others: 177
Was liked: 491
LZ didn't care about ko threats, as there is no ko fight on the board.


This post by jlt was liked by 2 people: Bill Spight, Knotwilg
Top
 Profile  
 
Offline
 Post subject: Re: AI vs Dummies - Dummies win?
Post #3 Posted: Mon Feb 04, 2019 6:41 am 
Judan

Posts: 6725
Location: Cambridge, UK
Liked others: 436
Was liked: 3719
Rank: UK 4 dan
KGS: Uberdude 4d
OGS: Uberdude 7d
John Fairbairn wrote:
I have long been suspicious that the AI bots can teach us anything. They can certainly beat us, and they can certainly stimulate us into our own research. But can they teach us anything?

I have learnt that approaching a 3-4 is more important than answering an approach to a 4-4.

As for the problem, indeed bots can't perform the abstract logically reasoning that allows us to quickly solve this problem 'correctly'. I actually put corrrectly in quotes, because now I just realised the traditional correct answer is not unconditionally better than the wrong answer. The standard rationale is it only leaves 1 instead of 2 ko threats. However, the wrong answer has the benefit that it you ignore white's ko threat then black's remaining dead stones have 2 liberties instead of 1. It would be pretty unlikely that this would matter in a game, but it is possible for the benefit to become manifest if a ladder or semeai ended up smashing into the surrounding white walls.

I also wonder what whole board position John used, if you made a realistic game position in which living here was the correct idea maybe LZ would find the better answer.

Top
 Profile  
 
Offline
 Post subject: Re: AI vs Dummies - Dummies win?
Post #4 Posted: Mon Feb 04, 2019 8:00 am 
Dies with sente

Posts: 101
Liked others: 2
Was liked: 16
Rank: KGS 2 D
Regarding the title, it's far from win by answering this local problem correctly.

Top
 Profile  
 
Offline
 Post subject: Re: AI vs Dummies - Dummies win?
Post #5 Posted: Mon Feb 04, 2019 9:54 am 
Judan

Posts: 6725
Location: Cambridge, UK
Liked others: 436
Was liked: 3719
Rank: UK 4 dan
KGS: Uberdude 4d
OGS: Uberdude 7d
Quick try with LZ 201, slightly prefers correct answer.

Attachment:
Screen Shot 2019-02-04 at 16.53.07.png
Screen Shot 2019-02-04 at 16.53.07.png [ 1.06 MiB | Viewed 10222 times ]


This post by Uberdude was liked by: Knotwilg
Top
 Profile  
 
Offline
 Post subject: Re: AI vs Dummies - Dummies win?
Post #6 Posted: Mon Feb 04, 2019 10:06 am 
Oza
User avatar

Posts: 2408
Location: Ghent, Belgium
Liked others: 359
Was liked: 1019
Rank: KGS 2d OGS 1d Fox 4d
KGS: Artevelde
OGS: Knotwilg
Online playing schedule: UTC 18:00 - 22:00
John Fairbairn wrote:
they could never explain complex concepts like thickness.



I'm pretty sure that even if they could, they would be told "no, that's not it". :)

More to the point, bots speak a language that is probably much closer to the language of professionals than the language of Go scholars, even if one person hosts a pro and a scholar. They both "see sequences" as I have argued in another thread. Because amateurs don't see the same sequences, scholars have abbreviated and generalized the professional sequences into heuristics.

People like Uberdude have already conveyed modern (AI/bot) opening theory to this crowd. If you've been using LZ for some time in game analysis, its sequences have sufficiently spoken for you to articulate its "thinking" into words. I don't know how much programming that would take but I'm not sure talking a conceptual teaching language would be that much harder to achieve than playing at professional level.


This post by Knotwilg was liked by 2 people: dfan, Gomoto
Top
 Profile  
 
Offline
 Post subject: Re: AI vs Dummies - Dummies win?
Post #7 Posted: Mon Feb 04, 2019 10:32 am 
Honinbo

Posts: 10905
Liked others: 3651
Was liked: 3374
Uberdude wrote:
I also wonder what whole board position John used, if you made a realistic game position in which living here was the correct idea maybe LZ would find the better answer.


Yes. Why wasn't tenuki correct? That's my choice on an otherwise empty board.

_________________
The Adkins Principle:
At some point, doesn't thinking have to go on?
— Winona Adkins

Visualize whirled peas.

Everything with love. Stay safe.

Top
 Profile  
 
Offline
 Post subject: Re: AI vs Dummies - Dummies win?
Post #8 Posted: Mon Feb 04, 2019 10:53 am 
Honinbo

Posts: 10905
Liked others: 3651
Was liked: 3374
Knotwilg wrote:
John Fairbairn wrote:
they could never explain complex concepts like thickness.



I'm pretty sure that even if they could, they would be told "no, that's not it". :)


;)

Neural net go bots are, perforce, global thinkers. :) Something that humans are encouraged to be. Despite the fact that the top bots are better than humans, humans sometimes are better with regard to local positions. Given their weakness at local thinking, the fact that the top bots are better than humans mean that they are much better than we are at global thinking.

Thickness, in the sense of outside strength, is a global concept. One of my first thoughts when viewing AlphaGo's games was, "There goes thickness." While many of AlphaGo's global plays were reminiscent of Go Seigen's, it was plain (to me) that its understanding of center oriented play went far beyond any current human concepts.

Humans are quite smart, and I believe that we will come up with new and better concepts or modify our current concepts. Thickness as we know it is yesterday's news.

_________________
The Adkins Principle:
At some point, doesn't thinking have to go on?
— Winona Adkins

Visualize whirled peas.

Everything with love. Stay safe.

Top
 Profile  
 
Offline
 Post subject: Re: AI vs Dummies - Dummies win?
Post #9 Posted: Mon Feb 04, 2019 11:20 am 
Oza
User avatar

Posts: 2408
Location: Ghent, Belgium
Liked others: 359
Was liked: 1019
Rank: KGS 2d OGS 1d Fox 4d
KGS: Artevelde
OGS: Knotwilg
Online playing schedule: UTC 18:00 - 22:00
Quote:
Thickness as we know it is yesterday's news.


Even if John may not agree with my definitions of thickness, it was him who made me understand the difference between local thickness (atsumi) and global thickness (atsuza). I'm forever grateful for that post.

What you saw disappear is global thickness, the value we presumed in being globally with less defects than the opponent, and influential stones working well together, whether or not to form a potential huge central territory, Takemiya-style.

I don't think the value of local thickness is gone to the same extent. The fact that White prefers crawling on the second line in the basic variation of the 3-3 invasion, rather than hane-connect, is very likely due to the opponent's tiger mouth giving local thickness to the wall resulting from that invasion. By crawling, the invader lives and the invaded gets outward influence, not thickness.

If you do this multiple times, you get global thickness, but the bots would still invade.

This is my proof :)

Top
 Profile  
 
Offline
 Post subject: Re: AI vs Dummies - Dummies win?
Post #10 Posted: Mon Feb 04, 2019 9:29 pm 
Lives in gote

Posts: 388
Liked others: 416
Was liked: 198
John Fairbairn wrote:
I have long been suspicious that the AI bots can teach us anything. They can certainly beat us, and they can certainly stimulate us into our own research. But can they teach us anything?

If they beat us and we don't learn anything from it, it's our fault, not theirs. Fortunately, most people learn from being beaten.

John Fairbairn wrote:
I ran LeelaZero for some time on the following position.



LZ stuck to move A for Black as the best move even though there can be no possible justification for this, even with billions of teragurgles of extra computing power. Yet the problem is trivial for humans.

I guess I am as bad as an AI, since A was the only answer I could think of!
It was only after reading other posts when I realized that you are talking between A and another way to defend that leaves one less ko-threat...

_________________
Sorin - 361points.com

Top
 Profile  
 
Offline
 Post subject: Re: AI vs Dummies - Dummies win?
Post #11 Posted: Tue Feb 05, 2019 12:19 am 
Oza
User avatar

Posts: 2408
Location: Ghent, Belgium
Liked others: 359
Was liked: 1019
Rank: KGS 2d OGS 1d Fox 4d
KGS: Artevelde
OGS: Knotwilg
Online playing schedule: UTC 18:00 - 22:00
Maybe we should ADD a topic “what’s trivizl?”

Top
 Profile  
 
Offline
 Post subject: Re: AI vs Dummies - Dummies win?
Post #12 Posted: Tue Feb 05, 2019 8:07 am 
Lives with ko

Posts: 125
Liked others: 124
Was liked: 42
Bill Spight wrote:
Why wasn't tenuki correct? That's my choice on an otherwise empty board.
My understanding is even worse, as I am still confused by Bill's choice. If Black plays elsewhere, away from the group, doesn't this allow White to kill the group by playing a white stone at A?

_________________
And the go-fever which is more real than many doctors’ diseases, waked and raged...
- Rudyard Kipling, "The Light That Failed" (1891)

Top
 Profile  
 
Offline
 Post subject: Re: AI vs Dummies - Dummies win?
Post #13 Posted: Tue Feb 05, 2019 8:15 am 
Gosei
User avatar

Posts: 1753
Liked others: 177
Was liked: 491
Playing locally is 24 points gote. At the opening stage, it is possible that some tenuki moves are worth more than that.

Top
 Profile  
 
Offline
 Post subject: Re: AI vs Dummies - Dummies win?
Post #14 Posted: Tue Feb 05, 2019 8:32 am 
Lives with ko

Posts: 125
Liked others: 124
Was liked: 42
Okay, I think I can see that possibility. White currently has a small wall facing the empty part of the board, which could help him extend his control of that area. Black, on the other hand, has nothing out there. So perhaps Black should get some stones out there soon, as otherwise White could dominate that empty area? Or maybe I'm still missing something.

_________________
And the go-fever which is more real than many doctors’ diseases, waked and raged...
- Rudyard Kipling, "The Light That Failed" (1891)

Top
 Profile  
 
Offline
 Post subject: Re: AI vs Dummies - Dummies win?
Post #15 Posted: Tue Feb 05, 2019 9:33 am 
Honinbo

Posts: 10905
Liked others: 3651
Was liked: 3374
jlt wrote:
Playing locally is 24 points gote. At the opening stage, it is possible that some tenuki moves are worth more than that.


By swing counting, the first move on an empty board is worth approximately 28 pts.

_________________
The Adkins Principle:
At some point, doesn't thinking have to go on?
— Winona Adkins

Visualize whirled peas.

Everything with love. Stay safe.

Top
 Profile  
 
Offline
 Post subject: Re: AI vs Dummies - Dummies win?
Post #16 Posted: Tue Feb 05, 2019 10:33 am 
Lives in gote

Posts: 603
Location: Indiana
Liked others: 114
Was liked: 176
Bill Spight wrote:
jlt wrote:
Playing locally is 24 points gote. At the opening stage, it is possible that some tenuki moves are worth more than that.


By swing counting, the first move on an empty board is worth approximately 28 pts.


Except the first move isn't worth a 28-point komi. ;-)

Top
 Profile  
 
Offline
 Post subject: Re: AI vs Dummies - Dummies win?
Post #17 Posted: Tue Feb 05, 2019 10:37 am 
Gosei
User avatar

Posts: 1753
Liked others: 177
Was liked: 491
Here is a totally artificial board position where LZ157 thinks that tenuki is better.

Attachment:
Capture.JPG
Capture.JPG [ 93.76 KiB | Viewed 9947 times ]

Top
 Profile  
 
Offline
 Post subject: Re: AI vs Dummies - Dummies win?
Post #18 Posted: Tue Feb 05, 2019 10:51 am 
Gosei
User avatar

Posts: 1753
Liked others: 177
Was liked: 491
Aidoneus wrote:
Except the first move isn't worth a 28-point komi. ;-)


Probably Bill has a better better explanation but here is how I interpret this value of 28 points. Suppose perfect komi is 7.

Consider a simplified model where move 1 is a points, move 2 is a-h points, move 3 is a-2h points,... until move 2n which is a-(2n-1)h points.
There is no extra move available, so a=2nh. The difference of points between Black and White is nh, so nh=7 and a=14.

Swing counting consists in adding points by Black if Black makes one move, and points by White if White makes one move, so we get a+a=28 points.

Top
 Profile  
 
Offline
 Post subject: Re: AI vs Dummies - Dummies win?
Post #19 Posted: Tue Feb 05, 2019 10:57 am 
Lives in gote

Posts: 603
Location: Indiana
Liked others: 114
Was liked: 176
Sure, I did understand that we are looking at an alternating sequence, which is why I don't believe tenuki would be worthwhile on an EMPTY board. But I guess my wink was wasted, yes?

Top
 Profile  
 
Offline
 Post subject: Re: AI vs Dummies - Dummies win?
Post #20 Posted: Tue Feb 05, 2019 11:10 am 
Gosei
User avatar

Posts: 1753
Liked others: 177
Was liked: 491
Your last message seems to imply that you disagree with Bill, but you don't really explain why.

Top
 Profile  
 
Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 28 posts ]  Go to page 1, 2  Next

All times are UTC - 8 hours [ DST ]


Who is online

Users browsing this forum: No registered users and 1 guest


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Search for:
Jump to:  
Powered by phpBB © 2000, 2002, 2005, 2007 phpBB Group