Is not defending them effective against programs?

For discussing go computing, software announcements, etc.
Post Reply
betgo
Beginner
Posts: 14
Joined: Tue May 28, 2019 1:18 pm
Rank: AGA 1 kyu
GD Posts: 0

Is not defending them effective against programs?

Post by betgo »

I have found that programs get confused when you do things like making approach moves and not responding to the programs reply in the corner, or putting in stone in the middle of the programs extension and then ignoring its reply. Also, sacrificing small numbers of stones seems to work.

The programs seem to get confused by stones they are not sure are live or not.

Are there weaknesses of programs? Do they still work against the versions that are beating professionals?
Bill Spight
Honinbo
Posts: 10905
Joined: Wed Apr 21, 2010 1:24 pm
Has thanked: 3651 times
Been thanked: 3373 times

Re: Is not defending them effective against programs?

Post by Bill Spight »

betgo wrote:I have found that programs get confused when you do things like making approach moves and not responding to the programs reply in the corner, or putting in stone in the middle of the programs extension and then ignoring its reply. Also, sacrificing small numbers of stones seems to work.

The programs seem to get confused by stones they are not sure are live or not.

Are there weaknesses of programs? Do they still work against the versions that are beating professionals?
Yes, programs have weaknesses. See Beat Elf viewtopic.php?f=15&t=16641 . Elf is one of today's top programs that beats pros.

However, the weaknesses you mention are unlikely to confuse today's top programs. In their training they have played against opponents that do those things. That is, against weak versions of themselves. :)

As for local life and death situations, even top bots can err, because they read the whole board. Given enough time they can solve all local life and death situations, but, depending on other options on the board that they explore, in any sufficiently complicated or unusual case they can err. There are also whole board positions where they will leave a local position undecided, because they deem it more important to play elsewhere. That doe not mean that they have made a mistake. :)

If you are running into all of these weaknesses, you have a program that is weak, given the conditions that Uberdude has mentioned.
The Adkins Principle:
At some point, doesn't thinking have to go on?
— Winona Adkins

Visualize whirled peas.

Everything with love. Stay safe.
User avatar
jlt
Gosei
Posts: 1786
Joined: Wed Dec 14, 2016 3:59 am
GD Posts: 0
Has thanked: 185 times
Been thanked: 495 times

Re: Is not defending them effective against programs?

Post by jlt »

With which bots did you observe these weaknesses? Even games or handicap games? How many stones handicap, and how many playouts per move?
Aram
Dies in gote
Posts: 53
Joined: Tue Jun 14, 2016 9:46 am
Rank: KGS 2k
GD Posts: 0
Has thanked: 3 times
Been thanked: 33 times

Re: Is not defending them effective against programs?

Post by Aram »

Bots can have weaknesses yes, but its important to also know in what kind of environment the weaknesses appear.

In a lost game, or high handicap game, the bot might just ignore and/or play random moves if it feels that there is no way to win.

For example, if the bot is loosing by 20 points, it might suicide its own group, making it loose by even more. This is because suiciding and counting are both just as sure losses in the eyes of the bot.
betgo
Beginner
Posts: 14
Joined: Tue May 28, 2019 1:18 pm
Rank: AGA 1 kyu
GD Posts: 0

Re: Is not defending them effective against programs?

Post by betgo »

jlt wrote:With which bots did you observe these weaknesses? Even games or handicap games? How many stones handicap, and how many playouts per move?
Not on the really strong configurations. Against regular leela and leelaz on my laptop at like 500 playouts/move at a 4 stone handicap. I would assume the programs / configurations beating top pros don't make obvious mistakes like that. However, I was wondering if plays like that might still give an advantage in causing the program to pay suboptimally. What I noticed was not usually blatant mistakes but that it would not play as well if it was confused about whether stones were live.

Regular leela has weaknesses like not understanding seki, and thinking it has territory.
Uberdude
Judan
Posts: 6727
Joined: Thu Nov 24, 2011 11:35 am
Rank: UK 4 dan
GD Posts: 0
KGS: Uberdude 4d
OGS: Uberdude 7d
Location: Cambridge, UK
Has thanked: 436 times
Been thanked: 3718 times

Re: Is not defending them effective against programs?

Post by Uberdude »

I think the biggest weakness of Leela Zero wasn't mentioned: ladders, particularly at low playouts and the older networks.
Bill Spight
Honinbo
Posts: 10905
Joined: Wed Apr 21, 2010 1:24 pm
Has thanked: 3651 times
Been thanked: 3373 times

Re: Is not defending them effective against programs?

Post by Bill Spight »

betgo wrote:However, I was wondering if plays like that might still give an advantage in causing the program to pay suboptimally. What I noticed was not usually blatant mistakes but that it would not play as well if it was confused about whether stones were live.
Is your purpose to beat the program or to learn from it?
The Adkins Principle:
At some point, doesn't thinking have to go on?
— Winona Adkins

Visualize whirled peas.

Everything with love. Stay safe.
Aram
Dies in gote
Posts: 53
Joined: Tue Jun 14, 2016 9:46 am
Rank: KGS 2k
GD Posts: 0
Has thanked: 3 times
Been thanked: 33 times

Re: Is not defending them effective against programs?

Post by Aram »

betgo wrote:
jlt wrote:With which bots did you observe these weaknesses? Even games or handicap games? How many stones handicap, and how many playouts per move?
Not on the really strong configurations. Against regular leela and leelaz on my laptop at like 500 playouts/move at a 4 stone handicap. I would assume the programs / configurations beating top pros don't make obvious mistakes like that. However, I was wondering if plays like that might still give an advantage in causing the program to pay suboptimally. What I noticed was not usually blatant mistakes but that it would not play as well if it was confused about whether stones were live.

Regular leela has weaknesses like not understanding seki, and thinking it has territory.

You should not make any assumptions on strengths or weaknesses when running at 4 handicap stones, the program simply is not designed to play at such handicap.
Also remember that the program is using Tromp-Taylor rules (similar to Chinese), not Japanese.

Handicap play is something that some other programs are currently trying to solve, but i do not think its currently easy to download any of them.
Bill Spight
Honinbo
Posts: 10905
Joined: Wed Apr 21, 2010 1:24 pm
Has thanked: 3651 times
Been thanked: 3373 times

Re: Is not defending them effective against programs?

Post by Bill Spight »

You may enjoy taking handicap stones from Deep Leela at https://www.deepleela.com . It is Leela 11, which is weaker than Leela Zero, but was trained on human play, so it plays handicap games in a more human manner. :)
The Adkins Principle:
At some point, doesn't thinking have to go on?
— Winona Adkins

Visualize whirled peas.

Everything with love. Stay safe.
betgo
Beginner
Posts: 14
Joined: Tue May 28, 2019 1:18 pm
Rank: AGA 1 kyu
GD Posts: 0

Re: Is not defending them effective against programs?

Post by betgo »

Bill Spight wrote:You may enjoy taking handicap stones from Deep Leela at https://www.deepleela.com . It is Leela 11, which is weaker than Leela Zero, but was trained on human play, so it plays handicap games in a more human manner. :)
Is there a way to configure deepleela not to show suggested moves for its opponent?

I would think the handicap issue would be important as a lot of people would like to play / train against a strong program, but not that many are 4D+ Japanese / US scale.
Bill Spight
Honinbo
Posts: 10905
Joined: Wed Apr 21, 2010 1:24 pm
Has thanked: 3651 times
Been thanked: 3373 times

Re: Is not defending them effective against programs?

Post by Bill Spight »

betgo wrote:
Bill Spight wrote:You may enjoy taking handicap stones from Deep Leela at https://www.deepleela.com . It is Leela 11, which is weaker than Leela Zero, but was trained on human play, so it plays handicap games in a more human manner. :)
Is there a way to configure deepleela not to show suggested moves for its opponent?
I don't know. Maybe someone here does, or you could ask.
I would think the handicap issue would be important as a lot of people would like to play / train against a strong program, but not that many are 4D+ Japanese / US scale.
Me, too.
The Adkins Principle:
At some point, doesn't thinking have to go on?
— Winona Adkins

Visualize whirled peas.

Everything with love. Stay safe.
sorin
Lives in gote
Posts: 389
Joined: Wed Apr 21, 2010 9:14 pm
Has thanked: 418 times
Been thanked: 198 times

Re: Is not defending them effective against programs?

Post by sorin »

betgo wrote:I have found that programs get confused when you do things like making approach moves and not responding to the programs reply in the corner, or putting in stone in the middle of the programs extension and then ignoring its reply.
How does the programs confusion manifest itself?
Gomoto
Gosei
Posts: 1733
Joined: Sun Nov 06, 2016 6:56 am
GD Posts: 0
Location: Earth
Has thanked: 621 times
Been thanked: 310 times

Re: Is not defending them effective against programs?

Post by Gomoto »

No not defending is not effective against programs.

Effective in your sense is playing them on obsolete hardware.

It is like binding the legs of a world class runner and then cheer because you are walking faster than the athlete.

You can not make rational conclusions if you set unrational constraints.
Post Reply