One possible response to plateaus and blind spots is to increase the search during self play games. I had that possibility in mind when I said that correct play could be found in infinite time.
Elf teaches us how to play the black hole vs LeelaZero
-
Bill Spight
- Honinbo
- Posts: 10905
- Joined: Wed Apr 21, 2010 1:24 pm
- Has thanked: 3651 times
- Been thanked: 3373 times
Re: Elf teaches us how to play the black hole vs LeelaZero
Improvement through self play requires a different kind of search from game tree search, a search which explores variations of the self. I pointed out the possibility of self reinforcing blind spots long ago. In fact, I suggested the possibility that AlphaZero Chess reached a self play plateau that could not beat a version of Stockfish which used an opening book and endgame table base. I am unaware of anybody else suggesting that.
One possible response to plateaus and blind spots is to increase the search during self play games. I had that possibility in mind when I said that correct play could be found in infinite time.
(Not that I would take that approach to overcoming the currently identified blind spots.
)
One possible response to plateaus and blind spots is to increase the search during self play games. I had that possibility in mind when I said that correct play could be found in infinite time.
The Adkins Principle:
At some point, doesn't thinking have to go on?
— Winona Adkins
Visualize whirled peas.
Everything with love. Stay safe.
At some point, doesn't thinking have to go on?
— Winona Adkins
Visualize whirled peas.
Everything with love. Stay safe.
-
dfan
- Gosei
- Posts: 1598
- Joined: Wed Apr 21, 2010 8:49 am
- Rank: AGA 2k Fox 3d
- GD Posts: 61
- KGS: dfan
- Has thanked: 891 times
- Been thanked: 534 times
- Contact:
Re: Elf teaches us how to play the black hole vs LeelaZero
People used to be pretty worried about self-play plateaus until AlphaGo Zero came along and slaughtered all the top pros.Bill Spight wrote:I pointed out the possibility of self reinforcing blind spots long ago. In fact, I suggested the possibility that AlphaZero Chess reached a self play plateau that could not beat a version of Stockfish which used an opening book and endgame table base. I am unaware of anybody else suggesting that.
-
Bill Spight
- Honinbo
- Posts: 10905
- Joined: Wed Apr 21, 2010 1:24 pm
- Has thanked: 3651 times
- Been thanked: 3373 times
Re: Elf teaches us how to play the black hole vs LeelaZero
Well, if your goal is just to beat all humans, what's the problem?dfan wrote:People used to be pretty worried about self-play plateaus until AlphaGo Zero came along and slaughtered all the top pros.Bill Spight wrote:I pointed out the possibility of self reinforcing blind spots long ago. In fact, I suggested the possibility that AlphaZero Chess reached a self play plateau that could not beat a version of Stockfish which used an opening book and endgame table base. I am unaware of anybody else suggesting that.But they may have been too quick to stop being concerned about it.
The Adkins Principle:
At some point, doesn't thinking have to go on?
— Winona Adkins
Visualize whirled peas.
Everything with love. Stay safe.
At some point, doesn't thinking have to go on?
— Winona Adkins
Visualize whirled peas.
Everything with love. Stay safe.