AlphaZero paper discussion (Mastering Go, Chess, and Shogi)

For discussing go computing, software announcements, etc.
Mike Novack
Lives in sente
Posts: 1045
Joined: Mon Aug 09, 2010 9:36 am
GD Posts: 0
Been thanked: 182 times

Re: Re:

Post by Mike Novack »

djhbrown wrote:
[i]The Economist[/i]: $ in AI wrote:...The most important is whether AI will always depend on vast amounts of data... A competing vision of AI stresses simulations, in which machines teach themselves using synthetic data or in virtual environments........... [so she must be really intelligent and will take over the outside real world without needing any real-world data as well as triumphing over the inside world of a board game of limited depth].

Propaganda Works - You Know This
Except I think this is an example of economists not understanding other areas of science and mathematics. A misunderstanding thinking that "learn from zero" means having learned from NO data from the "real" world (in this case the limited definition of the game go). Other information about the real world, vast amounts of information, is indeed irrelevant to learning how to solve THIS problem << learn to play go very well >>

Yes, it turns out that the set of information needed (by alpaha go zero) turns out to be small, but in problems like this, discovering the minimalist set, the necessary and sufficient set, is one of the difficulties. The reason I said "blindness" on the part of the economists is that they don't relate this to THEIR problem. They imagine that they NEED vast amounts of information about the real world (to make their predictions) without seeing that the reason for that is that they don't know which bits of information from the real world are relevant and which are not. And that appearances can be deceptive.

Thus before being shown, we would have thought that alpha go zero would have needed more information << information we cannot see is redundant to the minimal set of information that is sufficient >>

They also do not see what the (generalized) process might be able to do. Given a problem and a PROPOSED minimalist set of information, can the neural net learn to solve the problem "from zero" --- with "from zero" meaning "from just THIS minimalist set of information". In which case that set of information IS a sufficient set.
Uberdude
Judan
Posts: 6727
Joined: Thu Nov 24, 2011 11:35 am
Rank: UK 4 dan
GD Posts: 0
KGS: Uberdude 4d
OGS: Uberdude 7d
Location: Cambridge, UK
Has thanked: 436 times
Been thanked: 3718 times

Re: AlphaZero paper discussion (Mastering Go, Chess, and Sho

Post by Uberdude »

Mike Novack wrote:Except I think this is an example of economists not understanding other areas of science and mathematics.
The Economist is a general newspaper (in magazine format), it's not actually written solely or indeed much by economists. (Or were you joking?)
User avatar
EdLee
Honinbo
Posts: 8859
Joined: Sat Apr 24, 2010 6:49 pm
GD Posts: 312
Location: Santa Barbara, CA
Has thanked: 349 times
Been thanked: 2070 times

Post by EdLee »

Quartz: AI complexity ( sorry about the ads )
In school we ask students to put it in their own words to prove that they’ve understood something, to show their work, justify their conclusion. <snip> And now we’re expecting that machines will be able to do the same thing.
(emphasis added)
When entity A (eg. student) tries to explain something to entity B (eg. teacher; or vice versa), the above makes an implicit but vital assumption that an explanation exists that B can digest.

This assumption may be true if A's understanding and computational power are roughly similar to B's, or even if A's (slightly) > B's.

But if A's >> B's, it's not so clear why it must be true.

Samples:
A: Einstein (at the publication of his relativity papers ); B: top physicists, general public (at that time; even today).
A: Feynman (on quantum mechanics); B: his dad, general public.
A: average child; B: cat.
A: AlphaZero; B: top pros.
Sneegurd
Lives with ko
Posts: 129
Joined: Fri Mar 23, 2012 8:57 am
GD Posts: 0
Has thanked: 20 times
Been thanked: 17 times

Re: AlphaZero paper discussion (Mastering Go, Chess, and Sho

Post by Sneegurd »

pookpooi wrote:Criticism from Computer Shogi community (in English) http://www.uuunuuun.com/single-post/201 ... ogi-engine
Concerns, yes, but not surprising, Deepmind probably did not find decent information on what is state of the art in Computer Shogi. As one cannot find decent software simply. You fight your way through Google translated japanese pages and end up finding GUIs appealing as software from the 90s. E.g., in Shogi, best I found the other day was ShogiGUI, which, by chess software standards, was still clunky retro style software. And you find like 3 people commenting on it on the internet. And first you do is tell it to install in english - and still get a japanese UI. So first thing to do is find the option o change language. Which is not an easy task.
Or Shogidokoro. Oh well, also like software from 1990. IMO Shogi software development is lightyears behind western chess. Go only lightmonths ;)
Bill Spight
Honinbo
Posts: 10905
Joined: Wed Apr 21, 2010 1:24 pm
Has thanked: 3651 times
Been thanked: 3373 times

Re:

Post by Bill Spight »

EdLee wrote:Quartz: AI complexity ( sorry about the ads )
In school we ask students to put it in their own words to prove that they’ve understood something, to show their work, justify their conclusion. <snip> And now we’re expecting that machines will be able to do the same thing.
(emphasis added)
I'm sorry, Dave.
The Adkins Principle:
At some point, doesn't thinking have to go on?
— Winona Adkins

Visualize whirled peas.

Everything with love. Stay safe.
User avatar
EdLee
Honinbo
Posts: 8859
Joined: Sat Apr 24, 2010 6:49 pm
GD Posts: 312
Location: Santa Barbara, CA
Has thanked: 349 times
Been thanked: 2070 times

Post by EdLee »

I'm sorry, Dave.
Off topic:
CSM-101, HAL 2000, Frankenstein, ... the idea of a human created monster in literature or oral traditions goes back how far, and in which cultures ?
Bill Spight
Honinbo
Posts: 10905
Joined: Wed Apr 21, 2010 1:24 pm
Has thanked: 3651 times
Been thanked: 3373 times

Re:

Post by Bill Spight »

EdLee wrote:
I'm sorry, Dave.
Off topic:
CSM-101, HAL 2000, Frankenstein, ... the idea of a human created monster in literature or oral traditions goes back how far, and in which cultures ?
Alpha Golem? ;)
The Adkins Principle:
At some point, doesn't thinking have to go on?
— Winona Adkins

Visualize whirled peas.

Everything with love. Stay safe.
Post Reply