It is currently Thu Mar 28, 2024 7:57 am

All times are UTC - 8 hours [ DST ]




Post new topic Reply to topic  [ 10 posts ] 
Author Message
Offline
 Post subject: AI’s Language Problem
Post #1 Posted: Tue May 09, 2017 6:21 pm 
Oza
User avatar

Posts: 2221
Location: Germany
Liked others: 8262
Was liked: 924
Rank: OGS 9k
OGS: trohde
Universal go server handle: trohde
MIT Technology Review > Intelligent Machines > AI’s Language Problem

It’s not only about language, and it’s not off-topic (at least not totally), lots of references to AlphaGo, etc.

_________________
“The only difference between me and a madman is that I’m not mad.” — Salvador Dali ★ Play a slooooow correspondence game with me on OGS? :)


This post by Bonobo was liked by 3 people: gowan, nasdaq, schwartzseer
Top
 Profile  
 
Offline
 Post subject: Re: AI’s Language Problem
Post #2 Posted: Tue May 09, 2017 6:37 pm 
Dies in gote

Posts: 63
Liked others: 12
Was liked: 11
From the same source is a review of the AlphaGo movie: https://www.technologyreview.com/s/604273/finding-solace-in-defeat-by-artificial-intelligence/

Top
 Profile  
 
Offline
 Post subject: Re: AI’s Language Problem
Post #3 Posted: Wed May 10, 2017 12:51 am 
Dies in gote

Posts: 53
Liked others: 3
Was liked: 9
Rank: 1k
It was a good read, thanks for sharing.

Top
 Profile  
 
Offline
 Post subject: Re: AI’s Language Problem
Post #4 Posted: Wed May 10, 2017 6:20 am 
Gosei

Posts: 1625
Liked others: 542
Was liked: 450
Rank: senior player
GD Posts: 1000
Bonobo wrote:
MIT Technology Review > Intelligent Machines > AI’s Language Problem

It’s not only about language, and it’s not off-topic (at least not totally), lots of references to AlphaGo, etc.


AlphaGo learned to play go at a very high level by taking in a large number of human-played games Why couldn't a program learn human language the same way? Humans don't learn language by learning and applying rules. The explicit grammatical rules come after the user is fluent in the language. People use grammatical rules to learn as adults but rules alone do not lead to fluent speaking. Most people do not use grammatical rules to judge whether an utterance is acceptable or not; if it "sounds" right it is acceptable. Humans learn their first language(s) by hearing people speak then trying themselves and being corrected. Sounds a lot like how AlphaGo learned. No human is perfect at any human language. There are always unfamiliar words and even unfamiliar syntactic patterns. I wonder whether an AI could learn a language by "reading" thousands of books and "listening" to years(?) of speech via TV.

Top
 Profile  
 
Offline
 Post subject: Re: AI’s Language Problem
Post #5 Posted: Wed May 10, 2017 8:21 am 
Honinbo

Posts: 10905
Liked others: 3651
Was liked: 3374
Actually, humans do learn language rules on the path to fluency. A classic example has to do with irregular verbs in English. For instance, the verb, go has the past tense, went. Children first learn went, presumably by imitation, but later go through a phase where they say goed, forming the past tense the standard rule. Later still they go back to saying went. :)

_________________
The Adkins Principle:
At some point, doesn't thinking have to go on?
— Winona Adkins

Visualize whirled peas.

Everything with love. Stay safe.

Top
 Profile  
 
Offline
 Post subject: Re: AI’s Language Problem
Post #6 Posted: Wed May 10, 2017 8:44 pm 
Gosei

Posts: 1625
Liked others: 542
Was liked: 450
Rank: senior player
GD Posts: 1000
Bill Spight wrote:
Actually, humans do learn language rules on the path to fluency. A classic example has to do with irregular verbs in English. For instance, the verb, go has the past tense, went. Children first learn went, presumably by imitation, but later go through a phase where they say goed, forming the past tense the standard rule. Later still they go back to saying went. :)


This example of children's learning language is somewhat supporting my thesis that an important part, maybe the most important part, of language learning is through imitation with correction. The imitation most easily comes through interaction with fluent speakers but might also come from books. Certainly many of us acquire much of our vocabulary from reading. Even as adults we sometimes misuse a word we have read but not heard spoken.

Top
 Profile  
 
Offline
 Post subject: Re: AI’s Language Problem
Post #7 Posted: Wed May 10, 2017 11:07 pm 
Lives in gote
User avatar

Posts: 392
Liked others: 23
Was liked: 43
Rank: NR
interesting that the MIT article doesn't mention the most insightful work on AI of language being done at MIT, that of Pat Winston, its former director. Follow the money.

_________________
i shrink, therefore i swarm

Top
 Profile  
 
Offline
 Post subject: Re: AI’s Language Problem
Post #8 Posted: Thu May 11, 2017 1:05 am 
Oza

Posts: 3647
Liked others: 20
Was liked: 4626
Quote:
This example of children's learning language is somewhat supporting my thesis that an important part, maybe the most important part, of language learning is through imitation with correction. The imitation most easily comes through interaction with fluent speakers but might also come from books. Certainly many of us acquire much of our vocabulary from reading. Even as adults we sometimes misuse a word we have read but not heard spoken.


I agree with this. It's important to remember that communication through language is a cooperative process. We are not just corrected but queried - even with a raised eyebrow - as we speak, so we learn to correct ourselves by rephrasing, so that redundancy in language becomes important. Furthermore, most of the time utterances do not have long-term goals. We seek instant feedback (either in language or behaviour).

Go differs in all three respects. It is a contest. Efficiency is prized. Long-term goals are paramount.

In that respect, AlphaGo is not likely yet to offer much insight into language learning. But maybe language learning can offer a little insight into playing against AlphaGo.

Like, I think, most amateur games players over a certain age, I tend to play by rote and with the barest of thought. I am playing purely for distraction. I do the same when playing a chess program on my iPhone. Because chess is so tactical, I routinely miss a simple trap which I know I know. Some time ago I decided to cheat. If it was indeed a trap or combination I did indeed know - in other words, I would have expected to have seen it if I was playing carefully - I take my move back (but still play quickly). This program has a decent Elo grading algorithm and I discovered that the difference in my grade without cheating and with cheating is of the order of 400 points. That's massive, but seems to equate what I have noticed in go - that older players playing by rote drop by about 4 dan/kyu.

What I suggest, therefore, is Matta Go - an experiment in which a pro can take back any last move once he sees how AlphaGo responds. A pro is very unlikely to be playing four grades below his best, of course, but the "correction" process might make enough of a difference for the most human aspects of go (long-term strategies?) to re-assert themselves. We might then see even better go.

Top
 Profile  
 
Offline
 Post subject: Re: AI’s Language Problem
Post #9 Posted: Thu May 11, 2017 9:28 am 
Tengen

Posts: 4380
Location: North Carolina
Liked others: 499
Was liked: 733
Rank: AGA 3k
GD Posts: 65
OGS: Hyperpape 4k
Bill Spight wrote:
Actually, humans do learn language rules on the path to fluency. A classic example has to do with irregular verbs in English. For instance, the verb, go has the past tense, went. Children first learn went, presumably by imitation, but later go through a phase where they say goed, forming the past tense the standard rule. Later still they go back to saying went. :)
My understanding is that linguists who say we don't learn rules of language mean that we do not learn by learning and applying rules that we can state. A large chunk of linguistic work is trying to state the syntactic rules that native speakers follow, and how those rules develop for the individual speaker during childhood.

It's also the case that some things, like punctuation, really are learned by explicit instruction and rules that the learner can roughly state. But the capacity to utter a grammatical sentence of English is not one of them.

_________________
Occupy Babel!

Top
 Profile  
 
Offline
 Post subject: Re: AI’s Language Problem
Post #10 Posted: Thu May 11, 2017 2:37 pm 
Lives in gote
User avatar

Posts: 392
Liked others: 23
Was liked: 43
Rank: NR
hyperpape wrote:
a load of 200 year-old nonsense
what's the Matta with you people? Can't you read?! i proved 10 years ago that there's no such thing as syntax - it's all made-up by Bishop Wilberforce - well, Bishop something or other
https://ssrn.com/abstract=2205530
and if that isn't bad enough, Noam Chomsky had the cheek to pinch my idea and publish it 40 years before me..., i mean, really!
But what is even worse, is that i had no idea what Matta means and had to Google it. Yes, that kind of sums up Go very aptly, except that Go isn't about Matta-ing the other one, it's really about Matta-ing yourself, which is a very queer way of Go-ing about life, if you could get round to it, which you can't. Even Alpha male dogs can't, but they keep trying.

How about being able to Matta recursively in real life? i would love to rewind the clock and have another Go at all the Mattas i missed out on, except that it would be pointless, for like all humans, i never learn anything and keep Go-ing on making the same mistakes over and over again, such as writing this.

On the other hand, Bishop Jawn may be on to something, for wouldn't butter Go be so much more exciting, if stones could slip one in, or slide across the bored?

Top
 Profile  
 
Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 10 posts ] 

All times are UTC - 8 hours [ DST ]


Who is online

Users browsing this forum: No registered users and 1 guest


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Search for:
Jump to:  
Powered by phpBB © 2000, 2002, 2005, 2007 phpBB Group