Re: Computer are strong?!

For discussing go computing, software announcements, etc.
User avatar
Redundant
Lives in sente
Posts: 924
Joined: Thu Apr 22, 2010 3:00 pm
Rank: lazy
GD Posts: 0
KGS: redundant/silchas
Tygem: redundant
Wbaduk: redundant
DGS: redundant
OGS: redundant
Location: Pittsburgh
Has thanked: 45 times
Been thanked: 103 times

Re: Computer are strong?!

Post by Redundant »

Tis the season for good trolling. Trollololol lol lol lol lol.

EDIT: I'm not the OP, but was responding to his attempt at trolling.
Last edited by Redundant on Mon Dec 20, 2010 1:19 pm, edited 1 time in total.
User avatar
Monadology
Lives in gote
Posts: 388
Joined: Wed Jun 23, 2010 1:26 pm
Rank: KGS 7 kyu
GD Posts: 0
KGS: Krill
OGS: Krill
Location: Riverside CA
Has thanked: 246 times
Been thanked: 79 times

Re: Computer are strong?!

Post by Monadology »

Redundant wrote:Tis the season for good trolling. Trollololol lol lol lol lol.


http://www.youtube.com/watch?v=iwGFalTR ... r_embedded
Mike Novack
Lives in sente
Posts: 1045
Joined: Mon Aug 09, 2010 9:36 am
GD Posts: 0
Been thanked: 182 times

Re: Computer are strong?!

Post by Mike Novack »

Was that a question?

a) Define "strong" (what does that term means to you)
b) Recognize that it isn't "computers" that might be strong at go but computer programs that might be -- but how well the program would do in a finite amount of time would then depend on power of the hardware on which running. Without the constraint "time" the computer itself is irrelevant.

Other questions about the performance of go playing software are possible. For example, the "Turing Test" with respect to programs playing go. (given a collection of game records, some human vs human and some human vs "bot", with how much certainty/acuracy can you identify the "bot" players)
pasky
Dies in gote
Posts: 43
Joined: Wed Apr 21, 2010 6:49 am
Has thanked: 4 times
Been thanked: 22 times

Re: Computer are strong?!

Post by pasky »

Once you place the constraint at "reasonable thinking time" (e.g. practical for usual tournament/casual play with human opponent), it does not really matter that much. It is a significant factor, but not drastically so; you may gain or lose two or three ranks but you will remain in the same ballpark. Either the algorithm is too generic and scales extremely slowly, or it is highly tuned and it gains the baseline strength very quickly, but gets caught in bad biases in hairy situations and will scale even poorer in these.
Go programmer and researcher: http://pasky.or.cz/~pasky/go/
EGF 1921, KGS ~1d and getting weaker
Mike Novack
Lives in sente
Posts: 1045
Joined: Mon Aug 09, 2010 9:36 am
GD Posts: 0
Been thanked: 182 times

Re: Computer are strong?!

Post by Mike Novack »

pasky wrote:Once you place the constraint at "reasonable thinking time" (e.g. practical for usual tournament/casual play with human opponent), it does not really matter that much. It is a significant factor, but not drastically so; you may gain or lose two or three ranks but you will remain in the same ballpark. Either the algorithm is too generic and scales extremely slowly, or it is highly tuned and it gains the baseline strength very quickly, but gets caught in bad biases in hairy situations and will scale even poorer in these.


Need to take this apart (several issues)

1) The performance of some of these algorithms may be extremely non-linear with respect to time (time being interpreted as a combination of machine power and real time). Below enough time performanace might be terrible but above some critical amount improvement with reasonable additional time modest and above some point improvement very slow as time increases exponentially.

2) You can't go by how the algorithms of several years ago behaved so the rest of what you say is outdated. The dominant algorithm now used by all the strongest programs does not behave the way you have described. Currently performance is limited purely by time and isn't "biased" in the way you think. Given enough time these algorithms would discover the best next move. For these programs "tuning" is adjusting behavior so as to get the best performance within the constraint of actual time given the allowed computer power. How that is done might or might not introduce "bias" (it doesn't have to -- need not be deterministic*)

3) Objectives differ. Are we after the strongest possible program (given the time/machine power constraint) or the strongest one that can pass or come close to passing the Turing test within that constraint? (not obviously identifiable as a non human player -- if presented with a set of games some of which between two humans and some between a human and this program you could not easily/certainly separate into the two subsets)

* And here don't try to go into a discussion of "pseudo-random" vs "random" since could use an approximate true random (for example, the time used by the opponent to make the previous move)
User avatar
liquido
Beginner
Posts: 12
Joined: Sat May 01, 2010 11:48 am
GD Posts: 0
KGS: liquido
Has thanked: 4 times
Been thanked: 6 times
Contact:

Re: Computer are strong?!

Post by liquido »

Mike Novack wrote:
pasky wrote:Once you place the constraint at "reasonable thinking time" (e.g. practical for usual tournament/casual play with human opponent), it does not really matter that much. It is a significant factor, but not drastically so; you may gain or lose two or three ranks but you will remain in the same ballpark. Either the algorithm is too generic and scales extremely slowly, or it is highly tuned and it gains the baseline strength very quickly, but gets caught in bad biases in hairy situations and will scale even poorer in these.


Need to take this apart (several issues)

1) The performance of some of these algorithms may be extremely non-linear with respect to time (time being interpreted as a combination of machine power and real time). Below enough time performanace might be terrible but above some critical amount improvement with reasonable additional time modest and above some point improvement very slow as time increases exponentially.

2) You can't go by how the algorithms of several years ago behaved so the rest of what you say is outdated. The dominant algorithm now used by all the strongest programs does not behave the way you have described. Currently performance is limited purely by time and isn't "biased" in the way you think. Given enough time these algorithms would discover the best next move. For these programs "tuning" is adjusting behavior so as to get the best performance within the constraint of actual time given the allowed computer power. How that is done might or might not introduce "bias" (it doesn't have to -- need not be deterministic*)

3) Objectives differ. Are we after the strongest possible program (given the time/machine power constraint) or the strongest one that can pass or come close to passing the Turing test within that constraint? (not obviously identifiable as a non human player -- if presented with a set of games some of which between two humans and some between a human and this program you could not easily/certainly separate into the two subsets)

* And here don't try to go into a discussion of "pseudo-random" vs "random" since could use an approximate true random (for example, the time used by the opponent to make the previous move)


Actually I agree with pasky here. Both of us have experience in Computer Go using MCTS (the dominant algo you speak of). Yes, MCTS programs do gain more strength from more time, but within "reasonable" time limits that humans might use, the difference is not so big. MCTS seems to gain about 1 stone with every doubling of the thinking time. This corresponds to "It is a significant factor, but not drastically so; you may gain or lose two or three ranks but you will remain in the same ballpark."
User avatar
shapenaji
Lives in sente
Posts: 1103
Joined: Tue Apr 20, 2010 10:58 pm
Rank: EGF 4d
GD Posts: 952
Location: Netherlands
Has thanked: 407 times
Been thanked: 422 times

Re: Computer are strong?!

Post by shapenaji »

are people actually writing reasoned posts in response to an ANNOUNCED troll post?

Do you guys read the OP's anymore?
Tactics yes, Tact no...
User avatar
palapiku
Lives in sente
Posts: 761
Joined: Sun Apr 25, 2010 11:25 pm
Rank: the k-word
GD Posts: 0
Has thanked: 152 times
Been thanked: 204 times

Re: Computer are strong?!

Post by palapiku »

Computer are

VARY STONG!
User avatar
Magicwand
Tengen
Posts: 4844
Joined: Wed Apr 21, 2010 5:26 am
Rank: Wbaduk 7D
GD Posts: 0
KGS: magicwand
Tygem: magicwand
Wbaduk: rlatkfkd
DGS: magicwand
OGS: magicwand
Location: Mechanicsburg, PA
Has thanked: 62 times
Been thanked: 504 times

Re: Computer are strong?!

Post by Magicwand »

acking troll:
there are computer program that will play perfect endgame.
so computers are stronger than professionals in some sense
:)
"The more we think we know about
The greater the unknown"

Words by neil peart, music by geddy lee and alex lifeson
User avatar
shapenaji
Lives in sente
Posts: 1103
Joined: Tue Apr 20, 2010 10:58 pm
Rank: EGF 4d
GD Posts: 952
Location: Netherlands
Has thanked: 407 times
Been thanked: 422 times

Re: Computer are strong?!

Post by shapenaji »

Redundant wrote:Tis the season for good trolling. Trollololol lol lol lol lol.

EDIT: I'm not the OP, but was responding to his attempt at trolling.


Haha, I didn't realize this was a response to another thread, I just assumed that the subject line was good rickroll material. My bad!
Tactics yes, Tact no...
User avatar
Redundant
Lives in sente
Posts: 924
Joined: Thu Apr 22, 2010 3:00 pm
Rank: lazy
GD Posts: 0
KGS: redundant/silchas
Tygem: redundant
Wbaduk: redundant
DGS: redundant
OGS: redundant
Location: Pittsburgh
Has thanked: 45 times
Been thanked: 103 times

Re: Computer are strong?!

Post by Redundant »

shapenaji wrote:
Redundant wrote:Tis the season for good trolling. Trollololol lol lol lol lol.

EDIT: I'm not the OP, but was responding to his attempt at trolling.


Haha, I didn't realize this was a response to another thread, I just assumed that the subject line was good rickroll material. My bad!


There actually was a post before me in this thread, but the poster got the banhammer, and his post was deleted.
User avatar
shapenaji
Lives in sente
Posts: 1103
Joined: Tue Apr 20, 2010 10:58 pm
Rank: EGF 4d
GD Posts: 952
Location: Netherlands
Has thanked: 407 times
Been thanked: 422 times

Re: Computer are strong?!

Post by shapenaji »

To our esteemed moderator: In future, if someone is being banworthy, mind leaving a little something-something behind? I was profoundly confused at first
Tactics yes, Tact no...
User avatar
Li Kao
Lives in gote
Posts: 643
Joined: Wed Apr 21, 2010 10:37 am
Rank: KGS 3k
GD Posts: 0
KGS: LiKao / Loki
Location: Munich, Germany
Has thanked: 115 times
Been thanked: 102 times

Re: Computer are strong?!

Post by Li Kao »

How to treat such trolls is being discussed in a thread in the Suggestions forum
Sanity is for the weak.
waldo
Beginner
Posts: 4
Joined: Thu Aug 12, 2010 6:45 pm
Rank: AGA 8kyu
GD Posts: 20

Re: Computer are strong?!

Post by waldo »

Computer are strong?!

Pie are square.

No, brownies are square; pie are round.
Mike Novack
Lives in sente
Posts: 1045
Joined: Mon Aug 09, 2010 9:36 am
GD Posts: 0
Been thanked: 182 times

Re: Computer are strong?!

Post by Mike Novack »

liquido wrote:Actually I agree with pasky here. Both of us have experience in Computer Go using MCTS (the dominant algo you speak of). Yes, MCTS programs do gain more strength from more time, but within "reasonable" time limits that humans might use, the difference is not so big. MCTS seems to gain about 1 stone with every doubling of the thinking time. This corresponds to "It is a significant factor, but not drastically so; you may gain or lose two or three ranks but you will remain in the same ballpark."


I think you are considering too small a portion of the curve.

Consider the shape of the curve performance vs time (number of algorithm steps) over a large range. What I am saying is that below some number of steps (too little time) won't be other than random moves. In this region the curve is very steep, great improvement when more time is allowed. And at the other end gogin to take a lot more than doubling to increase one level. So yes, somewhere in between you would observe what you say you do (doubling time per level improvement). But I think:

a) That's over a relatively small number of playing levels. Keep in mind that even an exponent of 2 grows quickly.
b) The strongest programs are currently above this point pon the curve. In other words, the implementations are fast enough that they are able to play at acceptable speed (from the human point of view) at a level where for them to go up another level would take much more than doubling the time.

You want a practical example? How about MFOG 12.21? It is supposed to be at 1 dan on a "standard" 2 core machine that a program buyer might be expected to have but the bot on KGS is playing at 2 dan on a machine about 6 times more powerful than "standard" (equivalent to six times the time).
Post Reply