Life In 19x19
http://lifein19x19.com/

On handling online cheating with AI
http://lifein19x19.com/viewtopic.php?f=10&t=17528
Page 5 of 8

Author:  Bill Spight [ Tue Jun 02, 2020 12:17 pm ]
Post subject:  Re: On handling online cheating with AI

jlt wrote:
Perhaps Bill's point is that in some situations, it may happen that moves A and B have similar winrates, but A is much more bot-like than B.


If I have a point, it's that I don't know. ;)

But I also know that I don't know. :)

Author:  Bill Spight [ Tue Jun 02, 2020 12:32 pm ]
Post subject:  Re: On handling online cheating with AI

Knotwilg wrote:
I got 10/12. In the last 4 examples I found it much easier to determine the better move and so I would only think the bot played the other move for some statistical win probability maximizing reason. But it didn't.

Now I admit, what's the point here? Me calling out the bot move 10/12 doesn't say a lot I guess. Suppose more people can do it, what does that prove? That this forum has good insight in what bots play? That this forum is strong on average? What kind of benchmark is this establishing?


The ability that you and jlt show in being able to distinguish between human and bot moves is hopeful, because that suggests that a neural network could learn that distinction, as well. Whatever the basis of that distinction is, it does not have to do with playing well, since I controlled for the quality of the plays.

And if a cheater learns how to make human style good plays, then he doesn't have to cheat, does he? (OC, he might fall back on Leela 11, but there you go. :lol:)

Author:  Adin [ Tue Jun 02, 2020 12:57 pm ]
Post subject:  Re: On handling online cheating with AI

Knotwilg wrote:
Suppose more people can do it, what does that prove? That this forum has good insight in what bots play?

It proves how one can get to 10.000 posts while knowing he does not know while others not knowing he knows that.

Author:  Knotwilg [ Tue Jun 02, 2020 1:37 pm ]
Post subject:  Re: On handling online cheating with AI

Adin wrote:
Knotwilg wrote:
Suppose more people can do it, what does that prove? That this forum has good insight in what bots play?

It proves how one can get to 10.000 posts while knowing he does not know while others not knowing he knows that.


If you're not careful, you're going to have more posts about Bill's posts than about what you actually want to discuss. Put away your anger for a moment will you? I wouldn't be confident in the refereeing of a person so easily aroused.

Author:  Gomoto [ Tue Jun 02, 2020 1:43 pm ]
Post subject:  Re: On handling online cheating with AI

hand talk? rank talk!

Author:  gennan [ Tue Jun 02, 2020 1:44 pm ]
Post subject:  Re: On handling online cheating with AI

Uberdude wrote:
Adin, what is your view of the Carlo Metta cases from the PGETC?

And of Blackstone's principle that
Quote:
It is better that ten guilty persons escape than that one innocent suffer.


What do you think the correct ratio is for AI cheating is in Go. I think it is reasonable to differ from that for say the crime of murder and the punishment of lenghty imprisonment or execution. But we shouldn't neglect the reputational damage of declaring someone an AI cheater, indeed I would be happy with a lower standard of evidence against an anonymous online account than one linked to a known human individual.

Robert seems to think that ratio is infinity to 1. The US justice prison system seems to think it's flipped at 1 to 10. My first feeling is maybe a bit lower than Blackstone's, say 5 to 1, is an appropriate target to design for. What do others think is a suitable one for Go cheating?


If the ratio is less than 5 (false negatives) to 1 (false positive), it would start to feel like a police state policy. The cure would be worse than the disease.

Author:  jann [ Tue Jun 02, 2020 2:12 pm ]
Post subject:  Re: On handling online cheating with AI

Adin wrote:
We really need automated detection but I heard of nobody working on that.

IMO this is nearly impossible if a bot is only used for blunder checking. Not making bigger than a certain size of blunders needs dozens or hundreds of games to even remotely amount to meaningful evidence.

Author:  Uberdude [ Tue Jun 02, 2020 2:18 pm ]
Post subject:  Re: On handling online cheating with AI

Adin wrote:
A few months ago I played a game on another server than KGS. I got crushed. Looking at opponent user info his latest about one hundred games were all wins. He had skyrocketed from a very stable 2k to 4d and showed no sign of stopping. I contacted the server administration and they won't do anything since there is no policy regarding AI cheating. And meanwhile instead of complaining or taking action people get into the most abstract philosophical discussions involving 0.5% win rate. Oh well.


I just checked the KGS TOS at http://gokgs.com/tos.jsp. Although it says "Dishonest play during rated games." is not allowed, it says nothing specifically against using bots, just prohibits "Having other people play rated games for you". It could be argued that using a bot to help you is not dishonest so long as you don't claim to not use a bot, so whilst I certainly agree it is bad etiquette not to volunteer that information through your obvious username (like leelazero7 I used on Fox), in your profile, or in chat before the game, under the current rules of KGS it does not appear to be cheating there either. Perhaps you should liase with the other admins and update the TOS, though changes to TOS should be clearly communicated to current users.

About automatic bot detection, I have heard Yike server has some, though no idea of its details or efficacy.

Author:  Adin [ Tue Jun 02, 2020 2:30 pm ]
Post subject:  Re: On handling online cheating with AI

Quote:
I just checked the KGS TOS at http://gokgs.com/tos.jsp. Although it says "Dishonest play during rated games." is not allowed, it says nothing specifically against using bots, just prohibits "Having other people play rated games for you".

Using an AI as a human player in rated games does qualify as dishonest play. But it is certainly a good suggestion to add it specifically, I will bring that up.
Knotwilg wrote:
If you're not careful, you're going to have more posts about Bill's posts than about what you actually want to discuss. Put away your anger for a moment will you? I wouldn't be confident in the refereeing of a person so easily aroused.

If you care about something then you are passionate about it. I look at it as saying that some robbers are taking away our goods and we should do something about it. And then someone else talks for hours about whether a robber usually wears a hoodie or just a simple shirt, and do they use Android or IPhones etc etc. These things are totally irrelevant, a robber is that guy with YOUR phone in his hand.

Author:  Javaness2 [ Tue Jun 02, 2020 2:37 pm ]
Post subject:  Re: On handling online cheating with AI

Adin wrote:
Quote:
I just checked the KGS TOS at http://gokgs.com/tos.jsp. Although it says "Dishonest play during rated games." is not allowed, it says nothing specifically against using bots, just prohibits "Having other people play rated games for you".

Using an AI as a human player in rated games does qualify as dishonest play. But it is certainly a good suggestion to add it specifically, I will bring that up.


There are many openly AI enhanced players on KGS now, I haven't noticed anyone removing their rank. So I am not sure that you are right about that.

Author:  Adin [ Tue Jun 02, 2020 2:56 pm ]
Post subject:  Re: On handling online cheating with AI

Javaness2 wrote:
There are many openly AI enhanced players on KGS now, I haven't noticed anyone removing their rank. So I am not sure that you are right about that.

Have you reported them? I removed myself the rank of someone who was an openly AI enhanced player. If you wish you can send me a PM with their usernames.

Author:  Bill Spight [ Tue Jun 02, 2020 4:08 pm ]
Post subject:  Re: On handling online cheating with AI

Adin wrote:
I look at it as saying that some robbers are taking away our goods and we should do something about it. And then someone else talks for hours about whether a robber usually wears a hoodie or just a simple shirt, and do they use Android or IPhones etc etc. These things are totally irrelevant, a robber is that guy with YOUR phone in his hand.


How can you tell if a robbery has taken place? What action should you take about a nonexistent crime? If you are going to take any action, you have to learn how to be a detective.

Author:  Knotwilg [ Tue Jun 02, 2020 4:33 pm ]
Post subject:  Re: On handling online cheating with AI

Adin wrote:
Quote:
I just checked the KGS TOS at http://gokgs.com/tos.jsp. Although it says "Dishonest play during rated games." is not allowed, it says nothing specifically against using bots, just prohibits "Having other people play rated games for you".

Using an AI as a human player in rated games does qualify as dishonest play. But it is certainly a good suggestion to add it specifically, I will bring that up.
Knotwilg wrote:
If you're not careful, you're going to have more posts about Bill's posts than about what you actually want to discuss. Put away your anger for a moment will you? I wouldn't be confident in the refereeing of a person so easily aroused.

If you care about something then you are passionate about it. I look at it as saying that some robbers are taking away our goods and we should do something about it. And then someone else talks for hours about whether a robber usually wears a hoodie or just a simple shirt, and do they use Android or IPhones etc etc. These things are totally irrelevant, a robber is that guy with YOUR phone in his hand.


An analogy is a sign of someone becoming intellectually insecure about his own argument yet emotionally attached to it. You'd better stick to the point.

You want to do something against people using bots to boost their ranks online. Several arguments are being offered here, one of which is Bill's tangent, trying to find out if you can at all figure out if someone uses a bot. Whether that exploration is very fruitful to your quest, I don't know, but it's certainly a more valuable contribution than your own rambling against it. You can choose to follow other arguments instead. I think that's perfectly fine.

Author:  jlt [ Wed Jun 03, 2020 12:04 am ]
Post subject:  Re: On handling online cheating with AI

Uberdude wrote:
And of Blackstone's principle that
Quote:
It is better that ten guilty persons escape than that one innocent suffer.


What do you think the correct ratio is for AI cheating is in Go. I think it is reasonable to differ from that for say the crime of murder and the punishment of lenghty imprisonment or execution. But we shouldn't neglect the reputational damage of declaring someone an AI cheater, indeed I would be happy with a lower standard of evidence against an anonymous online account than one linked to a known human individual.

Robert seems to think that ratio is infinity to 1. The US justice prison system seems to think it's flipped at 1 to 10. My first feeling is maybe a bit lower than Blackstone's, say 5 to 1, is an appropriate target to design for. What do others think is a suitable one for Go cheating?


It depends what kind of punishment you are talking about. A ratio of 5:1 is perfectly fine if you just invalidate the rank of an anonymous account (i.e. the account is no longer allowed to play ranked games), maybe 10:1 if you ban the account and 500:1 if in addition you ban the IP.

On the other hand, if the punishment is to ban an account of an identifiable person and to state publicly that the reason is cheating with AI, then I wouldn't be comfortable with a ratio less than 100000:1.

There are other ways to prevent cheating without ruining a player's reputation. For online tournaments, you can ask a player to be monitored and/or filmed by a camera that shows the player's screen as well as all his body movements.

Author:  ez4u [ Wed Jun 03, 2020 12:37 am ]
Post subject:  Re: On handling online cheating with AI

I find some of the comments here rather beyond the line of being helpful.

The issue is how should admins police the servers so that we do not see the communities that exist there deteriorate as people become unwilling or too cautious about playing. See Baduk Doctor's 9-dan videos, where he says that these days he only plays known opponents because the 9-dan ranks have become overrun with people playing via AI's.

Personally I think that we are far from detecting human vs bot in any automated fashion. I see quite a lot of variation in move choices among bots, among different versions of the same bots, and depending on how many playouts the bots are given. So what can be done?

First, everyone in the U.S. (i.e. where KGS is located) should stop with the absolute proof discussions. I cannot speak for other countries but in the U.S. the standard is different.

Source: criminal.findlaw.com/criminal-law-basics/the-differences-between-a-criminal-case-and-a-civil-case

"The Standard of Proof

Crimes must generally be proved "beyond a reasonable doubt", whereas civil cases are proved by lower standards of proof such as "the preponderance of the evidence" (which essentially means that it was more likely than not that something occurred in a certain way). The difference in standards exists because civil liability is considered less blameworthy and because the punishments are less severe."

What should the less severe punishments be? The best that I can think of is that if the admins examine a complaint against a player and feel that it is more likely than not that the player used an AI:
1. They should remove the player from any tournament that they are in and nullify their result if there is a tournament involved.
2. KGS should develop an new icon for "suspected bot" or something and apply that icon to the player. That way people should be able to see a ready indication of the judgement of the server with regard to that player. If you don't mind, you can play them. However, people that do mind should have easy access to the judgement of the server.
3. People suspected of using bots should be banned... from automatch rather than from the server. This would lower the likelihood that people who object to using AI's would end up playing against people that do so.

Of course I have not found a better way to confirm whether an AI has been used. My advice is to do what you do throughout the day every day - use your common sense. In other words, if it walks like a duck and quacks like a duck, slap the duck icon on it. However, do not lose any sleep over it. Believe that you are acting for the greater good. In 1970 George Akerlof published "The Market for Lemons" on the economic costs of dishonesty and the negative effects on markets. The paper won him the 2001 Nobel prize. Go servers represent such markets where people gather to exchange entertainment services. The ability of some players to cheat, for whatever reason, does reduce the average experience of the more honest players and makes the servers less attractive. I support the efforts of the admins to police the servers and am particularly appreciative of the unpaid volunteers.

Author:  Adin [ Wed Jun 03, 2020 12:49 am ]
Post subject:  Re: On handling online cheating with AI

As I mentioned before I think an error rate of 1 in 100 is achievable. And anything worse than 1 in 10 is an obvious failure of the investigator.

I'm not comfortable with "punishments" since there will always be some error. The point is not to punish someone but to protect the community. For example on KGS you just get your rank deactivated and you can ask it back after 6 months when all your ranked games have gone out of the system. You can create a new account and start playing right away (of course, admins may monitor it and remove the rank from it too if shows the same AI behaviour). But there's no banning or public shaming or any such stuff.
Quote:
In 1970 George Akerlof published "The Market for Lemons" on the economic costs of dishonesty and the negative effects on markets. The paper won him the 2001 Nobel prize. Go servers represent such markets where people gather to exchange entertainment services. The ability of some players to cheat, for whatever reason, does reduce the average experience of the more honest players and makes the servers less attractive.

Well said, it basically takes away some of the enjoyment of Go from us.

Author:  gennan [ Wed Jun 03, 2020 1:08 am ]
Post subject:  Re: On handling online cheating with AI

If the false positive rate is more than 20% and the sanction is disproportional like an automatic 6 month ban from the server, I would definitely be against it.

If the false positive rate is less than 1% and if the sanctions are proportional like @ez4u proposes, I would definitely be in favour.

But how do we know the false positive rate? I think quite a bit of testing has to be done to measure this rate for whatever bot detection method the admins use (without disclosing the details of those methods).

Author:  RobertJasiek [ Wed Jun 03, 2020 1:42 am ]
Post subject:  Re: On handling online cheating with AI

You don't want to hear it because you don't want to invest the work: false positives are identified by observing each alleged cheater in person proving his strength in self-decided play for many games.

Author:  Polama [ Wed Jun 03, 2020 7:56 am ]
Post subject:  Re: On handling online cheating with AI

I'd posit there's two types of cheaters: people who just run the bot and destroy their opponent, who want to play the best move every move. And people who want to get away with cheating, who spot check for blunders or the occasional tricky move, but who are savvy enough to not blindly play clearly bot sequences.

I really don't think you'll catch the latter group with anything short of monitoring. And again, if you have an algorithm that detects bot moves, you can train a bot that doesn't play those moves.

In a lot of ways, though, I think it's the former group that's the bigger problem because it's more visible. If people are complaining that the 9-dan ranks are all bots, that's a perception of a widespread problem. But I think Spinal Tap can point us to a helpful counter-measure: make it go to 11! Bots are better than us at Go. Let the cheaters raise up to a rank above us humans and play amongst themselves.

Author:  Bill Spight [ Wed Jun 03, 2020 9:14 am ]
Post subject:  Re: On handling online cheating with AI

Polama wrote:
I'd posit there's two types of cheaters: people who just run the bot and destroy their opponent, who want to play the best move every move. And people who want to get away with cheating, who spot check for blunders or the occasional tricky move, but who are savvy enough to not blindly play clearly bot sequences.

I really don't think you'll catch the latter group with anything short of monitoring. And again, if you have an algorithm that detects bot moves, you can train a bot that doesn't play those moves.


If, however, the bot detectors are based on different preferences between bots and humans that do not have to do with the quality of play, then the extra task of finding human-like plays is likely to reduce the bot's level of play. IIUC, today's top bots are Zero(™) bots is that the initial training on human professional play is a handicap.

Quote:
In a lot of ways, though, I think it's the former group that's the bigger problem because it's more visible. If people are complaining that the 9-dan ranks are all bots, that's a perception of a widespread problem. But I think Spinal Tap can point us to a helpful counter-measure: make it go to 11! Bots are better than us at Go. Let the cheaters raise up to a rank above us humans and play amongst themselves.


Interesting idea. :)

Page 5 of 8 All times are UTC - 8 hours [ DST ]
Powered by phpBB © 2000, 2002, 2005, 2007 phpBB Group
http://www.phpbb.com/