what is the ASR doing wrong?

Discussions about the KGS ASR League go here...
User avatar
jts
Oza
Posts: 2662
Joined: Sat Sep 18, 2010 4:17 pm
Rank: kgs 6k
GD Posts: 0
Has thanked: 310 times
Been thanked: 632 times

Re: what is the ASR doing wrong?

Post by jts »

ez4u wrote:Of course I have only opinions, unsupported by real facts, about what might be done differently.

Are these the opinions you mentioned earlier, or other ideas that you are coyly hiding?

Again (not to harp, but to get you to divulge more about your opinions), how will playing even games advance advanced study? It's really easy to get even games. Distressingly easy, in fact: if I get up to get a drink after clicking autoplay, my time is running down before I get back. These are slow games, using the same time settings as ASR. I don't get a review afterwards, but then, it's hard to get a review with even players even in the ASR. (Mostly because the loser is often fuming, but also because neither player feels obligated to the other.)

I agree that the stronger players aren't getting screwed over! :) I just didn't want to speak for them, since it would be rather self-serving to say they enjoy it. I can say, though, that I'm squarely in the middle and I rather enjoy my ASR games with players who are even beginnerer than I. They can be fun even if I'm poorly rested or stressed out, I can experiment with different ideas without feeling any pressure to be perfect, and I really like it when I get the sense they're learning something from the review.
User avatar
ez4u
Oza
Posts: 2414
Joined: Wed Feb 23, 2011 10:15 pm
Rank: Jp 6 dan
GD Posts: 0
KGS: ez4u
Location: Tokyo, Japan
Has thanked: 2351 times
Been thanked: 1332 times

Re: what is the ASR doing wrong?

Post by ez4u »

I did not mean to imply that I have other opinions that have been held back. I only wanted to make it clear that regardless of what experience might back up my opinion, none of it is experience in the ASR itself, which is presumably the most relevant type.

On the second point, I think that advanced study requires serious games where the opponents put their current best effort into winning. I do not believe that uncompetitive games are serious. Actually of course that is just a theory of mine - I've certainly not tested how to successfully "do" advanced study! Although even games are simple to obtain, serious even games are not. I remember that my initial expectation for the ASR was something like what I am describing. Of course that was me applying my thoughts to someone else's reality - incorrectly as it turned out. :blackeye:
Dave Sigaty
"Short-lived are both the praiser and the praised, and rememberer and the remembered..."
- Marcus Aurelius; Meditations, VIII 21
User avatar
jts
Oza
Posts: 2662
Joined: Sat Sep 18, 2010 4:17 pm
Rank: kgs 6k
GD Posts: 0
Has thanked: 310 times
Been thanked: 632 times

Re: what is the ASR doing wrong?

Post by jts »

ez4u wrote:On the second point, I think that advanced study requires serious games where the opponents put their current best effort into winning. I do not believe that uncompetitive games are serious.

Oh, okay. I agree, more or less... I actually posted a question a week or two ago,about whether people play to win or play for the best point spread when they're way behind. But this is mostly a problem once the gap gets to be too large, when it's hard to even think strategically about the game because the situation on the board is so lopsided. For me, at least, "best effort" has more to do with sleep and mood than the rank difference.

But you and Bill Spight should really have a debate on this - he (along with several other members of the forum, iirc) is a big proponent of "get whomped by stronger players in even games".

What I find to be most "serious" about the ASR games is the review. Getting a review from a player who is both much stronger than you and was your opponent is totally different from either one separately.
User avatar
topazg
Tengen
Posts: 4511
Joined: Wed Apr 21, 2010 3:08 am
Rank: Nebulous
GD Posts: 918
KGS: topazg
Location: Chatteris, UK
Has thanked: 1579 times
Been thanked: 650 times
Contact:

Re: what is the ASR doing wrong?

Post by topazg »

I have come to think that games would be taken more seriously if they were rated, and I now think ASR league games should be rated by default.

PS Your dog looks awesome Dave :P
User avatar
ez4u
Oza
Posts: 2414
Joined: Wed Feb 23, 2011 10:15 pm
Rank: Jp 6 dan
GD Posts: 0
KGS: ez4u
Location: Tokyo, Japan
Has thanked: 2351 times
Been thanked: 1332 times

Re: what is the ASR doing wrong?

Post by ez4u »

topazg wrote:...
PS Your dog looks awesome Dave :P

Absolutely disgraceful that my wife and one of her friends took the most important member of the family to a local pet shop and photographed her wearing a some bear ears! :evil:
Dave Sigaty
"Short-lived are both the praiser and the praised, and rememberer and the remembered..."
- Marcus Aurelius; Meditations, VIII 21
User avatar
ez4u
Oza
Posts: 2414
Joined: Wed Feb 23, 2011 10:15 pm
Rank: Jp 6 dan
GD Posts: 0
KGS: ez4u
Location: Tokyo, Japan
Has thanked: 2351 times
Been thanked: 1332 times

Re: what is the ASR doing wrong?

Post by ez4u »

Of course it is even worse that I then posted it on the net! :blackeye:
Dave Sigaty
"Short-lived are both the praiser and the praised, and rememberer and the remembered..."
- Marcus Aurelius; Meditations, VIII 21
User avatar
daal
Oza
Posts: 2508
Joined: Wed Apr 21, 2010 1:30 am
GD Posts: 0
Has thanked: 1304 times
Been thanked: 1128 times

Re: what is the ASR doing wrong?

Post by daal »

topazg wrote:I have come to think that games would be taken more seriously if they were rated, and I now think ASR league games should be rated by default.


I think you're mixing up more serious with more stressful. I really really hope that you don't implement this, as it would be a great deterrent to the stated goal of playing lots of games.
Patience, grasshopper.
User avatar
stalkor
Lives in gote
Posts: 397
Joined: Fri Aug 06, 2010 3:30 pm
Rank: KGS 1d
GD Posts: 0
KGS: stalkor
Location: Netherlands
Has thanked: 102 times
Been thanked: 66 times
Contact:

Re: what is the ASR doing wrong?

Post by stalkor »

daal wrote:
topazg wrote:I have come to think that games would be taken more seriously if they were rated, and I now think ASR league games should be rated by default.


I think you're mixing up more serious with more stressful. I really really hope that you don't implement this, as it would be a great deterrent to the stated goal of playing lots of games.


i agree here, not only would it seriously get your rank stuck really quickly it would also ''scare off'' all [-] players in a heartbeat.

To get back to ez4u without going OT (poor doggie) the ASR is a community and to get things going the community must set this in motion (just like here on L19 or am i missing something?). Yes asia is really underrepresented in the ASR and i wish i could get them in there for an even more diverse and active ASR. So my proposal is then that you (blunt mode) do something about it (/blunt mode).
Im more then willing to promote lectures on the site and in the room if youre willing to give them because we need more of a study environment of high standard that motivates those strong players to like the ASR.

I compared other rooms to the ASR and i can still say ASR is one of the most active rooms that is not a national or standard room, so if you say the room is inactive, compare first.
admin of the ASR league and KGS admin
User avatar
topazg
Tengen
Posts: 4511
Joined: Wed Apr 21, 2010 3:08 am
Rank: Nebulous
GD Posts: 918
KGS: topazg
Location: Chatteris, UK
Has thanked: 1579 times
Been thanked: 650 times
Contact:

Re: what is the ASR doing wrong?

Post by topazg »

I may come under a lot of fire for this view, but I'll share it anyway (it's never stopped me before!) - Also, Dave, if you're reading this, I'd actually really value your opinion on it too.

The answer (if there is one) depends a lot on what the current goals of the ASR actually are. I'll suggest 4 possibilities, but I'm sure there are lots more:

1) A good excuse to play lots of games with a competitive feel

If this is the goal, reviews should be optional, and games should probably be a lot shorter, perhaps 10 mins + 5x0:20 byo. I'll keep this one short as I don't think anyone quite feels this is "the priority", but as daal mentioned the goal was playing lots of games (even though I'm sure this wasn't what he was implying) I thought I'd mention it.

2) A friendly environment to play and learn

By and large, the ASR seems a pretty friendly place, and it has its own KGS room, website, and forum (albeit here on L19). However, there's not a great deal of social interaction, and there isn't much ASR focus on making more happen. The number of players that participate on the forum is a tiny fraction, and the website has little access or social use, instead being used for rules, guidelines, hints and tips, and the league results.

The games have sensible time controls for learning and playing, and reviews are recommended at the end of the game, which helps in some respects to learning. However, I think if 2) is the goal, not enough is being done to encourage an interactive community that could interact explicitly on teaching and learning material as well as general social interaction. For example, threads in a dedicated ASR forum that are dedicated to studying josekis / fusekis, analysing when tesujis work and when they don't, regular L+D challenge problems for different levels etc. This would seem like a consistent way to develop further in the future, but finding a way of combining the existing league system successfully could be tricky.

3) A serious competition environment, with emphasis on learning as a side

I think this is probably the closest of the 4 goals with respect to how the ASR currently functions in practice. The games are suitably long, reviews are advocated by the administration, and the league system rewards both activity and performance. There's incentive to play games, and incentive to win, and I think that the league achieves 3) pretty well.

An enhanced online presence, perhaps on "featured games", or "featured players" might be interesting, with interviews (including questions on how to improve the league!) of some of the more active players. Stats would also be nice for many I think (total games played, total games won, total points earned, perhaps with the ability to break down both by tier and by month), as most competitive environments seem to benefit from this kind of thing (too many gamers are stats/numbers afficionados, especially in the Go world). It would also be possible to keep an "ASR performance rating" running alongside it with ELO evaluations of the players, so just as with the chess world, there'd by the champion (by competition), and the highest rated player (by overall performance), who are not necessarily the same.

4) A serious learning environment, with emphasis on competition as a side

I think this is probably the closest of the 4 with respect to ASR's officially stated goals. If the goal is to help players improve first, and offer a competitive environment second, I think there are a few ways of improving the current system.

As someone who has successfully taught quite a few students, I would have said that the greater the investment (in money, time, energy and/or stress), the greater the potential gain in ability. The more you invest into your improvement, the more focus you have, the more stress you have, and the more you remember of the pros and cons of your play and your opponent's play. If I was to have lots of time and money, so that I could play in the ASR (unrated), on KGS generally (for rated games), and paid tuition (with teachers), my concentration, focus and effort would be 1) teacher games, 2) KGS rated games, and quite a long way behind it, 3) ASR games. If we are genuinely keen on using the ASR as a platform for improvement in playing ability, this order seems somewhat perverse. I actually believe that, whilst playing stronger players and having them review is awesome and useful, simply playing long, serious, highly focused games against the same level opposition and reviewing it together afterwards can be really effective for improving and learning.

Rated games are more stressful, it's easier to make excuses to not play, and I feel 100% sure the ASR would lose a bunch of players, and a bunch of games per month if it was implemented. I also feel 100% sure that those that remain would focus harder, put in more energy effort, and have less need to play rated games in the EGR (allowing more time to focus on ASR games). I think this would help players to improve their play considerably more, and if 4) is the goal of the ASR, I think rated games makes much more sense than unrated games. Alex has taken a different route with the Insei league, and gets people's motivation and focus based on paying money, but I think making games rated will be more effective, and easier to find the players who feel in a position to play in the system. As with 2), the focus for online development would probably be ideally related around discussions of study material - the ability to post positions, moves, games, ideas, and discuss them, as well as in-depth analysis and ideas behind josekis and fusekis.



In summary, I actually don't feel particularly strongly, as it depends entirely on what the ASR feels is its goal. When I first joined, I was enamoured by the idea that this "wasn't just another league". The goal was a competitive environment (which I love), with serious games (which I love), and first and foremost an opportunity to really improve your game of Go. If the latter is now less of a priority than the former, "serious games" becomes "longer games" (which I love slightly less ;)), and much of the unique appeal it held for me disappears. I could go join the BGA individual league instead (where I know most of the players, so get a sense of community from it) if I wanted to simply have a competition with other Go players. On the other hand, if other people want it, and more importantly if the ASR administration feel that the competition should be the core of the ASR, then it's the right decision. However, trying to achieve both 3) and 4) equally I think will leave the ASR doing neither thing outstandingly well, which is worse than focusing properly on one of the two aims individually.

PS Anecdotal evidence of one: I'm a [-] player and it would bring me _back_ ;)
User avatar
daal
Oza
Posts: 2508
Joined: Wed Apr 21, 2010 1:30 am
GD Posts: 0
Has thanked: 1304 times
Been thanked: 1128 times

Re: what is the ASR doing wrong?

Post by daal »

topazg wrote: I'll suggest 4 possibilities, but I'm sure there are lots more:


I think that your description 4: "A serious learning environment, with emphasis on competition as a side," best fits both the stated goals and the way ASR works in practice, though I would add the word "friendly" somewhere too. The reason that this model as opposed to your point 3 fits the current practice best is that the emphasis on playing lots of games, allowing people with lots of time to rise more easily, makes the competitive aspect of ASR a side benefit. The main focus is learning by playing and reviewing, and a friendly atmosphere is conducive to that. Rated games tend to be more competitive and less friendly.

Generally, KGS rated games are 1) not even games between players of differing strengths, and 2) don't end in a review. These are the aspects that make ASR unique. It is also the case that most KGS games are rated. In fact, ASR is one of the best ways to get a serious free game. This is for me a huge benefit. It allows me to free my mind of ratings concerns and simply concentrate on the game. This also reduces the anger at my own mistakes, and allows me to concentrate on learning from the review. I'm sure it would be great if I could direct my hate to my mistakes instead of myself when I lose a rated game, but I'm not the only one with this problem.

Whether playing and reviewing is the best way to improve is perhaps questionable - I've never had a teacher - but I see it as an important part of the mix. Rated games, as well as tsumego practice or lectures I can get elsewhere, but the regular game + review is something that I only get at ASR. I think this is what the league should focus on.
Patience, grasshopper.
User avatar
ez4u
Oza
Posts: 2414
Joined: Wed Feb 23, 2011 10:15 pm
Rank: Jp 6 dan
GD Posts: 0
KGS: ez4u
Location: Tokyo, Japan
Has thanked: 2351 times
Been thanked: 1332 times

Re: what is the ASR doing wrong?

Post by ez4u »

I saw the last few posts but haven't had time to think them through yet. Meanwhile, I took the results chart for September and put the info into Excel. Here is a brief summary. I wanted to have a better understanding of the range of activity in the league. For my mental picture, I divided the number of games played by four to arrive at "games played per week" and grouped players as shown. The first line, for example, says that 17 people played five or more games a week on average (= they played 20 or more games total; that actual range was 20-31). Those 17 people represented 5% of the players in the league that month, grabbed 17% of the points scored, garnered 18% of the wins, suffered 18% of the losses, and accounted for 18% of all games. I have not drawn any conclusions yet, it is simply food for thought at this point.

September stats...
Image

I also made a quick histogram of the number of games played...
Image
Dave Sigaty
"Short-lived are both the praiser and the praised, and rememberer and the remembered..."
- Marcus Aurelius; Meditations, VIII 21
User avatar
stalkor
Lives in gote
Posts: 397
Joined: Fri Aug 06, 2010 3:30 pm
Rank: KGS 1d
GD Posts: 0
KGS: stalkor
Location: Netherlands
Has thanked: 102 times
Been thanked: 66 times
Contact:

Re: what is the ASR doing wrong?

Post by stalkor »

ez4u wrote:I also made a quick histogram of the number of games played...
Image



this is either totally wrong or im totally stupid. there were over a 1000 games last month and your histogram doesnt average out on 30+ games per day.


my stats for september
Stats for this month (september

Total number of players registered this month: 314
Players not yet completed enough games to stay in: 114 (36% dropout)
Total games played this month: 1076 out of a possible 7464 (14.4%)
games per active player (>4 games): 5,38 games
games per player: 3,43 games
average games per day: 35,86


compare to stats for august
Stats for this month

Total number of players registered this month: 312
Players not yet completed enough games to stay in: 85 (27% dropout)
Total games played this month: 1361 out of a possible 8198 (16.6)
games per active player (>4 games): 5.99 games
games per player: 4.36 games
average games per day: 43.9


compare to stats for february (biggest league we ever had + most games ever in a month)
Stats for this month

Total number of players registered this month: 542
Players not yet completed enough games to stay in: 174 (32% dropout)
Total games played this month: 2080 out of a possible 10032 (20,7%)
games per active player (>4 games): 5.65 games
games per player: 3.83 games
average games per day: 74,28
N.B. this month had an inactive superclass so 13 of 174 drops were from that class(making dropout actually 29,7% but im counting them anyway)


feel free to draw conclusions from this ez4u:)
admin of the ASR league and KGS admin
User avatar
ez4u
Oza
Posts: 2414
Joined: Wed Feb 23, 2011 10:15 pm
Rank: Jp 6 dan
GD Posts: 0
KGS: ez4u
Location: Tokyo, Japan
Has thanked: 2351 times
Been thanked: 1332 times

Re: what is the ASR doing wrong?

Post by ez4u »

stalkor wrote:
ez4u wrote:I also made a quick histogram of the number of games played...
Image



this is either totally wrong or im totally stupid. there were over a 1000 games last month and your histogram doesnt average out on 30+ games per day.

...feel free to draw conclusions from this ez4u:)

Oh, don't be so hard on yourself! :D Just notice the histogram is the number of people bucketed by the number of games they played. So: 43 people played no games (+0), 30 people played 1 game (+30), 22 people played 2 games (+44),..., and 1 person played 31 games (+31). It all adds up; it is just from running Excel's "histogram" analytical tool across the same list of players. :blackeye:

BTW - I think your method of calculating the average number of games understates the situation by half. In September, for example, although dividing the number of games by the number of players gives us 3.43, from the players' point of view they experienced playing an average of 6.86 games since each game had two players. That's why in my table I showed 2,152 games played instead of 1,076. It's true there were 1,076 wins, but there were also 1,076 losses! ;-)
Dave Sigaty
"Short-lived are both the praiser and the praised, and rememberer and the remembered..."
- Marcus Aurelius; Meditations, VIII 21
User avatar
stalkor
Lives in gote
Posts: 397
Joined: Fri Aug 06, 2010 3:30 pm
Rank: KGS 1d
GD Posts: 0
KGS: stalkor
Location: Netherlands
Has thanked: 102 times
Been thanked: 66 times
Contact:

Re: what is the ASR doing wrong?

Post by stalkor »

ez4u wrote:
stalkor wrote:
ez4u wrote:I also made a quick histogram of the number of games played...
Image



this is either totally wrong or im totally stupid. there were over a 1000 games last month and your histogram doesnt average out on 30+ games per day.

...feel free to draw conclusions from this ez4u:)

Oh, don't be so hard on yourself! :D Just notice the histogram is the number of people bucketed by the number of games they played. So: 43 people played no games (+0), 30 people played 1 game (+30), 22 people played 2 games (+44),..., and 1 person played 31 games (+31). It all adds up; it is just from running Excel's "histogram" analytical tool across the same list of players. :blackeye:

BTW - I think your method of calculating the average number of games understates the situation by half. In September, for example, although dividing the number of games by the number of players gives us 3.43, from the players' point of view they experienced playing an average of 6.86 games since each game had two players. That's why in my table I showed 2,152 games played instead of 1,076. It's true there were 1,076 wins, but there were also 1,076 losses! ;-)


so yeah i am stupid i thought you did days on the horizontal line (DERPDIDERP) and yes i explicitly used the word GAMES everywhere instead of players to point that out. I really dont see the point in saying things in terms of players or points while this histogram is pretty nice to look at it doesnt say anything about what we should do about for example: the dropout rate.

btw its natural that for every win there is an opposite loss but still a player should play 4 games and the number under 4 games just says: a lot of ppl did not succeed in getting over 4 games, and this is true.
admin of the ASR league and KGS admin
User avatar
ez4u
Oza
Posts: 2414
Joined: Wed Feb 23, 2011 10:15 pm
Rank: Jp 6 dan
GD Posts: 0
KGS: ez4u
Location: Tokyo, Japan
Has thanked: 2351 times
Been thanked: 1332 times

Re: what is the ASR doing wrong?

Post by ez4u »

stalkor wrote:... I really dont see the point in saying things in terms of players or points while this histogram is pretty nice to look at it doesnt say anything about what we should do about for example: the dropout rate.

btw its natural that for every win there is an opposite loss but still a player should play 4 games and the number under 4 games just says: a lot of ppl did not succeed in getting over 4 games, and this is true.

I think we look at it a little differently. I try looking at the situation and want to concentrate on the way the people behave. So I am playing with the figures to try and see how they behave now. For example, another figure (not in my table) is the median number of games played per person in September, which was five games. That is only slightly over 1 game a week. Why do only half the people in the league play more games than that? The numbers will not tell us, nor will they tell us what changes to make in order to have different results. However, looking at the numbers in different ways may (only may!) lead us to think of different alternatives to try. And if something new is tried, having more ways of looking at the results may also help understand and evaluate the effect of the change.

One goal of the ASR is to promote playing a lot of games, right? But, how many is a lot? Do the organizers share among themselves a similar understanding of how many games that is? Do the playing members have a similar understanding? Right now (in September at least) 36% of the players achieved 8 or more games (my 2 games a week or more). Another 36% dropped out with less than 4 games. In the middle, the remaining 28% played 4-7 games. I assume that right now people would consider that reducing the dropout rate to 25% would be a more significant change than raising the "2+ games a week" rate to 50%. That is because the dropout rate is calculated and reported each month and is salient in people's minds. However, note that raising the 2+ rate by 14 points would probably require a bigger increase in the number of games played than reducing the dropout rate by 11 points. But which would be easier to achieve? Is it easier to get someone who played 2 games last month to play 4 this month or to get someone who play 6 to play 8 this month? I don't know. Probably no one does right now! They are not necessarily affected by the same issues.
Dave Sigaty
"Short-lived are both the praiser and the praised, and rememberer and the remembered..."
- Marcus Aurelius; Meditations, VIII 21
Post Reply