Conquer Club

Overall Ratings Calculation Bug

Found something broken on the website or in the game, that isn't a plugin enhancement issue? Let's check it out.

Moderators: Beta Team, Tech Team

Forum rules
Please read the Community Guidelines before posting.

And don't forget to search for previously reported bugs first!

Overall Ratings Calculation Bug

Postby degaston on Mon Oct 06, 2014 6:59 pm

Concise description:
  • The Overall rating appears to be calculated incorrectly.

Specifics:
  • User USBrit started a topic because someone gave him an unfair rating.
  • He has received two ratings so far: 5,5,5 and X,1,X
  • His ratings summary is:
    • Fair Play: 5
    • Gameplay: 3
    • Attitude: 5
    • Overall: 3
  • It appears that the Overall rating is being calculated by averaging the average rating given by each player. This does not take into account the fact that sometimes they give no rating for a category.
  • In this case, his Overall rating should be 4, but simply averaging the three categories could also produce a more reasonable rating of 4.3
User avatar
Brigadier degaston
 
Posts: 628
Joined: Fri Apr 01, 2011 10:12 am
Medals: 15
Standard Achievement (2) Doubles Achievement (2) Triples Achievement (1) Manual Troops Achievement (1) Nuclear Spoils Achievement (1)
Fog of War Achievement (2) Trench Warfare Achievement (1) Cross-Map Achievement (1) Ratings Achievement (2) General Achievement (2)

Re: Overall Ratings Calculation Bug

Postby Metsfanmax on Mon Oct 06, 2014 7:06 pm

degaston wrote:Concise description:
  • The Overall rating appears to be calculated incorrectly.

Specifics:
  • User USBrit started a topic because someone gave him an unfair rating.
  • He has received two ratings so far: 5,5,5 and X,1,X
  • His ratings summary is:
    • Fair Play: 5
    • Gameplay: 3
    • Attitude: 5
    • Overall: 3
  • It appears that the Overall rating is being calculated by averaging the average rating given by each player. This does not take into account the fact that sometimes they give no rating for a category.
  • In this case, his Overall rating should be 4, but simply averaging the three categories could also produce a more reasonable rating of 4.3


It's not a bug, strictly speaking. This has been discussed before and it was seen as intended behavior. It may not be the most optimal, so move to Suggestions if you want it to change.
User avatar
Lieutenant Metsfanmax
 
Posts: 5273
Joined: Wed Apr 11, 2007 11:01 pm
Location: NY
Medals: 43
Standard Achievement (3) Doubles Achievement (2) Triples Achievement (1) Quadruples Achievement (1) Terminator Achievement (1)
Assassin Achievement (1) Manual Troops Achievement (2) Freestyle Achievement (1) Nuclear Spoils Achievement (1) Fog of War Achievement (3)
Trench Warfare Achievement (1) Speed Achievement (3) Teammate Achievement (1) Random Map Achievement (1) Cross-Map Achievement (1)
Battle Royale Achievement (1) Ratings Achievement (2) Tournament Achievement (1) General Achievement (7) Clan Achievement (2)
General Contribution (7)

Re: Overall Ratings Calculation Bug

Postby degaston on Mon Oct 06, 2014 7:40 pm

Metsfanmax wrote:It's not a bug, strictly speaking. This has been discussed before and it was seen as intended behavior. It may not be the most optimal, so move to Suggestions if you want it to change.

I doubt that this was really the intended behavior - someone probably just didn't think about it when it was coded, and now they don't want to change it.
But it doesn't really affect me, so I'm not going to bother making another suggestion that I know won't go anywhere.
User avatar
Brigadier degaston
 
Posts: 628
Joined: Fri Apr 01, 2011 10:12 am
Medals: 15
Standard Achievement (2) Doubles Achievement (2) Triples Achievement (1) Manual Troops Achievement (1) Nuclear Spoils Achievement (1)
Fog of War Achievement (2) Trench Warfare Achievement (1) Cross-Map Achievement (1) Ratings Achievement (2) General Achievement (2)

Re: Overall Ratings Calculation Bug

Postby Metsfanmax on Mon Oct 06, 2014 9:22 pm

degaston wrote:
Metsfanmax wrote:It's not a bug, strictly speaking. This has been discussed before and it was seen as intended behavior. It may not be the most optimal, so move to Suggestions if you want it to change.

I doubt that this was really the intended behavior - someone probably just didn't think about it when it was coded, and now they don't want to change it.


*shrug* I can't know what lack was really thinking at the time. All I can say is that there is a legitimate argument for averaging player ratings rather than individual ratings, and since it is a question of design choice, it is not relevant for this forum.
User avatar
Lieutenant Metsfanmax
 
Posts: 5273
Joined: Wed Apr 11, 2007 11:01 pm
Location: NY
Medals: 43
Standard Achievement (3) Doubles Achievement (2) Triples Achievement (1) Quadruples Achievement (1) Terminator Achievement (1)
Assassin Achievement (1) Manual Troops Achievement (2) Freestyle Achievement (1) Nuclear Spoils Achievement (1) Fog of War Achievement (3)
Trench Warfare Achievement (1) Speed Achievement (3) Teammate Achievement (1) Random Map Achievement (1) Cross-Map Achievement (1)
Battle Royale Achievement (1) Ratings Achievement (2) Tournament Achievement (1) General Achievement (7) Clan Achievement (2)
General Contribution (7)

Re: Overall Ratings Calculation Bug

Postby king achilles on Mon Oct 06, 2014 10:48 pm

I can say that it looks wrong but you know, 5 & 1 ratings from 2 people, maybe the 3 average has something in there. Maybe the more ratings he will get, the further his ratings will get 'valid'.
Nevertheless, I would have to agree with Metsfanmax here. Although, the report looks legitimately arguable, the coding for this has not been touched or edited. And since there are far more important updates and a lot of to do things that the webmaster still has in store, the ratings system/encoding will remain as it is.
User avatar
General king achilles
Support Admin
Support Admin
 
Posts: 11100
Joined: Wed Jun 13, 2007 10:55 pm
Medals: 16
Standard Achievement (2) Terminator Achievement (1) Fog of War Achievement (1) Trench Warfare Achievement (1) Speed Achievement (1)
Random Map Achievement (1) Cross-Map Achievement (1) Beta Map Achievement (1) Bot Achievement (3) Ratings Achievement (1)
Tournament Achievement (1) General Achievement (1) General Contribution (1)

Re: Overall Ratings Calculation Bug

Postby betiko on Tue Oct 07, 2014 11:13 am

So how is it calculated?
Player x gives 5 average (all 3 categories) and player y gives 1 average (1 category) -> 3 average rating
So basically there is no point in filling all 3 categories, unless you want to give the person say a 1.66 average?
Image
User avatar
Colonel betiko
 
Posts: 7799
Joined: Fri Feb 25, 2011 3:05 pm
Location: J'vais vous montrer qui c'est Raoul
Medals: 160
Conquer Cup Gold Achievement (1) Standard Achievement (4) Doubles Achievement (3) Triples Achievement (3) Quadruples Achievement (3)
Terminator Achievement (2) Assassin Achievement (3) Manual Troops Achievement (3) Freestyle Achievement (3) Polymorphic Achievement (2)
Nuclear Spoils Achievement (3) Fog of War Achievement (4) Trench Warfare Achievement (3) Speed Achievement (4) Teammate Achievement (2)
Random Map Achievement (3) Cross-Map Achievement (4) Beta Map Achievement (2) Battle Royale Achievement (2) Bot Achievement (4)
Ratings Achievement (4) Tournament Achievement (17) General Achievement (30) Clan Achievement (12) Training Achievement (2)

Re: Overall Ratings Calculation Bug

Postby degaston on Tue Oct 07, 2014 11:40 am

betiko wrote:So how is it calculated?
Player x gives 5 average (all 3 categories) and player y gives 1 average (1 category) -> 3 average rating
So basically there is no point in filling all 3 categories, unless you want to give the person say a 1.66 average?

It appears that in the situation described, it takes the average rating from player x (5) and the average rating from player y (1) and averages those two together to get 3. It ignores the fact that player y only rated in one category.

Once someone has several ratings, it probably becomes unnoticeable, but for new players who only have a couple of ratings, it's just one more thing that might piss them off and make them decide to try another site where they know how to calculate an average correctly. Oh well - at least we have conquer stars!
User avatar
Brigadier degaston
 
Posts: 628
Joined: Fri Apr 01, 2011 10:12 am
Medals: 15
Standard Achievement (2) Doubles Achievement (2) Triples Achievement (1) Manual Troops Achievement (1) Nuclear Spoils Achievement (1)
Fog of War Achievement (2) Trench Warfare Achievement (1) Cross-Map Achievement (1) Ratings Achievement (2) General Achievement (2)

Re: Overall Ratings Calculation Bug

Postby Metsfanmax on Tue Oct 07, 2014 1:09 pm

degaston wrote:Once someone has several ratings, it probably becomes unnoticeable, but for new players who only have a couple of ratings, it's just one more thing that might piss them off and make them decide to try another site where they know how to calculate an average correctly. Oh well - at least we have conquer stars!


Yes, clearly we can just average together fair play and game play and attitude together and just get a number out right? Who cares if it means anything. It's an average! And there's only one way to do it. Let's make sure that this person has 4.8 just like everyone else, so we can be satisfied that the ratings system is working properly.
User avatar
Lieutenant Metsfanmax
 
Posts: 5273
Joined: Wed Apr 11, 2007 11:01 pm
Location: NY
Medals: 43
Standard Achievement (3) Doubles Achievement (2) Triples Achievement (1) Quadruples Achievement (1) Terminator Achievement (1)
Assassin Achievement (1) Manual Troops Achievement (2) Freestyle Achievement (1) Nuclear Spoils Achievement (1) Fog of War Achievement (3)
Trench Warfare Achievement (1) Speed Achievement (3) Teammate Achievement (1) Random Map Achievement (1) Cross-Map Achievement (1)
Battle Royale Achievement (1) Ratings Achievement (2) Tournament Achievement (1) General Achievement (7) Clan Achievement (2)
General Contribution (7)

Re: Overall Ratings Calculation Bug

Postby dgz345 on Wed Oct 08, 2014 7:42 am

Fair Play Star 4.9 (rated by 461 players)
Gameplay Star 4.9 (rated by 462 players)
Attitude Star 4.9 (rated by 461 players)
Overall Star 4.9 (rated by 465 players)

this is mine. so Overall do not work as you think it will.

just one guess how it could work. it takes the average from each player and then divide.
so in the 5,5,5 X,1,X example it would be that playera gave 5 and playerb gave 1 so the overall average is 3
User avatar
Lieutenant dgz345
Head Tech
Head Tech
 
Posts: 1073
Joined: Thu Oct 07, 2010 10:53 am
Medals: 48
Conqueror Achievement (1) Conquer Cup Gold Achievement (1) Standard Achievement (2) Doubles Achievement (2) Triples Achievement (2)
Quadruples Achievement (2) Terminator Achievement (1) Assassin Achievement (1) Manual Troops Achievement (2) Freestyle Achievement (2)
Polymorphic Achievement (1) Nuclear Spoils Achievement (1) Fog of War Achievement (3) Trench Warfare Achievement (2) Speed Achievement (1)
Teammate Achievement (1) Random Map Achievement (2) Cross-Map Achievement (3) Beta Map Achievement (1) Ratings Achievement (4)
Tournament Achievement (2) General Achievement (5) Clan Achievement (3) Challenge Achievement (2) General Contribution (1)


Return to Bug Reports

Who is online

Users browsing this forum: No registered users

cron