Actions
Forum Thread Details
  • Replies 19 replies
  • Subscribers 2564 subscribers
  • Views 2133 views
  • Users 0 members are here
Related

RoadTest Reviews: A Discussion About The Rating System

rscasny

For any RoadTest Review, the reviewer not only provides his or her personal take on the product being reviewed but also a numbered ranking (10-point scale) for 6 different questions.

 

Here is a random example:

 

image

My gut feeling is that  I haven't clarified well enough what the 10-point scale means. As a result, there may be a lack of certainty when giving a grade. In addition, a lot of RoadTesters grade these questions in similar ways. So, I'd like to revisit our grading system. To start here's my idea:

 

  • 10 points: Outstanding
  • 9 points: Very Good Satisfaction
  • 8 points: Good Satisfaction
  • 7 points: Adequate but had to work through some programs
  • 6 points: Needs Work
  • 5 points  Barely Satisfactory
  • 4 points: Below Average
  • 3 points: Unsatisfactory
  • 2 Points:Totally Unsatisfactory
  • 1 point: Time to Rethink

 

I'd like to get the RoadTester Group's opinions on the rating system. Do you think it needs more clarification? Keep it the way it is?

 

Go ahead and suggest your own. Perhaps the problem is that we need to ask different questions?

 

Sincerely,

 

Randall Scasny

RoadTest Program Manager

Parents

  • I tend to agree with the comments that having an "exceed" or "surprise and delight" option is a good idea as that gives balance (i.e. upside and just downside).

     

    However, I would suggest maybe rephrasing some of the questions to make it clearer or have an intro explaining how scoring should be carried out.

     

    So for example "Product performed to expectations" should be rephrased to something like "Degree to which product exceeded or failed to perform to expectations". The "Degree to which..." is now the key focus in the scoring and this part is now common to all questions and could be used as header, or something similar.

Reply

  • I tend to agree with the comments that having an "exceed" or "surprise and delight" option is a good idea as that gives balance (i.e. upside and just downside).

     

    However, I would suggest maybe rephrasing some of the questions to make it clearer or have an intro explaining how scoring should be carried out.

     

    So for example "Product performed to expectations" should be rephrased to something like "Degree to which product exceeded or failed to perform to expectations". The "Degree to which..." is now the key focus in the scoring and this part is now common to all questions and could be used as header, or something similar.

Children
No Data