User Scoring and Ranking Guide

Laying the groundwork for your tester scoring system

User Scoring is a vital part of a successful Customer Validation program. By establishing a scoring system for your users, you’ll be able to easily (and automatically) identify top contributors or noncompliant participators. As a Community administration tool, you’ll find the User Scoring configuration at the Community level, but options to use Scoring at both the Community and Project scopes.

User Scoring consists of Rankings - individual values representative of positive (feedback submission, excellent participation, special events) or negative (non-compliance, NDA breach, non-responsiveness) user account milestones. Separated by the Community and Project scope, you’ll leverage the individual Rankings to score your user accounts for scope-specific intentions like tester participation quality at the Community level or providing a high-quality bug report within a Project.

Creating new rankings lets you fine-tune your User Scoring program system beyond what’s provided in the Centercode Templates. Merging Rankings will update every instance of the old ranking, causing user scores to be recalculated based on the new value. This offers great flexibility when scaling your ranking system to meet the evolving goals of your growing CV program or when simply cleaning up your list as a matter of housekeeping.

Once User Ranking has been established, it can be applied to any User account manually via User Summary and automation macros. 

Creating and Updating Your Existing User Scoring

Creating new rankings lets you fine-tune your User Scoring program system beyond what’s provided in the Centercode Templates. User Scoring consists of Rankings - individual values representative of positive (feedback submission, excellent participation, special events) or negative (non-compliance, NDA breach, non-responsiveness) user account milestones.

Separated by the Community and Project scope, you’ll leverage the individual Rankings to score your user accounts for scope-specific intentions like tester participation quality at the Community level or providing a high-quality bug report within a Project.

To create or update your existing user scoring: 

  1. Access Community Tools, then Configuration
  2. Click User Scoring
  3. Adjust Community and Project scopes to suit your scoring processes
  • Use default options to utilize our recommended ranking
  • Create new rankings and fill out the required fields if desired
  • Merge to update the selected rank to a new value if desired

Edit, merge, or create new rankings to suit your practices

Example Merging Scenario

Merging Good Effort (+15) into Actively Engaged (+20) will update any pre-existing rankings and scores for any instance of Good Effort (+15) previously granted to users. 

Tester A - Community score - 40 points 

  • 2x Good Effort (+15) 
  • 1x Average Participation (+10) 

Good Effort (+15) merged with Actively Engaged (+20)

Tester A - new Community score  - 50 points

  • 2x Actively Engaged  (+20)
  • 1x Average Participation (+10)

To Merge an existing ranking: 

  1. Access Community Tools, then Configuration
  2. Click User Scoring
  3. Merge to update the selected rank to a new value if desired
  • Merged ranks will update every use of the old rank, causing user scores to be recalculated based on the new value.

Scoring Your Users Ad-Hoc

As your CV program progress, you may find yourself in need of adjusting individual user scores  based on performance and participation. User Summaries contains the Performance tab where you can manually adjust user score at both scopes. 

To manually adjust a user’s score:

  1. From your Project, search the user via Knowledge Base Search or User Management to access the user’s summary
  2. Click the Performance tab
  3. Select the scope of the score you’ll apply
  4. Select the ranking to apply from the dropdown menu
  5. Feel free to add a comment, which can utilized via Filters and Views
  6. Click Submit to save

Access user’s summary to add Project and Community scoring

Enabling Centercode’s Default User Scoring Automation

Use Centerocode's scoring best practices

The fixed CV2 Template  available in your portal contains User and Feedback Macros for you to utilize. A Macro is a single instruction that expands automatically into a set of instructions to perform a particular task. In this use case, we're adjusting user score. The User Macro provided grants users +1 point for logging in daily. The Feedback Macros provided grant users +points for providing Bug Reports, Suggestions, and Private Journals. 

These macros simply need to be activated if your Project is based off of the CV2 Template, which distills decades of collective Customer Validation experience and proven methodologies into a framework.

To activate any of these macros:

  1. Click Users or Feedback Type (Bug ReportsSuggestionsPrivate Journals
  2. Click Moderate Macros or Manage Feedback Macros & Automation 
  3. Click Moderate Macro Schedules or Automate Feedback (Scheduled and Triggered Macros)
  4. Hover over and click Archive to move the macro from Archive State to Active State
  • Feel free to adjust any settings and preferences to suit your needs

Activate provided macros to start scoring users!

Notes

  • Community scoring should be used to track overall user contribution or major, program-level milestones of account activity. 
  • Project scoring should track user contribution throughout individual Projects. Project score should be used to “boil up” participation and contribution scoring to the Community. This allows you to develop a fully profiled and scored panel of engaged testers for easier tester recruitment.
Did this answer your question?