Monitoring Evaluation Progress

It is possible to obtain an overview of which sections have been evaluated, and which are outstanding directly from the eSourcing Console by clicking on Evaluation Status:

Also available via the eSourcing Console is the Project Evaluation Progress Summary available by clicking on Evaluation Progress Report.

On this page, you will see a summary of the evaluations by percentage:

To get an overview of which sections have been evaluated and which are outstanding, from the eSourcing Console, click on Evaluation status.

 

Aggregating Scores

The evaluation process results in individual scores being recorded, but no aggregation or averaging of evaluation takes place.

When all scores have been completed, from the Project page, click the Evaluate Scores button. You will be prompted before this action runs. The action will:

  • calculate (or re-calculate) the weighted average of the scores entered by all Evaluators for all Suppliers Bidding and records the outcome of this calculation on the Supplier Bidding, Response Section and Response pages
  • roll-up the outcome of all Pass/Fail questions such that if any one Pass/Fail question is Failed then the supplier’s Response Section fails
  • make the overall evaluation results visible to system users (individual evaluator scores will not be shared)

 

Supplier Section Scores %

Weighted Average

When the default evaluation scoring algorithm has been selected the following equation is used to calculate the Supplier Section Score for each supplier.

The following equation is used to calculate the Supplier Section Score for each supplier:

       ∑  Mean Average of all Evaluator Scores / Max. Evaluation Score  x  Evaluation Weighting
            -------------------------------------------------------------------------------------------   X 100%
              ∑  Evaluation Max. Score x Evaluation Weighting

The Supplier Score will always be a percentage figure between 0% and 100%.

Sections weightings aren’t percentages (e.g., Section A - weighting 10, Section B - weighting 10, Section C - weighting 20)

       ∑  Supplier Section Score  %  x  Section Weighting 
   --------------------------------------------------------------   x  100%
                           ∑  100  x  Section Weighting

Alternative Evaluation Scoring

There are also the following alternative evaluation scoring algorithms that can be used. The Procurement Procedure determines the algorithm which is used, and in turn the evaluation algorithm used is dictated by the option selected in the procurement procedure template.

 

Updating the procurement procedure template for clients

Weighted as Percentage

Requirement Weighting is used to set the contribution of the requirement to the section (e.g., Requirement 1 - weighting 10 contributes 25%, Requirement 2 - weighting 10 contributes 25%, Requirement 3 - weighting 20 contributes 50%).

The Max score is not included in the contribution of the requirement to the section, unlike in the Weighted Average Algorithm.

         ∑  Mean Average of all Evaluator Scores / Max. Evaluation Score  x  Evaluation Weighting
            -------------------------------------------------------------------------------------------   
              ∑   Evaluation Weighting

*Moderated score used in place of average when present

The Supplier Section Score will always be a percentage figure between 0% and 100%.

 

Weighted Score

Sections weightings total 100 and mark % contribution of each section (e.g., Section A - weighting 50%, Section B - weighting 25%, Section C - weighting 25%).

The following equation is used to calculate the Supplier Score (i.e. the overall score) for each supplier:

       ∑  Supplier Section Score  %  x  Section Weighting %
                                 --------------------------------------------------------------   x  100%
                           ∑  100  x  Section Weighting

TIP The field Weighting on Requirement is a number field but the field Section Weighting (%) is a percentage field.

And as such: Section Weighting (%) is a number between 0 and 1, which makes the maths different, whereas Weighting on Requirement is a number between 0-100 (normally).

 


 

Evaluation Matrix

To view the results of the evaluation, from the Evaluation Status on the eSourcing Console, select Evaluation Matrix Report to run a report summarising each supplier’s overall score by Section.


 

Updated

Was this article helpful?

0 out of 0 found this helpful

Have more questions? Submit a request