SGT University · Leadership Development Programme for Academic Leaders

Research Portfolio Evaluation Rubric

Session FN 2 · Leading Research for Relevance, Quality and Impact · Rubric, scoring bands, table worksheet and commitment card
Day 3 · FN 2
Presenter: Dr. Shalini Kapoor

Each criterion is scored 1 to 5 using the descriptors. The four criterion scores are added to give a total out of 20. Scores are a structure for discussion, not a formula that replaces judgement; a table may fund a lower-scoring case if it can say why.

Rubric

Criterion12345
Quality
Rigour of design, appropriateness of methods, capacity of the team to execute to a standard others will trust
Design cannot answer the question; no methodological support; team has no relevant track recordDesign has known weaknesses that are not addressed; limited prior workSound design for the question; team has published relevant work; methodological support identifiedStrong design with risks acknowledged and mitigated; team has a recognised track record; ethics and data plans in placeDesign is at the standard of the best work in the field; independent review already obtained; team has led comparable studies
Relevance to national priorities
Fit with a stated national, state, sector or community problem
No connection to any stated priority; problem chosen for conveniencePriority is named but the link is nominalAddresses a stated priority (mission, programme, SDG, state plan) with a plausible contributionAddresses a stated priority and a specific gap that a programme or partner has identifiedAddresses a priority at the request of, or in partnership with, the body responsible for it
Potential impact
Credibility of the route from output to outcome to impact; reach and significance
No user or partner; outputs are the end of the storyA possible user is mentioned but not engagedA user is identified and has expressed interest; outcome is describedA partner is committed in writing; outcome and impact are described with a realistic timelineA partner is co-designing the work and has a decision that depends on the result; reach beyond the immediate partner is plausible
Feasibility
Whether this team, in this institution, with this budget and time, can deliver
Budget, time or capacity clearly insufficient; critical dependencies unsecuredMajor dependencies unsecured (ethics, access, key facility)Deliverable with identified risks; main dependencies securedDeliverable with contingency; dependencies secured; budget realisticDeliverable with margin; team has delivered projects of this size before

Scoring bands

Total (out of 20)BandRecommended decision
17 to 20ConsequentialFund at full value; consider as a flagship for an external proposal
13 to 16PromisingFund with conditions that address the lowest-scoring criterion
9 to 12DevelopmentalReturn for revision with mentoring; consider a smaller pilot grant
4 to 8Not readyDecline; redirect the team to capacity-building support

Table worksheet (11 minutes)

Record the table's consensus score on each criterion and the total for each case.

CriterionCase 1 · Salivary biomarkersCase 2 · Retinal imagesCase 3 · Insurance utilisation
Quality
Relevance to national priorities
Potential impact
Feasibility
Total (out of 20)
Band
Ranking
Position in Pasteur's Quadrant
Bohr · Pasteur · Edison · lower-left
The one case the table would fund at full value
Two sentences of justification that refer to the rubric
If this is not the highest-scoring case, why
What could reduce the chosen case's main risk within the grant

Commitment card

One change to assessment or funding practice I could begin before the next term

Who must approve it

Who would object, and the answer to them

What will be observably different in six months