LOR Ratings: No Basis for Judgment Explained
Distinguish missing observations, tiny comparison groups and real reservations when completing graduate reference ratings and the accompanying letter.
LOR Ratings: No Basis for Judgment Explained
A graduate referee should not invent a comparison merely to avoid an unavailable-judgment response. Read the exact question, identify the relevant people and observations, and use the form's available response or explanation when the basis is missing. A small group, an unobserved quality and a genuine reservation are different situations.
Our recommendation is to explain the basis you do have, without pretending it supports every question. A strong narrative can describe substantial work while acknowledging the limits of a particular comparison. It cannot guarantee how an admissions committee will interpret a missing rating.
This guide addresses graduate recommendation forms and their accompanying narratives. It does not choose ratings for a writer or supply a universal rule across application systems.
What the actual forms distinguish
Stanford's graduate recommendation form asks for the comparison group, years evaluating it and approximate population size before an overall-ability rating. It includes “No basis for judgment.” The letter is a separate assessment, and program-specific wording can differ.
Cambridge's academic referee guidance asks about relative academic performance and comparison-group size, with an opportunity to explain inability to rate. It also requests a reference letter. That explanatory opportunity should not be assumed to exist in every university's form.
These structures make the denominator part of the answer. Choosing a favorable category first and constructing a population afterward reverses the task. Start with what the question actually asks and what your experience can support.
Do not infer an admissions penalty or immunity from the presence of an option. A form can permit an answer without publishing how every committee will weigh it alongside other evidence.
Separate three problems before you respond
| Situation | What is missing? | Useful next question |
|---|---|---|
| You did not observe the requested quality | Relevant evidence | Does the form permit an unavailable judgment or explanation? |
| You know the applicant well but have a very small peer group | A broad comparative basis | Can you describe the real population without overstating its precision? |
| You observed a difficulty or limitation | Nothing necessarily; the evidence may be mixed | What accurate assessment and context does the question request? |
These situations can coexist. A summer supervisor may know an applicant's analytical work well, have supervised only two comparable people and have never observed teaching. That does not require the same response to all three questions.
The PhD recommendation guide explains why specific evidence matters in the narrative. Here, the narrower task is preventing a comparative rating from claiming more knowledge than the writer possesses.
Constructed case: an unobserved quality
The cases here are original illustrations, not real reference forms or admissions outcomes.
A research supervisor works closely with an applicant on data analysis. They discuss assumptions, examine an unexpected result and review a written report. The supervisor has strong evidence about analytical reasoning but has never observed the applicant teach or explain material to a novice.
If a form asks about teaching, the supervisor should read what that item means before responding. The applicant's clear report does not automatically establish teaching ability. The writer can distinguish a quality they observed from one they have not had a chance to assess.
Where an unavailable-judgment option or explanatory field exists, that may be the appropriate way to express the limit. In the narrative, the writer can still give a precise account of the analytical work. They need not weaken every conclusion merely because one dimension was unobserved.
Nor should the applicant arrange a superficial demonstration solely to manufacture a rating. A brief presentation may provide some new evidence, but it should not be described as a sustained teaching relationship. The letter must keep the observation window proportionate to the claim.
For clinical psychology, a related situation arises when a practice supervisor knows professional conduct but has not observed research. The clinical-versus-research referee guide helps decide whether that person fills an appropriate role in the complete reference set.
Constructed case: excellent work in a comparison group of two
A new faculty member has directly supervised two master's students. One applicant completed a thoughtful project and responded well to criticism. The faculty member feels confident recommending them but is uncomfortable assigning a precise top percentile.
The solution is not to inflate the population to include every student who attended a lecture, every colleague at the institution or researchers known only through publications. Those people may not match the question or have been evaluated on comparable work.
Our recommendation is to report the real basis where the form asks for it and describe the quality of the project directly. Being the stronger of two observed researchers is a different statement from belonging to a measured top fraction of a large population. The latter implies comparative knowledge the writer may not possess.
A small group does not erase the value of close observation. The faculty member can explain the independence the applicant demonstrated, the difficulty of the work and the response to feedback. Those are useful claims when supported by actual interactions.
If the form forces a comparative choice that the writer cannot responsibly make and provides no suitable option, ask the receiving program how to handle the item. Do not ask the applicant which rating would look best. The uncertainty concerns the writer's ability to answer the form accurately.
Constructed case: a reservation is not missing information
A third supervisor has observed an applicant miss agreed milestones and initially resist feedback. Over several months, the applicant improves their planning and begins raising difficulties earlier. The supervisor has evidence of both a limitation and subsequent development.
This is different from never observing the quality. Selecting an unavailable judgment simply to avoid a less favorable assessment would conceal the nature of the evidence. The writer should answer the actual question candidly and use the narrative to explain the relevant context and trajectory.
That does not mean every imperfection belongs in every paragraph. The task is an accurate assessment of what the form asks, supported by specific observations. A bounded account of development is more informative than either exaggerated perfection or a vague warning without explanation.
If the supervisor cannot provide the recommendation they agreed to supply, they should communicate appropriately with the applicant while there is time to consider another eligible writer. The applicant should not attempt to negotiate the contents of a confidential evaluation.
A practical sequence for the writer
Work through the form in this order:
- Read the item and its response options. Do not assume all questions use the same comparison or time period.
- Identify the population you actually evaluated. Keep the people, setting and period aligned with the question.
- Locate the relevant observations. Distinguish firsthand evidence from a CV, another person's report or general reputation.
- Separate absence from reservation. Missing evidence and mixed evidence should not be disguised as each other.
- Use the available explanation accurately. Where appropriate, state the scope and limits without inventing precision.
- Review the narrative for consistency. A letter claiming extensive direct supervision should not conceal a very brief or indirect relationship.
This process does not generate a numerical answer. It helps the writer recognize which conclusions their evidence can and cannot support. The outside-field reference guide covers the related problem of relevant experience that does not justify comparison within the applicant's new discipline.
Is a blank rating from Interfolio the same problem?
No. A writer who cannot assess a quality and a dossier service that does not answer optional fields create different situations. One concerns knowledge; the other concerns the permitted delivery mechanism.
Read the Interfolio and graduate forms guide before assuming that a stored letter can complete a particular application. Do not fill in recommender-only ratings as the applicant to compensate for a delivery service's limitations.
What applicants can usefully do
Applicants can choose eligible writers with substantial relevant knowledge, provide accurate background and allow enough time for a thoughtful response. They can share the program's public guidance and ask whether the person feels able to write a substantive recommendation.
They should not supply a preferred rating, invent a comparison group or request the confidential letter to check whether it is enthusiastic enough. A recommender's independent perspective is part of the document's purpose.
Review the narrative, not the checkboxes
The academic recommendation rubric, available through recommendation letter review, addresses a supported writer-authored narrative. It does not grade portal ratings or predict the effect of an unavailable judgment. Applicants may share the public guide with their writer.
Our recommendation-letter collection covers adjacent questions. The useful goal is a recommendation whose confidence matches its evidence, including the places where that evidence has limits.
Primary guidance checked September 17, 2026. Cases and the decision procedure are original GradPilot illustrations.
Review the Letter Before It Is Submitted
See how the letter reads against the rubric for its destination.