Prompt Evaluation Rubric

Score a prompt and response against clarity, grounding, constraint-following, usefulness, and verifiability. This guide treats AI as a drafting and reasoning aid, not as an authority. The goal is to make the task explicit enough that you can review the result against real source information.

The core workflow

1. Task clarity — define this before asking for a polished final response.
2. Context sufficiency — define this before asking for a polished final response.
3. Constraint consistency — define this before asking for a polished final response.
4. Output inspectability — define this before asking for a polished final response.
5. Factual grounding — define this before asking for a polished final response.
6. Revision cost — define this before asking for a polished final response.

What to put in the prompt

For Prompt Evaluation Rubric, start with the exact task and intended user. Then provide the source facts the model cannot safely infer. Put critical requirements close to the task, separate pasted source material from instructions, and say what the response should do when information is missing.

• State one concrete deliverable or decision.
• Supply relevant context and authoritative source material.
• Name facts, commitments, or definitions that must remain unchanged.
• Specify the output structure so the result is easy to inspect.
• Require assumptions, unknowns, or unsupported claims to be visible.

A reusable prompt pattern

How to review the first response

Do not judge the first answer only by whether it sounds polished. For Prompt Evaluation Rubric, review whether the model followed the source, respected the stated limits, and produced something that can be checked. Highlight every claim that depends on a fact, date, number, policy, quote, citation, credential, or technical conclusion.

• Check task clarity.
• Check context sufficiency.
• Check constraint consistency.
• Check output inspectability.
• Check factual grounding.
• Check revision cost.

Common failure pattern

Iterate deliberately

When a response is weak, identify the largest specific failure and revise that instruction. Preserve the parts that are already correct. For Prompt Evaluation Rubric, a useful second pass might add missing source material, tighten one scope boundary, change the requested structure, or require a claim-by-claim verification list.

Practice exercise

1. Choose a real low-risk task you understand well.
2. Write down the expected facts or decisions before prompting.
3. Run the prompt and mark where the response follows, omits, or invents information.
4. Change one instruction and compare the second result.
5. Save the final prompt only after you understand which instruction produced the improvement.

Primary documentation

Put this resource through a real-world test

Use Prompt Evaluation Rubric first on a low-risk task whose correct facts you already know. That gives you a baseline for separating a prompt problem from a model limitation. The goal is not to reward an answer because it sounds polished; the goal is to see whether it respects the information, constraints, and output criteria you supplied.

1. Write down the correct source facts before you run the prompt.
2. Generate one response and highlight statements that cannot be traced to those facts.
3. Identify the single largest failure: missing context, ignored constraint, unsupported inference, wrong format, or excessive verbosity.
4. Revise the instruction that caused that failure while preserving the parts that already worked.
5. Compare the versions and save the prompt only if the improvement is repeatable.

Questions for the final review

• Does the result actually accomplish the purpose of Prompt Evaluation Rubric?
• Can every consequential fact be verified from supplied or authoritative information?
• Are unknowns visible instead of being filled with plausible detail?
• Would a colleague understand the requested output without seeing your original conversation?
• Is human or professional review needed before the result is sent, published, or acted on?

This extra review matters because Score a prompt and response against clarity, grounding, constraint-following, usefulness, and verifiability. A useful education resource should reduce revision and error risk, not simply produce more text. If a response remains unreliable after the task is properly specified, the correct next step may be a better source, a different tool, or human judgment rather than a longer prompt.

Primary references

For current ChatGPT-specific prompting guidance relevant to Prompt Evaluation Rubric, consult OpenAI’s official Prompt engineering best practices for ChatGPT and How do I create a good prompt for an AI model?. Product behavior can change, so current product documentation should take priority over older tips or screenshots.