Finishing the course

Your final assignment

Create an evaluation report that explains failure types and limits. Use the fictional examples from this course, or a non-sensitive scenario you are authorised to work on. Do not submit personal workplace records to complete the course.

Build your evidence pack

1. Golden sets and test contamination: Draft a ten-case golden set outline with normal, ambiguous and unsupported questions. Reserve some cases from prompt tuning and write how their answers will be established.
2. Rubrics and disagreement between reviewers: Write a three-criterion rubric with clear pass/fail anchors and one critical failure. Score two fictional answers that trade elegance against factual support.
3. Pairwise comparisons and order effects: Design a blind comparison sheet with criterion, order, preferred answer, reason and a both-unacceptable option. Use two outputs with different failure types.
4. Adversarial tests and subgroup failures: Write four harmless stress cases: conflicting dates, an unsupported request, an injected instruction and a meaning-preserving language variation. Define expected behaviour for each.
5. Uncertainty, abstention and release decisions: Write a release note reporting both 57/60 supported answers and 60/100 coverage. Name one investigation needed before deciding whether to expand access.

Combine the five outputs in the downloadable course workbook. Write a short decision note explaining the problem, your chosen approach, the evidence used and one limitation that would matter in real use. Keep initial and revised versions where a check changed your answer.

Review against these criteria

• Keep evaluation cases independent enough to remain informative.
• Make a quality judgement inspectable.
• Compare outputs without letting presentation decide the winner.
• Look for failure conditions beyond the average case.
• Let a system stop when the evidence is insufficient.

Ask a colleague or learning partner to challenge one assumption if available. If working alone, use the worked examples to review your reasoning and record the limits of that self-review. Completion is a personal learning record, not independent certification.

Change one condition

Choose one input or assumption from your original exercise and change it. Explain which part of the result must be recalculated, rechecked or withheld. Keep the revised answer and a short explanation of why the change matters. This is a transfer exercise: repeating the model answer without adapting it is insufficient.

Continue practising

Try a related Academy workspace or choose another course. The existing Practice Lab portfolio saves simulation work; keep this course workbook with your own learning records. Course completion progress remains in your browser and can be backed up through My Library.