Skip to content

Mock engagement: POC and evaluation

Modulefield.04 · practice · docs · Pass 11 · 1 to 2 h
You builddocs/engagement/poc.md
Testscourse/tests/field.04 (named below, with why each exists)
Needsnone
Used byno code call site; this is an independent artifact
MilestoneMS-P11
  • Tie each claim to the exact platform evidence that Mock engagement: POC and evaluation produces.
  • State the owner, success condition, and recovery action before declaring the work complete.
  • Record unresolved assumptions so the next review can test them.
Terminal window
ol start field.04
ol tests field.04
ol check field.04

A proof of concept needs a decision at its end. Evaluation criteria chosen after seeing results invite cherry-picking.

Set acceptance thresholds, representative tasks, comparison baseline, data handling, and rollback before the first run. Include operational and safety behavior as well as quality.

Choose a small evaluation set with held-out cases. Compare candidate and baseline under a fixed seed and report quality, latency, cost, refusal behavior, and failure examples. State what the sample cannot establish.

TestKINDChecksWhy it matters downstream
test_artifact_paths_are_declaredartifactConfirms the submitted paths and required evidence exist, so a plausible narrative cannot pass without the reviewable deliverable.
#PitfallSymptomCaught by
1The deliverable records a conclusion without its customer evidenceAnother engineer cannot reproduce the sizing or recommendation.test_artifact_paths_are_declared
2An assumption is written as a measured factThe engagement plan can promise capacity or security the system has not demonstrated.test_artifact_paths_are_declared
3The next owner and decision gate are missingWork stalls at handoff even when the technical work is complete.test_artifact_paths_are_declared
DirectionModuleConnection
Backfield.03Read this declared prerequisite before producing the artifact; use it to verify the relevant contract or evidence.
BackL6.7Read this declared prerequisite before producing the artifact; use it to verify the relevant contract or evidence.
Backag.09Read this declared prerequisite before producing the artifact; use it to verify the relevant contract or evidence.
ResourceWhat to inspect
Mock engagement sequenceCarry the evidence and open decisions into the next customer-facing artifact in the sequence.