after.machines

The words we test by.

26 words from this site in plain English: the phases, the eight checks every build is crashed into, the record you receive and the parts of a workflow.

How to read an entry

  1. WordThe word as this site uses it.
  2. Also calledWhat other teams call the same thing.
  3. MeaningOne or two plain sentences.
  4. WhereThe page where it shows up in the work.
01 The phases9 words

From the free call to the optional retainer.

Free workflow review

Also called: Discovery call

A free 30-minute call. You bring one workflow that costs time, money or attention, and leave with one candidate workflow, a fit decision and the next step. Nothing is built or run on it.

WhereBook one

Diagnostic Sprint

Also called: Discovery, audit

The first paid phase. It fixes the workflow, the outcome, the scope and the stop point before any build money is at risk. You keep the workflow map, baseline, ROI case and priority action plan, even if you stop there.

WhereWhat we build

Linked fromWhat we build

System Build

Also called: Implementation

The phase where the automation is built. Every check that applies runs on test data before the system touches real data, and a failing check blocks handover.

WhereWhat we build

Linked fromHow we testWhat we buildProcess

Stabilization

Also called: Hypercare

The 14 days after launch that come with every System Build, before the system is left to run on its own.

WhereWhat we build

Optimization Retainer

Also called: Maintenance plan

An optional monthly phase: monitoring, a monthly health review with the last run date per check, and one improvement cycle. The checks run again after any model or prompt change, and at least every 90 days.

WhereWhat we build

Linked fromWhat we build

Stop point

Also called: Go or no-go decision

The decision that ends a phase. Say yes and the next phase starts. Say no and it ends there. Every phase has one, and the decision is yours.

WhereFive gates

Linked fromWhat we build

Acceptance

Also called: Sign-off

The written scope is met and every check that applies has passed. Only then is a system handed over.

WhereGate 3

Handover

Also called: Transfer

Your team gets the system, the stress-test record, the documentation, the runbook and a named owner. Your team owns the workflow, code, configuration, prompts and data, and production accounts stay under your control.

WhereGate 4

Linked fromHow we testWhat we buildProcess

Runbook

Also called: Operating guide

A short document that tells your team how to run the system day to day and what to do when a step fails. It is part of every handover, so the system stays operable without us.

WhereWhat we build

Linked fromWhat we buildProcess

02 The eight checks8 words

What every build is crashed into.

Test set

Also called: Eval set, golden set, labeled test cases

A fixed set of labeled cases with the right answer written down first. Every result is compared with it, so a change that breaks an answer shows up before it ships.

WhereThe 8 checks

Linked fromHow we testWhat we buildWhat we automate

Prompt attack

Also called: Prompt injection

A test input with hidden instructions inside it, such as a lead form that tells the AI to ignore its rules. The workflow must ignore them or flag them.

WhereThe 8 checks

Linked fromHow we testWhat we buildWhat we automate

Load and limits

Also called: Load test, rate limits, spend caps

The workflow runs at its own maximum batch size, and it has limits on input size, items per run, sending speed and AI spend.

WhereThe 8 checks

Linked fromHow we testWhat we buildWhat we automate

03 The record5 words

What you receive and how to read it.

Stress-test record

Also called: QA record, test report

The record delivered with every System Build: dated, one row per check, counts only, never your data. Each row carries one of the status words.

WhereThe record

Linked fromHow we testWhat we buildProcess

Status words

Also called: Test status

The four words a record row can carry. Passed: a dated, recorded run met the check's bar. Not yet: the run has not happened. Not needed: the check does not apply, and the row says why. Stopped: the check stopped the record, and the row says what happened next.

WhereThe record

Not needed

Also called: Not applicable

A check is marked Not needed for one of four reasons only: there is no AI step, the AI sees only numbers our code computed, the workflow writes and sends nothing, or it stays inside your team.

WhereThe 8 checks

Model-review date

Also called: Model version check

The date each AI step's model was last reviewed. It is recorded for every AI step, and the checks run again before any model swap.

WhereThe AI steps

Linked fromWhat we buildProcess

Stress tested mark

Also called: Certification

The mark a workflow carries only while its checks are current. It comes off when the last run is older than 90 days, or older than the latest model or prompt change.

WhereHow we test

04 Inside a workflow4 words

The parts you will see on a drawing.

Fixed rule

Also called: Deterministic step, business rule

A step that checks, decides or routes the same way every time, written down in advance. Rules run before and after every AI step.

WhereThe live workflow on home

Linked fromHow we testWhat we automate

Parked item

Also called: Dead-letter queue, exception queue

An item that still failed after its retries, set aside for a person with the failed step named, so nothing is lost or sent half done.

WhereThe live workflow on home

05 In use19 of 26 words linked

Where each word is used.

Every page below links the first use of a word back to its card here. A filled square is a page where you can read the word in context. An empty row is a word with its own card that no other page links to yet.

Glossary words and the pages that link to them
WordHow we test15 wordsWhat we build19 wordsProcess6 wordsWhat we automate10 wordsPages
Free workflow reviewNot linkedNot linkedNot linkedNot linked0
Diagnostic SprintNot linkedDiagnostic Sprint is linked from What we buildNot linkedNot linked1
System BuildSystem Build is linked from How we testSystem Build is linked from What we buildSystem Build is linked from ProcessNot linked3
StabilizationNot linkedNot linkedNot linkedNot linked0
Optimization RetainerNot linkedOptimization Retainer is linked from What we buildNot linkedNot linked1
Stop pointNot linkedStop point is linked from What we buildNot linkedNot linked1
AcceptanceNot linkedNot linkedNot linkedNot linked0
HandoverHandover is linked from How we testHandover is linked from What we buildHandover is linked from ProcessNot linked3
RunbookNot linkedRunbook is linked from What we buildRunbook is linked from ProcessNot linked2
Test setTest set is linked from How we testTest set is linked from What we buildNot linkedTest set is linked from What we automate3
Prompt attackPrompt attack is linked from How we testPrompt attack is linked from What we buildNot linkedPrompt attack is linked from What we automate3
Run twiceRun twice is linked from How we testRun twice is linked from What we buildNot linkedRun twice is linked from What we automate3
Failure recoveryFailure recovery is linked from How we testFailure recovery is linked from What we buildNot linkedFailure recovery is linked from What we automate3
Load and limitsLoad and limits is linked from How we testLoad and limits is linked from What we buildNot linkedLoad and limits is linked from What we automate3
Failure alertFailure alert is linked from How we testFailure alert is linked from What we buildNot linkedFailure alert is linked from What we automate3
Human sign-offHuman sign-off is linked from How we testHuman sign-off is linked from What we buildNot linkedHuman sign-off is linked from What we automate3
Rules around the AIRules around the AI is linked from How we testRules around the AI is linked from What we buildNot linkedRules around the AI is linked from What we automate3
Stress-test recordStress-test record is linked from How we testStress-test record is linked from What we buildStress-test record is linked from ProcessNot linked3
Status wordsNot linkedNot linkedNot linkedNot linked0
Not neededNot linkedNot linkedNot linkedNot linked0
Model-review dateNot linkedModel-review date is linked from What we buildModel-review date is linked from ProcessNot linked2
Stress tested markNot linkedNot linkedNot linkedNot linked0
AI stepAI step is linked from How we testAI step is linked from What we buildAI step is linked from ProcessAI step is linked from What we automate4
Fixed ruleFixed rule is linked from How we testNot linkedNot linkedFixed rule is linked from What we automate2
Parked itemNot linkedNot linkedNot linkedNot linked0
FallbackFallback is linked from How we testFallback is linked from What we buildNot linkedNot linked2

Every one of these words shows up on the call.

Bring one workflow. In 30 minutes you hear which of the eight checks it would face, and whether it is worth building.

Book a free workflow review See the 8 checks in full