Skip to content
trawler
Use Trawler

Following a run

The run page — 03 Run — is both the live view and, once the run ends, the report. It refreshes itself every two seconds while the run is live and the tab is visible, and while a defect is being judged again. You can close the tab: the run keeps going, and the page shows where it got to when you come back. The app has no list of past runs yet, so keep the address.

A line such as Run 0001 · Live · app.example.com — the run’s number in the workspace, its status and the product’s host — and a headline:

Status Headline
Queued Waiting for a runner.
Live Your people are using the product.
Complete 2 defects confirmed by replay., None of the reported defects was confirmed. or No defects found.
Stopped at cap The same, starting with Stopped at the cap.
Cancelled You stopped this run.
Failed This run could not finish.

Below it, three figures:

  • Live cost — dollars spent so far, with a bar of $2.00 cap. For a run with a token cap it shows Tokens so far against the 3 million tokens instead.
  • Goals reached — for example 7 / 12: every person times every goal.
  • Confirmed defects.

If the page loses its connection it says Lost contact with Trawler. Retrying…; the run itself is not affected.

Use, Replay, Judge, Report — each marked Waiting, In progress, Done or Skipped. Use is the people’s sessions. Replay and Judge begin only when every person has finished. Once the run has ended, a stage that never ran is Skipped — because the run ended first, or because there was nothing for it to do: a run with no defects has nothing to replay or judge. Judge shows In progress again while a defect is being judged again.

One card per person, with their state:

State Meaning
Waiting Their turn has not come yet.
Exploring They are using the product now.
Goal reached Their session ended with every goal reached.
Goal not reached Their session ended with at least one goal failed.
Finished Their session ended without failing a goal, but not every goal got a status.
Could not finish Their session failed; the reason is shown in red. See Troubleshooting.
Stopped The run ended before their turn came.

Each goal is listed under the person — ✓ reached, ✕ not reached, · no answer yet — with the person’s note about it, and, once they have reported something, a count of their defect reports and friction.

People take their turn one after another: a run works on one session at a time, so at most one card says Exploring. A person’s session ends when they finish, which they may do only once every goal has a status; after 60 steps; when the run stops; or when the session fails. A session cut short by the cap or by Stop ends as Finished or Goal not reached — or Goal reached, if it had already reached them all — with any goals it did not get to still open.

While the run is live, Latest lists the newest eight things that happened: notes the people wrote to themselves, findings as they are reported, goals reached or not, and the judge’s verdicts.

Stop run at the bottom asks Stop now? What was found so far is kept. — choose Stop, or Keep running. Any member of the workspace can stop a run.

Stopping cancels everything still waiting. The session in progress stops the next time it reports in, and nothing after that is replayed or judged. Findings that had reached Trawler stay on the page; defects that were never replayed or judged appear under Not judged, and one whose judge was cut off under Could not be judged.

A run ends on its own when every session, replay and judge has finished — Complete, or Failed if every person’s session failed. It ends early as Stopped at cap when spending reaches the cap: what was still waiting is cancelled and the rest of the page reads as for a stopped run.

When it has ended, the bottom of the page names the model the run used and offers Start another run, which goes back to the plan.