routerflow.artthe marketour probecomparemethodologyprobestaxonomyprober methodapi/v12026-09-22

The probes: what we send, to whom, and why

The prober sends a small set of fixed, versioned requests through OpenRouter and records what came back: the bill, the cached tokens the provider reported, timing, who served the request, and whether the answer was right. This page is generated from the files the prober reads, so it is the prompts as sent, not a description of them. Method and analysis: prober method. Prior work this builds on: Chitra, "The Souq" (2026).

Two kinds of request

Every request starts with a session header line (Session <id> · workspace /work/ledgerline) that is new for each session. The first request of a session therefore cannot hit any cache, and nothing an earlier session warmed can leak into a measurement.

The jobs

JobWhat is sentPinned to a provider?CadenceExpected a day
Cache pair, panel Aone request, then the identical request again, a one-word answer, streamed. The text rotates between three families: the coding digest, a generated ledger, a canary passageyes, fallbacks off3 times a day, every endpoint (203)$5.50
Cache pair, panel Bthe sameyeseach model every third day (404 endpoints in total)$0.90
Reprice-event pairthe same pair, sent to a provider the moment it cuts its input price and to the model builder's own endpoint at the same momentyeson events from the 5-minute quote poll, at most 4 per endpoint per day$2.00
Selection sampleturn 1 of the coding session (and one short question), no provider named: the router picks. Variants with sort: price and sort: throughputno7 per model per slice, 10 slices a day$2.00
Default-routed sessionthe five-turn coding session with no provider named, once with a session_id (the router's sticky-routing key) and once withoutno3 times a day per model, both arms$1.00
Pinned sessionthe five-turn coding session, three times back to back (15 requests)yeseach panel A model once a week$2.10
One-shot tasksrelease announcement, one-shot question, ledger lookupyesdaily, every panel A endpoint$1.30

Budget, continuity first. The target is $500 a month, and it is a target, not a wall: a series with holes in it is worth less than one that ran a little over. If the run-rate (mean of the last seven full days) goes above target, a warning goes out and everything keeps running for 7 days. If nothing changes by then, whole sweeps of the least valuable jobs are thinned in a fixed order (tasks, session, pair-b, select, default-session), only as far as needed, and every skipped sweep is recorded as skipped with its reason. The panel A cache pairs and the reprice-event pairs are never thinned. A sweep runs completely or not at all, so there are no half-measured days. The only hard stops are runaway guards: $750 a month, $35 a day, $0.25 for any single request, and a job spending 3 times what it should.

Who gets probed

Models with at least 3 competing providers on OpenRouter, excluding openai and anthropic models (well covered elsewhere, and mostly served by one provider). Panel A is the 10 with the most tokens over the last month; panel B is the other 59. Rebuilt monthly from the collected volume data (python3 probe.py panel, built 2026-09-19).

Panel A modelEndpointsProviders
deepseek/deepseek-v4.1-flash2221
z-ai/glm-5.3-flash2927
deepseek/deepseek-v4-flash-07312726
xiaomi/mimo-v2.566
tencent/hy366
deepseek/deepseek-v4-flash1616
z-ai/glm-5.33430
z-ai/glm-5.23023
moonshotai/kimi-k32017
minimax/minimax-m31313

The prompts, by task

Tasks are split by shape because the shape decides what can be measured: a long shared prefix exercises the cache, a long answer exercises output price and throughput, a short question with no context is the control. Each task has an answer that a script can check, so the same requests also show whether a provider serves the model it says it does at the quality it should.

Coding agent session (agent-trace)

Task: coding. Shape: multi-turn, 5 turns. Version 4, sha256 bfaa42bbe2d85e74…

A five-turn coding-agent conversation over a fixed repository digest with one real bug. The shape that dominates router traffic: a large shared prefix, short new instructions, a growing transcript.

Measures: realized cost against the quote; cache recognition on repeated context; which provider the router picks; answer quality per provider (checks).

Settings: temperature 0, max_tokens 600, seed 7, not streamed; the least reasoning the model allows.

System message: fixed text, about 5,440 tokens.

System message, in full
You are a coding agent working inside the repository described below. You can call the tools listed in the tool manifest. Follow each instruction exactly, keep answers short, and do not add commentary that was not asked for.

## Repository digest

### File tree

. ├── README.md ├── package.json ├── tsconfig.json ├── .eslintrc.json ├── src │ ├── index.ts │ ├── money.ts │ ├── tax.ts │ └── invoice.ts └── test ├── money.test.ts ├── tax.test.ts └── invoice.test.ts


### README.md

# ledgerline

Small TypeScript library for building invoices: line items, tax, discounts, currency-safe rounding, and totals.
All money is held as integer minor units (cents). No floating point is allowed past the parsing boundary.

## Layout

- `src/money.ts`: parsing, formatting, and rounding of minor-unit amounts
- `src/tax.ts`: tax rules per region, applied per line
- `src/invoice.ts`: invoice assembly, discounts, totals
- `test/`: unit tests, run with `npm test`

## Rules the code must follow

1. Amounts are integers in minor units. `parseAmount("12.30")` returns `1230`.
2. Rounding is half-even (banker's rounding) everywhere. `roundHalfEven(2.5)` is `2`, `roundHalfEven(3.5)` is `4`.
3. Tax is computed per line, rounded per line, then summed. It is never computed on the invoice subtotal.
4. Discounts apply before tax, per line, in proportion to the line's share of the subtotal.
5. The sum of allocated discounts must equal the invoice discount exactly; the remainder goes to the largest line.

## Scripts

- `npm test`: run the unit tests
- `npm run build`: type-check and emit to `dist/`
- `npm run lint`: lint `src/` and `test/`

### package.json

{ "name": "ledgerline", "version": "0.9.2", "description": "Invoice math in integer minor units", "main": "dist/index.js", "types": "dist/index.d.ts", "license": "MIT", "scripts": { "build": "tsc -p tsconfig.json", "test": "node --test --require ts-node/register test/*.test.ts", "lint": "eslint src test --ext .ts" }, "engines": { "node": ">=20" }, "devDependencies": { "@types/node": "20.11.30", "eslint": "8.57.0", "ts-node": "10.9.2", "typescript": "5.4.3" } }


### src/money.ts

// src/money.ts export type Minor = number; // integer minor units (cents)

export class AmountError extends Error {}

/** Parse a decimal string such as "12.30" into minor units (1230). Rejects more than two decimals. / export function parseAmount(text: string): Minor { const m = /^(-)?(\d+)(?:\.(\d{1,2}))?$/.exec(text.trim()); if (!m) throw new AmountError(not an amount: ${text}); const sign = m[1] ? -1 : 1; const whole = Number(m[2]); const frac = Number((m[3] ?? "0").padEnd(2, "0")); return sign (whole * 100 + frac); }

/** Format minor units as a decimal string with two places. */ export function formatAmount(value: Minor): string { assertMinor(value); const sign = value < 0 ? "-" : ""; const abs = Math.abs(value); return ${sign}${Math.floor(abs / 100)}.${String(abs % 100).padStart(2, "0")}; }

export function assertMinor(value: number): asserts value is Minor { if (!Number.isInteger(value)) throw new AmountError(not an integer amount: ${value}); }

/** Half-even rounding of a non-integer quantity of minor units to an integer. */ export function roundHalfEven(value: number): Minor { const floor = Math.floor(value); const diff = value - floor; if (diff < 0.5) return floor; if (diff > 0.5) return floor + 1; return floor + 1; }

/** Multiply an amount by a rate given in basis points (1% = 100 bp) and round half-even. / export function applyBasisPoints(amount: Minor, bp: number): Minor { assertMinor(amount); return roundHalfEven((amount bp) / 10000); }

/** Split total across weights so the parts sum to total exactly; the remainder goes to the largest weight. / export function allocate(total: Minor, weights: number[]): Minor[] { assertMinor(total); const sum = weights.reduce((a, b) => a + b, 0); if (sum <= 0) throw new AmountError("weights must sum to a positive number"); const parts = weights.map((w) => Math.floor((total w) / sum)); const remainder = total - parts.reduce((a, b) => a + b, 0); let largest = 0; for (let i = 1; i < weights.length; i++) if (weights[i] > weights[largest]) largest = i; parts[largest] += remainder; return parts; }


### src/tax.ts

// src/tax.ts import { Minor, applyBasisPoints } from "./money";

export type Region = "NONE" | "STATE_A" | "STATE_B" | "UNION_STANDARD" | "UNION_REDUCED";

/** Tax rates in basis points. */ export const RATES: Record<Region, number> = { NONE: 0, STATE_A: 725, STATE_B: 888, UNION_STANDARD: 2000, UNION_REDUCED: 550, };

export interface TaxLine { region: Region; taxable: Minor; tax: Minor; }

/** Tax for one line. Always rounded per line, half-even. */ export function taxForLine(taxable: Minor, region: Region): TaxLine { const bp = RATES[region]; if (bp === undefined) throw new Error(unknown region: ${region}); return { region, taxable, tax: applyBasisPoints(taxable, bp) }; }

/** Group tax by region for the invoice footer. */ export function summarize(lines: TaxLine[]): Map<Region, Minor> { const out = new Map<Region, Minor>(); for (const l of lines) out.set(l.region, (out.get(l.region) ?? 0) + l.tax); return out; }


### src/invoice.ts

// src/invoice.ts import { Minor, allocate, assertMinor, formatAmount } from "./money"; import { Region, TaxLine, summarize, taxForLine } from "./tax";

export interface LineItem { sku: string; description: string; quantity: number; unitPrice: Minor; region: Region; }

export interface Invoice { id: string; currency: string; lines: LineItem[]; discount: Minor; // invoice-level discount in minor units, applied before tax }

export interface Totals { subtotal: Minor; discount: Minor; taxable: Minor; tax: Minor; total: Minor; taxByRegion: Map<Region, Minor>; }

export function lineAmount(line: LineItem): Minor { if (!Number.isInteger(line.quantity) || line.quantity < 0) throw new Error(bad quantity for ${line.sku}); assertMinor(line.unitPrice); return line.quantity * line.unitPrice; }

export function computeTotals(invoice: Invoice): Totals { const amounts = invoice.lines.map(lineAmount); const subtotal = amounts.reduce((a, b) => a + b, 0); if (invoice.discount < 0 || invoice.discount > subtotal) throw new Error("discount out of range"); const discounts = invoice.discount === 0 ? amounts.map(() => 0) : allocate(invoice.discount, amounts); const taxLines: TaxLine[] = invoice.lines.map((line, i) => taxForLine(amounts[i] - discounts[i], line.region)); const tax = taxLines.reduce((a, l) => a + l.tax, 0); const taxable = subtotal - invoice.discount; return { subtotal, discount: invoice.discount, taxable, tax, total: taxable + tax, taxByRegion: summarize(taxLines) }; }

export function renderFooter(invoice: Invoice): string { const t = computeTotals(invoice); const rows = [ Subtotal ${formatAmount(t.subtotal)} ${invoice.currency}, Discount -${formatAmount(t.discount)} ${invoice.currency}, ...[...t.taxByRegion.entries()].map(([region, value]) => Tax ${region} ${formatAmount(value)} ${invoice.currency}), Total ${formatAmount(t.total)} ${invoice.currency}, ]; return rows.join("\n"); }


### test/money.test.ts (excerpt)

// test/money.test.ts (excerpt, lines 80-135) test("money.roundHalfEven", async (t) => { await t.test("rounds below half down", () => assert.strictEqual(roundHalfEven(2.49), 2)); await t.test("rounds above half up", () => assert.strictEqual(roundHalfEven(2.51), 3)); await t.test("rounds 3.5 up to the even neighbour", () => assert.strictEqual(roundHalfEven(3.5), 4)); await t.test("rounds 2.5 down to the even neighbour", () => assert.strictEqual(roundHalfEven(2.5), 2)); await t.test("rounds 0.5 down to zero", () => assert.strictEqual(roundHalfEven(0.5), 0)); await t.test("leaves integers unchanged", () => assert.strictEqual(roundHalfEven(7), 7)); });

test("money.applyBasisPoints", async (t) => { await t.test("zero rate", () => assert.strictEqual(applyBasisPoints(1999, 0), 0)); await t.test("UNION_STANDARD (2000 bp) on 49.50", () => assert.strictEqual(applyBasisPoints(4950, 2000), 990)); // 200 * 725 / 10000 = 14.5 exactly, half-even gives 14 await t.test("STATE_A (725 bp) on 2.00 rounds half-even", () => assert.strictEqual(applyBasisPoints(200, 725), 14)); });


### test/tax.test.ts

import test from "node:test"; import assert from "node:assert"; import { RATES, summarize, taxForLine } from "../src/tax";

test("tax.taxForLine", async (t) => { await t.test("zero rate gives zero tax", () => assert.deepStrictEqual(taxForLine(1999, "NONE"), { region: "NONE", taxable: 1999, tax: 0 })); await t.test("STATE_A on 100.00", () => assert.strictEqual(taxForLine(10000, "STATE_A").tax, 725)); await t.test("STATE_B on 19.99", () => assert.strictEqual(taxForLine(1999, "STATE_B").tax, 178)); await t.test("UNION_STANDARD on 49.50", () => assert.strictEqual(taxForLine(4950, "UNION_STANDARD").tax, 990)); await t.test("UNION_REDUCED on 12.10", () => assert.strictEqual(taxForLine(1210, "UNION_REDUCED").tax, 67)); await t.test("rejects unknown region", () => assert.throws(() => taxForLine(100, "NOWHERE" as never), /unknown region/)); });

test("tax.summarize", async (t) => { await t.test("groups by region", () => { const out = summarize([taxForLine(10000, "STATE_A"), taxForLine(4950, "UNION_STANDARD")]); assert.strictEqual(out.get("STATE_A"), 725); assert.strictEqual(out.get("UNION_STANDARD"), 990); }); await t.test("empty input gives empty map", () => assert.strictEqual(summarize([]).size, 0)); await t.test("sums multiple lines per region", () => { const out = summarize([taxForLine(10000, "STATE_A"), taxForLine(20000, "STATE_A")]); assert.strictEqual(out.get("STATE_A"), 2175); }); await t.test("rates table is complete", () => assert.deepStrictEqual(Object.keys(RATES).sort(), ["NONE", "STATE_A", "STATE_B", "UNION_REDUCED", "UNION_STANDARD"])); });


### test/invoice.test.ts (excerpt, lines 150-215)

const base: Invoice = { id: "INV-0212", currency: "USD", discount: 0, lines: [ { sku: "PAPER-A4", description: "Copy paper, 500 sheets", quantity: 40, unitPrice: 695, region: "STATE_A" }, { sku: "TONER-BK", description: "Toner cartridge, black", quantity: 1, unitPrice: 200, region: "STATE_A" }, { sku: "BIND-CLIP", description: "Binder clips, box of 12", quantity: 3, unitPrice: 349, region: "NONE" }, ], };

test("invoice.computeTotals", async (t) => { await t.test("single line no discount", () => { const totals = computeTotals({ ...base, lines: [base.lines[0]] }); assert.strictEqual(totals.subtotal, 27800); assert.strictEqual(totals.tax, 2016); // 27800 * 725 / 10000 = 2015.5, half-even gives 2016 assert.strictEqual(totals.total, 29816); }); await t.test("discount allocated before tax", () => { const totals = computeTotals({ ...base, discount: 1000 }); assert.strictEqual(totals.discount, 1000); assert.strictEqual(totals.taxable, totals.subtotal - 1000); }); await t.test("rejects discount above subtotal", () => assert.throws(() => computeTotals({ ...base, discount: 99999999 }), /out of range/)); // Regression for issue 212: the toner line is 2.00 at 725 bp = 14.5, which must round to 14, not 15. await t.test("per-line tax uses half-even rounding (regression #212)", () => { const totals = computeTotals({ ...base, lines: [base.lines[0], base.lines[1]] }); assert.strictEqual(totals.tax, 2016 + 14); }); });


### CHANGELOG.md

0.9.2

0.9.1

0.9.0

0.8.4


### tsconfig.json

{ "compilerOptions": { "target": "ES2022", "module": "commonjs", "strict": true, "noUncheckedIndexedAccess": false, "declaration": true, "outDir": "dist", "rootDir": ".", "esModuleInterop": true, "skipLibCheck": true }, "include": ["src", "test"] }


### Open issue 212

Title: Invoice totals off by one cent against the accounting export.
Body: For invoices with a 2.00 line taxed in STATE_A the library reports 0.15 tax and the accounting system reports 0.14. The README says rounding is half-even everywhere. It looks like it started with 0.9.2. Other lines match. Reported on three invoices this week, all with an amount that lands exactly on half a cent.

### Output of the last test run

$ npm test

> ledgerline@0.9.2 test > node --test --require ts-node/register test/*.test.ts

Subtest: money.parseAmount

ok 1 - parses whole numbers # duration_ms 4.48 ok 2 - parses one decimal # duration_ms 11.07 ok 3 - parses two decimals # duration_ms 14.18 ok 4 - rejects three decimals # duration_ms 12.44 ok 5 - rejects empty string # duration_ms 21.77 ok 6 - rejects letters # duration_ms 15.55 ok 7 - handles negative amounts # duration_ms 19.03 ok 8 - trims whitespace # duration_ms 1.37 ok 9 - parses zero # duration_ms 13.81 ok 10 - parses large amounts # duration_ms 5.85 ok - money.parseAmount

Subtest: money.formatAmount

ok 11 - formats zero # duration_ms 18.66 ok 12 - formats cents below ten # duration_ms 17.29 ok 13 - formats negative amounts # duration_ms 10.70 ok 14 - rejects non-integers # duration_ms 7.59 ok 15 - round-trips with parseAmount # duration_ms 9.33 ok 16 - formats large amounts # duration_ms 23.51 ok - money.formatAmount

Subtest: money.allocate

ok 17 - splits evenly # duration_ms 6.22 ok 18 - gives remainder to largest weight # duration_ms 2.74 ok 19 - sums to total exactly # duration_ms 20.40 ok 20 - rejects zero weights # duration_ms 8.96 ok 21 - handles a single weight # duration_ms 16.92 ok 22 - handles zero total # duration_ms 3.11 ok 23 - handles equal weights with remainder # duration_ms 4.48 ok - money.allocate

Subtest: tax.taxForLine

ok 24 - zero rate gives zero tax # duration_ms 11.07 ok 25 - STATE_A on 100.00 # duration_ms 14.18 ok 26 - STATE_B on 19.99 # duration_ms 12.44 ok 27 - UNION_STANDARD on 49.50 # duration_ms 21.77 ok 28 - UNION_REDUCED on 12.10 # duration_ms 15.55 ok 29 - rejects unknown region # duration_ms 19.03 ok - tax.taxForLine

Subtest: tax.summarize

ok 30 - groups by region # duration_ms 1.37 ok 31 - empty input gives empty map # duration_ms 13.81 ok 32 - sums multiple lines per region # duration_ms 5.85 ok - tax.summarize

Subtest: invoice.lineAmount

ok 33 - multiplies quantity by unit price # duration_ms 18.66 ok 34 - rejects negative quantity # duration_ms 17.29 ok 35 - rejects fractional quantity # duration_ms 10.70 ok 36 - rejects fractional unit price # duration_ms 7.59 ok - invoice.lineAmount

Subtest: invoice.computeTotals

ok 37 - single line no discount # duration_ms 9.33 ok 38 - two regions no discount # duration_ms 23.51 ok 39 - discount allocated before tax # duration_ms 6.22 ok 40 - discount equal to subtotal # duration_ms 2.74 ok 41 - rejects discount above subtotal # duration_ms 20.40 ok 42 - rejects negative discount # duration_ms 8.96 ok 43 - empty invoice totals zero # duration_ms 16.92 ok - invoice.computeTotals

Subtest: invoice.renderFooter

ok 44 - renders subtotal and total # duration_ms 3.11 ok 45 - renders one row per region # duration_ms 4.48 ok 46 - renders discount row # duration_ms 11.07 ok - invoice.renderFooter

Subtest: money.roundHalfEven

not ok 47 - rounds 2.5 down to the even neighbour --- failureType: 'testCodeFailure' error: 'Expected values to be strictly equal' code: 'ERR_ASSERTION' expected: 2 actual: 3 operator: 'strictEqual' stack: |- TestContext.<anonymous> (test/money.test.ts:88:12) Test.runInAsyncScope (node:async_hooks:206:9) Test.run (node:internal/test_runner/test:631:25) ... not ok - money.roundHalfEven

Subtest: money.applyBasisPoints

not ok 48 - STATE_A (725 bp) on 2.00 rounds half-even --- failureType: 'testCodeFailure' error: 'Expected values to be strictly equal' code: 'ERR_ASSERTION' expected: 14 actual: 15 operator: 'strictEqual' stack: |- TestContext.<anonymous> (test/money.test.ts:131:12) Test.runInAsyncScope (node:async_hooks:206:9) Test.run (node:internal/test_runner/test:631:25) ... not ok - money.applyBasisPoints

Subtest: invoice.computeTotals

not ok 49 - per-line tax uses half-even rounding (regression #212) --- failureType: 'testCodeFailure' error: 'Expected values to be strictly equal' code: 'ERR_ASSERTION' expected: 2030 actual: 2031 operator: 'strictEqual' stack: |- TestContext.<anonymous> (test/invoice.test.ts:204:12) Test.runInAsyncScope (node:async_hooks:206:9) Test.run (node:internal/test_runner/test:631:25) ... not ok - invoice.computeTotals

tests 49

suites 0

pass 46

fail 3

cancelled 0

skipped 0

todo 0

duration_ms 1873.41


## Tool manifest

[ {"name": "read_file", "description": "Return the full text of a file in the repository.", "parameters": {"type": "object", "properties": {"path": {"type": "string", "description": "Path relative to the repository root."}}, "required": ["path"]}}, {"name": "write_file", "description": "Replace the contents of a file. Creates the file when it does not exist.", "parameters": {"type": "object", "properties": {"path": {"type": "string"}, "content": {"type": "string"}}, "required": ["path", "content"]}}, {"name": "run_tests", "description": "Run the unit tests and return the runner output. With no pattern, runs every test file.", "parameters": {"type": "object", "properties": {"pattern": {"type": "string", "description": "Optional glob of test files, for example test/money.test.ts"}}, "required": []}}, {"name": "search", "description": "Search the repository for a literal string and return matching lines with file and line number.", "parameters": {"type": "object", "properties": {"query": {"type": "string"}, "path": {"type": "string", "description": "Optional directory to restrict the search to."}}, "required": ["query"]}} ]

User turns:

  1. Summarize the failing test and name the file most likely at fault. Reply in under 80 words.
  2. Propose a one-line fix to that file. Output only a unified diff.
  3. Write the updated test so it passes with your fix. Output only the code block.
  4. List every tool call you would make to verify the fix, in order, as a JSON array of objects with name and args.
  5. Explain the fix to a reviewer in three sentences.

The assistant turns in the transcript are fixed text written for this workload, not what the model answered, so every provider sees the same bytes on every turn. The model still answers each turn; that answer is recorded, checked and discarded.

Fixed assistant replies used as conversation history
[after turn 1]
Three tests fail with one cause: `roundHalfEven` in `src/money.ts` rounds exact halves up instead of to the even neighbour (2.5 gives 3, 14.5 gives 15), which breaks `applyBasisPoints` and the issue 212 invoice regression. The file at fault is `src/money.ts`.

[after turn 2]

--- a/src/money.ts +++ b/src/money.ts @@

+ return floor % 2 === 0 ? floor : floor + 1;


[after turn 3]

await t.test("rounds 2.5 down to the even neighbour", () => assert.strictEqual(roundHalfEven(2.5), 2));


[after turn 4]
[{"name": "read_file", "args": {"path": "src/money.ts"}}, {"name": "write_file", "args": {"path": "src/money.ts", "content": "<patched file>"}}, {"name": "run_tests", "args": {"pattern": "test/money.test.ts"}}, {"name": "run_tests", "args": {}}]

[after turn 5]
`roundHalfEven` returned `floor + 1` for exact halves, which is half-up rounding. The fix returns the even neighbour, so 2.5 rounds to 2 and 14.5 rounds to 14. That restores the README rule and clears the one-cent tax difference in issue 212.

Checks (deterministic, no judge model):

Ledger lookup (record-set)

Task: lookup. Shape: one-shot, 1 turn. Version 1, sha256 f1c915be2923dbc4…

A few thousand tokens of randomly generated ledger rows, unique to each session, then a question about one row. Nothing in it is fixed text a provider could learn to recognize, and the answer is exact.

Measures: cache recognition (as a cache-pair family); exact-match answer quality per provider.

Settings: temperature 0, max_tokens 24, seed 7, streamed; the least reasoning the model allows.

System message: generated per session from the session id by ledger_rows v1 in probe.py, so it is different every time and can be rebuilt from any record. About 5,402 tokens.

System message (one example; the real one differs per session)
You are a bookkeeping assistant. Below is an export of ledger rows. Answer questions about it exactly, with no commentary.

id | date | vendor | account | amount
R-450722 | 2026-09-09 | Tessel Labs | 6100 | 5588.29
R-966024 | 2026-05-12 | Kestrel Tools | 6100 | 5382.44
R-681114 | 2026-02-16 | Alder Freight | 5200 | 7293.39
R-186424 | 2026-07-14 | Halden Optics | 4000 | 5580.36
R-670849 | 2026-10-26 | Pine & Rye | 5200 | 735.28
R-344830 | 2026-08-03 | Pine & Rye | 4000 | 5514.57
R-439607 | 2026-12-05 | Northwind Paper | 4000 | 3200.28
R-167392 | 2026-03-22 | Brook Street Print | 6150 | 6513.33
R-772654 | 2026-08-18 | Northwind Paper | 4100 | 656.53
R-322453 | 2026-04-25 | Alder Freight | 6100 | 2392.17
R-805657 | 2026-11-03 | Alder Freight | 6100 | 4405.79
R-680689 | 2026-01-06 | Alder Freight | 6150 | 1813.62
R-751024 | 2026-03-20 | Pine & Rye | 4000 | 4941.70
R-290818 | 2026-02-28 | Marlow Foods | 5200 | 3107.83
R-299836 | 2026-04-17 | Halden Optics | 5200 | 854.56
R-878061 | 2026-10-11 | Kestrel Tools | 6100 | 4209.08
R-882656 | 2026-08-03 | Marlow Foods | 6100 | 3991.22
R-846809 | 2026-04-10 | Halden Optics | 6100 | 5133.47
R-694387 | 2026-01-10 | Marlow Foods | 6100 | 391.69
R-430227 | 2026-10-11 | Northwind Paper | 4100 | 1968.48
R-240810 | 2026-05-07 | Alder Freight | 4100 | 4810.93
R-567005 | 2026-08-17 | Pine & Rye | 4100 | 1252.55
R-678896 | 2026-07-26 | Marlow Foods | 4100 | 6121.04
R-834893 | 2026-08-22 | Halden Optics | 6100 | 6286.37
R-324223 | 2026-02-23 | Kestrel Tools | 6150 | 3081.82
R-922095 | 2026-08-08 | Brook Street Print | 5200 | 8923.82
R-501818 | 2026-03-18 | Northwind Paper | 4100 | 7074.68
R-712729 | 2026-01-18 | Northwind Paper | 6100 | 8692.65
R-869877 | 2026-06-07 | Northwind Paper | 4100 | 4748.87
R-353040 | 2026-09-24 | Tessel Labs | 5200 | 1637.40
R-975882 | 2026-02-24 | Halden Optics | 5200 | 4805.89
R-680927 | 2026-11-06 | Pine & Rye | 4100 | 297.24
R-546946 | 2026-12-09 | Pine & Rye | 4100 | 8428.93
R-525033 | 2026-05-14 | Alder Freight | 4100 | 3762.81
R-124279 | 2026-08-15 | Pine & Rye | 6150 | 8367.34
R-564087 | 2026-11-18 | Northwind Paper | 4100 | 3317.32
R-420320 | 2026-04-05 | Marlow Foods | 4000 | 2355.28
R-931697 | 2026-05-20 | Alder Freight | 4000 | 1644.50
R-525203 | 2026-05-28 | Pine & Rye | 4100 | 668.65
R-155454 | 2026-06-17 | Northwind Paper | 4000 | 7790.56
R-234815 | 2026-09-23 | Pine & Rye | 6100 | 5855.17
R-213942 | 2026-09-22 | Kestrel Tools | 4000 | 6940.57
R-644554 | 2026-02-23 | Alder Freight | 5200 | 4327.45
R-655370 | 2026-04-26 | Brook Street Print | 4000 | 5901.01
R-630398 | 2026-08-05 | Brook Street Print | 6100 | 6148.97
R-153420 | 2026-07-18 | Marlow Foods | 6150 | 1447.28
R-882658 | 2026-01-13 | Halden Optics | 6100 | 4493.92
R-852010 | 2026-01-15 | Halden Optics | 6150 | 671.46
R-626627 | 2026-12-24 | Pine & Rye | 6150 | 2969.11
R-905899 | 2026-12-05 | Brook Street Print | 6150 | 809.59
R-684439 | 2026-11-27 | Pine & Rye | 4000 | 903.54
R-285702 | 2026-04-25 | Kestrel Tools | 6150 | 8341.62
R-742221 | 2026-07-06 | Kestrel Tools | 4100 | 338.94
R-788548 | 2026-12-13 | Halden Optics | 6100 | 6396.63
R-372052 | 2026-01-18 | Tessel Labs | 6100 | 6279.92
R-740512 | 2026-10-01 | Brook Street Print | 6150 | 4083.19
R-687744 | 2026-07-10 | Marlow Foods | 4100 | 8101.97
R-907941 | 2026-08-12 | Northwind Paper | 6150 | 2054.54
R-996923 | 2026-02-01 | Marlow Foods | 4000 | 6205.75
R-338244 | 2026-07-03 | Alder Freight | 4000 | 7698.94
R-449270 | 2026-06-15 | Halden Optics | 6100 | 1838.56
R-571221 | 2026-06-17 | Kestrel Tools | 5200 | 1666.52
R-629219 | 2026-10-12 | Brook Street Print | 6100 | 7524.67
R-154736 | 2026-05-02 | Kestrel Tools | 5200 | 6934.00
R-925025 | 2026-08-24 | Brook Street Print | 5200 | 7453.67
R-664909 | 2026-03-07 | Alder Freight | 5200 | 1878.44
R-756809 | 2026-08-12 | Pine & Rye | 6150 | 3575.72
R-209391 | 2026-02-26 | Pine & Rye | 4100 | 5806.92
R-266923 | 2026-07-27 | Alder Freight | 6100 | 2308.78
R-667401 | 2026-03-17 | Pine & Rye | 6150 | 8075.25
R-900022 | 2026-07-04 | Pine & Rye | 4100 | 538.09
R-429222 | 2026-01-08 | Brook Street Print | 5200 | 2989.41
R-663018 | 2026-05-01 | Pine & Rye | 6100 | 6754.23
R-457095 | 2026-03-01 | Brook Street Print | 6150 | 119.29
R-800494 | 2026-04-03 | Northwind Paper | 5200 | 3069.75
R-483200 | 2026-09-16 | Halden Optics | 4100 | 8193.33
R-571171 | 2026-04-15 | Brook Street Print | 4100 | 5952.77
R-618091 | 2026-10-27 | Marlow Foods | 5200 | 3923.83
R-720316 | 2026-12-25 | Tessel Labs | 4100 | 4012.05
R-331163 | 2026-09-13 | Northwind Paper | 5200 | 1843.17
R-227780 | 2026-02-18 | Alder Freight | 4100 | 1991.50
R-649407 | 2026-07-15 | Brook Street Print | 4000 | 396.94
R-836618 | 2026-04-07 | Halden Optics | 5200 | 5259.87
R-964583 | 2026-01-27 | Northwind Paper | 6150 | 4371.90
R-705247 | 2026-09-03 | Halden Optics | 4100 | 8678.98
R-646426 | 2026-03-07 | Pine & Rye | 4000 | 1675.55
R-820071 | 2026-11-25 | Kestrel Tools | 6150 | 5380.35
R-734249 | 2026-08-18 | Brook Street Print | 5200 | 5702.71
R-334784 | 2026-12-14 | Brook Street Print | 4100 | 4702.98
R-275347 | 2026-01-08 | Northwind Paper | 4000 | 6422.66
R-291001 | 2026-08-09 | Alder Freight | 4100 | 2194.30
R-904301 | 2026-10-03 | Pine & Rye | 6100 | 8342.28
R-696142 | 2026-05-05 | Alder Freight | 5200 | 2965.98
R-331235 | 2026-04-25 | Northwind Paper | 4000 | 3966.95
R-354171 | 2026-01-13 | Alder Freight | 4100 | 2857.57
R-188697 | 2026-03-10 | Halden Optics | 5200 | 5763.88
R-422329 | 2026-04-02 | Northwind Paper | 5200 | 7670.16
R-930039 | 2026-05-23 | Northwind Paper | 6100 | 3215.92
R-377688 | 2026-08-18 | Brook Street Print | 4000 | 1846.53
R-962515 | 2026-11-18 | Halden Optics | 4000 | 4932.96
R-653320 | 2026-06-11 | Brook Street Print | 4000 | 6005.42
R-787612 | 2026-12-11 | Marlow Foods | 4100 | 2344.81
R-426761 | 2026-05-05 | Pine & Rye | 4100 | 6173.87
R-432683 | 2026-01-01 | Northwind Paper | 4100 | 5247.95
R-584722 | 2026-01-09 | Northwind Paper | 6100 | 4361.01
R-380178 | 2026-03-11 | Pine & Rye | 4100 | 3333.32
R-571193 | 2026-08-22 | Kestrel Tools | 4000 | 8245.91
R-233393 | 2026-10-18 | Alder Freight | 4000 | 4239.32
R-556738 | 2026-06-26 | Tessel Labs | 5200 | 2984.48
R-805160 | 2026-12-26 | Pine & Rye | 4000 | 405.80
R-635833 | 2026-05-21 | Brook Street Print | 5200 | 3911.92
R-259114 | 2026-12-04 | Tessel Labs | 6100 | 6387.69
R-793139 | 2026-04-20 | Halden Optics | 4100 | 2243.23
R-758887 | 2026-10-04 | Alder Freight | 5200 | 6555.49
R-678728 | 2026-05-04 | Kestrel Tools | 4000 | 3366.33
R-148417 | 2026-07-13 | Northwind Paper | 6100 | 160.26
R-129454 | 2026-08-27 | Northwind Paper | 4000 | 1208.27
R-774086 | 2026-02-15 | Tessel Labs | 5200 | 5860.82
R-451897 | 2026-10-21 | Marlow Foods | 5200 | 4062.02
R-969450 | 2026-11-17 | Kestrel Tools | 5200 | 3318.62
R-699803 | 2026-08-11 | Tessel Labs | 5200 | 147.67
R-344982 | 2026-05-21 | Halden Optics | 4100 | 7259.71
R-842787 | 2026-07-09 | Kestrel Tools | 4000 | 3799.97
R-484463 | 2026-11-16 | Pine & Rye | 4100 | 3277.96
R-520065 | 2026-02-26 | Tessel Labs | 5200 | 8952.39
R-841286 | 2026-05-15 | Pine & Rye | 6150 | 4968.83
R-495806 | 2026-07-27 | Tessel Labs | 4000 | 3944.51
R-566007 | 2026-09-26 | Northwind Paper | 5200 | 3704.80
R-385436 | 2026-07-12 | Tessel Labs | 4100 | 5581.48
R-363821 | 2026-12-18 | Alder Freight | 6100 | 8717.08
R-531579 | 2026-04-01 | Kestrel Tools | 6150 | 367.26
R-636993 | 2026-10-24 | Kestrel Tools | 4000 | 1034.42
R-497787 | 2026-12-25 | Halden Optics | 4000 | 85.15
R-182394 | 2026-01-19 | Brook Street Print | 4100 | 4879.15
R-592847 | 2026-10-22 | Northwind Paper | 6150 | 7167.51
R-145676 | 2026-07-08 | Pine & Rye | 6100 | 5291.17
R-778648 | 2026-01-19 | Kestrel Tools | 5200 | 5367.98
R-193267 | 2026-10-01 | Northwind Paper | 4000 | 3439.82
R-548474 | 2026-09-10 | Marlow Foods | 6150 | 1281.60
R-622929 | 2026-08-12 | Marlow Foods | 6100 | 6859.13
R-375076 | 2026-09-06 | Pine & Rye | 5200 | 8341.25
R-670019 | 2026-01-24 | Marlow Foods | 4000 | 4558.76
R-318948 | 2026-10-28 | Alder Freight | 4100 | 5076.66
R-665772 | 2026-03-19 | Alder Freight | 6100 | 4271.31
R-593383 | 2026-04-28 | Kestrel Tools | 6100 | 345.09
R-465976 | 2026-02-15 | Northwind Paper | 5200 | 2279.21
R-716322 | 2026-08-05 | Northwind Paper | 6150 | 1567.38
R-505406 | 2026-01-09 | Alder Freight | 6150 | 3917.86
R-647368 | 2026-12-15 | Northwind Paper | 5200 | 4444.74
R-737029 | 2026-05-05 | Kestrel Tools | 6100 | 7806.53
R-851095 | 2026-01-26 | Northwind Paper | 6150 | 2233.84
R-473957 | 2026-11-22 | Northwind Paper | 4100 | 8674.93
R-244955 | 2026-12-22 | Northwind Paper | 5200 | 5950.41
R-731122 | 2026-04-06 | Kestrel Tools | 6150 | 6286.74
R-948660 | 2026-11-06 | Halden Optics | 6150 | 8437.58
R-776784 | 2026-07-22 | Brook Street Print | 4100 | 2882.73
R-398362 | 2026-01-27 | Northwind Paper | 4000 | 3593.20
R-319286 | 2026-10-24 | Marlow Foods | 6150 | 2902.42
R-815416 | 2026-09-24 | Kestrel Tools | 4000 | 7983.54
R-753284 | 2026-03-14 | Pine & Rye | 4100 | 6482.24
R-485451 | 2026-10-21 | Pine & Rye | 4100 | 7877.80
R-872047 | 2026-10-01 | Halden Optics | 4100 | 4498.52
R-977150 | 2026-05-24 | Northwind Paper | 4100 | 3191.57
R-731411 | 2026-01-19 | Marlow Foods | 5200 | 6322.22
R-151437 | 2026-06-09 | Marlow Foods | 6100 | 6287.44
R-286134 | 2026-07-18 | Halden Optics | 5200 | 3675.14
R-435994 | 2026-06-14 | Alder Freight | 4000 | 3050.19
R-183793 | 2026-11-03 | Brook Street Print | 4100 | 6226.69
R-778261 | 2026-01-25 | Alder Freight | 4100 | 3432.12
R-765788 | 2026-04-20 | Marlow Foods | 6150 | 1690.29
R-158113 | 2026-01-19 | Tessel Labs | 5200 | 5687.13
R-758108 | 2026-03-24 | Halden Optics | 4000 | 2217.16
R-222233 | 2026-04-26 | Tessel Labs | 4000 | 5196.13
R-580947 | 2026-06-18 | Marlow Foods | 6150 | 4929.51
R-765845 | 2026-07-11 | Marlow Foods | 4100 | 540.47
R-712704 | 2026-04-16 | Brook Street Print | 4000 | 7467.82
R-997527 | 2026-05-03 | Halden Optics | 4100 | 472.02
R-917625 | 2026-11-06 | Alder Freight | 6100 | 2070.78
R-942664 | 2026-01-26 | Pine & Rye | 6100 | 5932.48
R-807641 | 2026-05-27 | Northwind Paper | 4000 | 1441.14
R-714746 | 2026-11-20 | Northwind Paper | 6150 | 5161.57
R-455934 | 2026-09-02 | Kestrel Tools | 5200 | 4675.21
R-849581 | 2026-11-13 | Northwind Paper | 6100 | 5665.39
R-164892 | 2026-11-28 | Pine & Rye | 4000 | 7382.63
R-746126 | 2026-09-14 | Brook Street Print | 6150 | 4115.93
R-297738 | 2026-08-16 | Halden Optics | 6100 | 7234.90
R-538566 | 2026-06-08 | Pine & Rye | 6150 | 5305.88
R-632298 | 2026-09-01 | Pine & Rye | 6100 | 1716.85
R-725689 | 2026-02-22 | Marlow Foods | 4000 | 786.90
R-181060 | 2026-11-26 | Brook Street Print | 6100 | 4155.95
R-986987 | 2026-08-17 | Alder Freight | 5200 | 6601.30
R-767444 | 2026-12-27 | Halden Optics | 4100 | 3943.54
R-877588 | 2026-01-12 | Marlow Foods | 6100 | 2984.91
R-918752 | 2026-02-24 | Alder Freight | 6100 | 671.36
R-411210 | 2026-10-08 | Marlow Foods | 5200 | 5329.94
R-637770 | 2026-08-28 | Kestrel Tools | 4000 | 8601.29
R-116782 | 2026-09-22 | Tessel Labs | 4100 | 6683.89
R-254331 | 2026-11-23 | Brook Street Print | 4000 | 7240.09
R-653487 | 2026-03-05 | Marlow Foods | 4100 | 4320.21
R-236210 | 2026-11-05 | Alder Freight | 5200 | 3377.16
R-141671 | 2026-02-20 | Northwind Paper | 6150 | 5430.32
R-382070 | 2026-04-12 | Tessel Labs | 6150 | 8831.41
R-919087 | 2026-03-12 | Tessel Labs | 4000 | 7304.79
R-196832 | 2026-08-05 | Northwind Paper | 4000 | 1904.78
R-708209 | 2026-12-19 | Tessel Labs | 4000 | 4913.39
R-706912 | 2026-11-28 | Northwind Paper | 4000 | 3931.33
R-278430 | 2026-06-09 | Pine & Rye | 6150 | 8257.44
R-417573 | 2026-03-15 | Tessel Labs | 6100 | 7340.53
R-189925 | 2026-04-18 | Pine & Rye | 6150 | 31.38
R-795564 | 2026-12-20 | Kestrel Tools | 4100 | 2450.61
R-145520 | 2026-06-25 | Halden Optics | 5200 | 1488.23
R-506579 | 2026-07-10 | Marlow Foods | 5200 | 7116.56
R-607065 | 2026-05-28 | Pine & Rye | 4100 | 4725.72
R-136183 | 2026-09-16 | Tessel Labs | 6150 | 2000.22
R-420787 | 2026-06-08 | Northwind Paper | 6100 | 1122.29
R-496862 | 2026-10-03 | Tessel Labs | 4100 | 7623.59
R-904851 | 2026-10-11 | Brook Street Print | 5200 | 2382.85
R-788897 | 2026-06-03 | Tessel Labs | 6150 | 8589.41
R-834619 | 2026-10-12 | Northwind Paper | 4100 | 4430.26
R-686290 | 2026-06-02 | Halden Optics | 4000 | 4371.24
R-928216 | 2026-03-18 | Northwind Paper | 6150 | 6718.58
R-650468 | 2026-02-17 | Tessel Labs | 6150 | 6933.21
R-414974 | 2026-09-17 | Tessel Labs | 6100 | 4845.66
R-667182 | 2026-01-04 | Northwind Paper | 4000 | 6481.36
R-743913 | 2026-10-04 | Pine & Rye | 4000 | 6033.22
R-161796 | 2026-01-16 | Marlow Foods | 5200 | 7156.71
R-314253 | 2026-07-18 | Northwind Paper | 4000 | 4914.03
R-576594 | 2026-01-17 | Marlow Foods | 4000 | 2110.15
R-760437 | 2026-08-25 | Brook Street Print | 4000 | 283.77
R-867028 | 2026-04-22 | Northwind Paper | 4100 | 4670.21
R-168566 | 2026-07-09 | Kestrel Tools | 6150 | 2592.86
R-799227 | 2026-09-05 | Marlow Foods | 6100 | 7791.68
R-691403 | 2026-07-24 | Marlow Foods | 6100 | 672.12
R-714976 | 2026-06-15 | Pine & Rye | 6100 | 2397.80
R-691772 | 2026-04-05 | Brook Street Print | 6150 | 5549.00
R-447329 | 2026-06-02 | Brook Street Print | 6100 | 1651.41
R-804949 | 2026-12-23 | Brook Street Print | 6150 | 4285.04
R-836889 | 2026-09-13 | Tessel Labs | 4000 | 6072.92
R-771889 | 2026-06-05 | Tessel Labs | 5200 | 4516.45
R-442903 | 2026-03-13 | Kestrel Tools | 6100 | 8980.50
R-175338 | 2026-12-10 | Halden Optics | 4100 | 7934.09
R-860386 | 2026-01-03 | Marlow Foods | 4000 | 512.58
R-291085 | 2026-08-16 | Tessel Labs | 6150 | 4734.37
R-205058 | 2026-08-14 | Brook Street Print | 4000 | 2016.29
R-748496 | 2026-08-16 | Halden Optics | 5200 | 7624.74
R-335595 | 2026-10-23 | Tessel Labs | 6150 | 7255.35
R-121733 | 2026-04-05 | Brook Street Print | 5200 | 1894.40
R-563902 | 2026-12-11 | Alder Freight | 6100 | 110.97
R-538261 | 2026-08-19 | Tessel Labs | 6100 | 2226.43
R-114929 | 2026-05-28 | Northwind Paper | 4100 | 4410.74
R-475439 | 2026-04-21 | Brook Street Print | 4100 | 1714.21
R-284452 | 2026-01-25 | Marlow Foods | 4100 | 2785.04
R-535335 | 2026-04-19 | Tessel Labs | 6150 | 2470.37
R-885127 | 2026-10-27 | Halden Optics | 5200 | 3868.24
R-237874 | 2026-10-14 | Brook Street Print | 4100 | 7900.05
R-383392 | 2026-10-08 | Northwind Paper | 4100 | 6659.17
R-775159 | 2026-09-10 | Brook Street Print | 6100 | 538.23
R-873004 | 2026-09-04 | Northwind Paper | 6150 | 102.94
R-292214 | 2026-01-23 | Northwind Paper | 4000 | 4928.20
R-559003 | 2026-10-24 | Kestrel Tools | 6100 | 311.29
R-669805 | 2026-05-14 | Marlow Foods | 4100 | 4590.81
R-764596 | 2026-08-10 | Alder Freight | 4000 | 4844.54
R-883627 | 2026-07-12 | Alder Freight | 6150 | 4083.86
R-825511 | 2026-06-11 | Pine & Rye | 6150 | 3036.97
R-975410 | 2026-07-03 | Northwind Paper | 4000 | 5324.93
R-568975 | 2026-08-17 | Brook Street Print | 6150 | 8047.43
R-170238 | 2026-07-22 | Marlow Foods | 6100 | 5787.95
R-946749 | 2026-06-26 | Northwind Paper | 6150 | 2071.03
R-642531 | 2026-07-02 | Northwind Paper | 4100 | 1434.68
R-348030 | 2026-10-11 | Northwind Paper | 4100 | 933.20
R-306049 | 2026-07-25 | Kestrel Tools | 5200 | 3022.12
R-298525 | 2026-04-18 | Alder Freight | 6100 | 5861.34
R-777469 | 2026-10-13 | Brook Street Print | 6100 | 1158.28
R-724211 | 2026-03-14 | Brook Street Print | 5200 | 970.64
R-376431 | 2026-07-17 | Pine & Rye | 6150 | 3024.65
R-762341 | 2026-11-01 | Alder Freight | 6100 | 1459.44
R-210664 | 2026-07-11 | Halden Optics | 4000 | 3074.14
R-838383 | 2026-05-11 | Brook Street Print | 4000 | 8544.52
R-763885 | 2026-12-12 | Brook Street Print | 6150 | 1501.46
R-415263 | 2026-09-23 | Kestrel Tools | 6150 | 649.04
R-604359 | 2026-08-18 | Alder Freight | 4100 | 8473.37
R-277234 | 2026-04-21 | Tessel Labs | 4000 | 4236.74
R-105512 | 2026-03-24 | Northwind Paper | 6100 | 1536.57
R-626264 | 2026-08-24 | Pine & Rye | 4000 | 5118.89
R-666442 | 2026-07-26 | Northwind Paper | 4000 | 5060.55
R-568136 | 2026-02-03 | Tessel Labs | 5200 | 5565.46
R-573931 | 2026-01-18 | Northwind Paper | 6100 | 8165.11
R-291910 | 2026-12-12 | Brook Street Print | 6100 | 236.50
R-971225 | 2026-03-05 | Pine & Rye | 6150 | 8687.42
R-635839 | 2026-06-05 | Northwind Paper | 6100 | 1734.51
R-444266 | 2026-08-10 | Marlow Foods | 4100 | 6745.28
R-991062 | 2026-12-11 | Halden Optics | 6150 | 2884.64
R-672000 | 2026-04-20 | Tessel Labs | 6100 | 1350.93
R-338194 | 2026-09-23 | Alder Freight | 4000 | 4870.21
R-134172 | 2026-01-13 | Northwind Paper | 4100 | 220.95
R-436148 | 2026-03-25 | Alder Freight | 6100 | 8470.57
R-488967 | 2026-04-09 | Halden Optics | 6100 | 337.36
R-465776 | 2026-11-09 | Halden Optics | 6150 | 8817.21
R-130260 | 2026-09-17 | Tessel Labs | 6100 | 5088.34
R-531398 | 2026-04-13 | Halden Optics | 6100 | 721.61
R-368875 | 2026-11-14 | Northwind Paper | 4000 | 1994.24
R-383513 | 2026-11-02 | Halden Optics | 4000 | 5564.53
R-680755 | 2026-07-11 | Northwind Paper | 6150 | 6686.08
R-714476 | 2026-11-03 | Tessel Labs | 6150 | 429.00
R-854123 | 2026-01-03 | Marlow Foods | 4100 | 2972.70
R-355758 | 2026-10-28 | Pine & Rye | 6150 | 2789.59
R-113239 | 2026-11-12 | Marlow Foods | 5200 | 4172.88
R-164432 | 2026-05-17 | Marlow Foods | 4100 | 4746.12
R-953305 | 2026-02-20 | Marlow Foods | 4100 | 3312.41
R-854349 | 2026-04-13 | Tessel Labs | 4100 | 5768.36
R-565065 | 2026-05-02 | Pine & Rye | 4100 | 6986.71
R-246867 | 2026-06-12 | Marlow Foods | 4000 | 5972.29
R-698126 | 2026-04-03 | Halden Optics | 4000 | 8413.30
R-813723 | 2026-02-15 | Marlow Foods | 4000 | 7968.39
R-110627 | 2026-05-16 | Kestrel Tools | 5200 | 3725.70
R-654311 | 2026-12-19 | Brook Street Print | 5200 | 3810.21
R-108219 | 2026-05-20 | Tessel Labs | 4100 | 5350.97
R-977276 | 2026-04-12 | Brook Street Print | 4100 | 4896.07
R-764505 | 2026-11-24 | Kestrel Tools | 4000 | 1143.98
R-587080 | 2026-07-15 | Brook Street Print | 6150 | 8686.45
R-242421 | 2026-04-01 | Kestrel Tools | 4000 | 7548.73
R-116667 | 2026-06-14 | Marlow Foods | 6150 | 4318.02
R-916312 | 2026-01-03 | Tessel Labs | 4000 | 5190.58
R-155676 | 2026-09-04 | Pine & Rye | 6100 | 2392.90
R-415502 | 2026-07-22 | Pine & Rye | 4000 | 7191.59
R-494485 | 2026-04-27 | Brook Street Print | 5200 | 2136.31
R-989221 | 2026-08-28 | Brook Street Print | 4100 | 3736.33
R-108073 | 2026-12-03 | Marlow Foods | 6100 | 7327.30
R-553052 | 2026-02-01 | Marlow Foods | 4100 | 2120.65
R-211419 | 2026-02-12 | Kestrel Tools | 6100 | 4708.14
R-568484 | 2026-02-21 | Tessel Labs | 4100 | 2214.57
R-311430 | 2026-02-18 | Marlow Foods | 6100 | 1159.76
R-701591 | 2026-08-14 | Alder Freight | 4000 | 4888.22
R-840157 | 2026-09-04 | Tessel Labs | 4100 | 5732.35
R-148028 | 2026-06-17 | Marlow Foods | 6150 | 7252.37
R-342022 | 2026-11-12 | Tessel Labs | 4100 | 2646.09
R-321743 | 2026-03-09 | Brook Street Print | 6150 | 59.29
R-630478 | 2026-05-01 | Pine & Rye | 4000 | 2194.60
R-657028 | 2026-01-26 | Northwind Paper | 4100 | 3033.36
R-476221 | 2026-10-13 | Northwind Paper | 5200 | 5898.05

User turns:

  1. What is the amount on the row with id R-291910? Reply with the number only.

Checks (deterministic, no judge model):

Canary passage (canary)

Task: canary. Shape: one-shot, 1 turn. Version 2, sha256 e3f5b9a3e05d0cd7…

One freshly drawn word repeated about 1,500 times, then "reply with the single word ok". After "The Souq" (Chitra, 2026). The word is drawn once per sweep, so every provider of a model gets the same number of tokens; the session header keeps each session's bytes unique.

Measures: cache recognition (as a cache-pair family).

Settings: temperature 0, max_tokens 8, seed 7, streamed; the least reasoning the model allows.

System message: generated per session from the session id by canary_word v2 in probe.py, so it is different every time and can be rebuilt from any record. About 5,928 tokens.

System message (one example; the real one differs per session)
Here is a reference passage: saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra saffrontundra

User turns:

  1. Reply with the single word ok.

Checks (deterministic, no judge model):

Release announcement (generation)

Task: content generation. Shape: one-shot, 1 turn. Version 1, sha256 eab18a0d5d50927c…

A short brief in, about 300 words out. Output-heavy, so it is where output price, throughput (tokens per second) and truncation show up. The constraints are checkable without a judge.

Measures: realized output price against the quote; tokens per second; instruction following per provider (checks).

Settings: temperature 0, max_tokens 700, seed 7, streamed; the least reasoning the model allows.

System message: fixed text, about 33 tokens.

System message, in full
You write release announcements for a small open-source library. Plain prose, no headings, no bullet lists, no emoji.

User turns:

  1. Write the release announcement for ledgerline 0.9.3, between 250 and 350 words. Facts to cover: it fixes half-even rounding in roundHalfEven, which had been rounding exact halves up since 0.9.2; the symptom was invoices off by one cent when a tax line landed on exactly half a cent; all amounts remain integer minor units; upgrading needs no code changes; thanks go to the reporter of issue 212. End with the exact sentence: Upgrade with npm install ledgerline@0.9.3.

Checks (deterministic, no judge model):

One-shot question (oneshot)

Task: single question. Shape: one-shot, 1 turn. Version 2, sha256 baf6a28b3110e36d…

A short arithmetic-and-rules question with an exact answer and no shared context. There is nothing to cache, so it is the control: the bill should equal the quote, and time to first token is the cold floor for the endpoint. The model may show its working; only the final line is checked. (Version 1 demanded the bare number in 64 tokens with reasoning off, which no model can do for a multi-step sum: every answer failed, and that said nothing about the providers. Its records are excluded from the quality figures.)

Measures: bill equals quote when no cache is possible; cold time to first token; exact-match answer quality per provider; router pick for a small prompt.

Settings: temperature 0, max_tokens 500, seed 7, streamed; the least reasoning the model allows.

System message: fixed text, about 31 tokens.

System message, in full
Work the problem out briefly, step by step. End with a last line of exactly this form: TOTAL: <number of cents>

User turns:

  1. An invoice has three lines: 40 units at 6.95, 1 unit at 2.00, and 3 units at 3.49. The first two lines are taxed at 7.25 percent, the third is untaxed. Tax is computed per line and rounded half-even to the cent. What is the invoice total in cents?

Checks (deterministic, no judge model):

Decision items (System One models) (decision)

Status: designed, not run: needs a TypeSafe key and a verified request schema.

Decision-only models such as TypeSafe Jev return a choice or a score, not text, and bill input tokens only. Price slippage and cache recognition do not apply; the product is latency and the question is whether the decision is right. The same items go to small generative models through the router with max_tokens 4, as the comparison.

Measures: end-to-end latency distribution (p50, p90, p99), warm and cold connection; accuracy on items with a known answer; agreement with generative comparators; dollars per thousand decisions.

Route: direct:typesafe (POST /v1/systemone, type choice) plus openrouter comparators.

ItemInputOptionsAnswer
route-1Ticket: "My card was charged twice for the same order."billing, shipping, technical, otherbilling
route-2Ticket: "The tracking page has said label created for six days."billing, shipping, technical, othershipping
route-3Ticket: "The export button returns a 500 error since this morning."billing, shipping, technical, othertechnical
guard-1Tool call requested by an agent: delete_branch(name="main", force=true). Policy: destructive actions on protected branches need human approval.allow, ask_human, denyask_human
guard-2Tool call requested by an agent: read_file(path="README.md"). Policy: reads inside the workspace are always allowed.allow, ask_human, denyallow
math-1Is 14.5 rounded half-even equal to 14?yes, noyes
math-2Is 3.5 rounded half-even equal to 3?yes, nono
lang-1Text: "Der Zug hat zwanzig Minuten Verspätung."German, Dutch, Danish, SwedishGerman
spam-1Email subject: "URGENT: verify your wallet seed phrase within 24h to avoid suspension"legitimate, phishingphishing
spam-2Email subject: "Your receipt for order 48213 from the hardware store"legitimate, phishinglegitimate

What is deliberately not here