SANDSCOPE

Agents that touch production should be as accountable as the people who do.

Every action routed deterministically, grounded with citations, evaluated, traced, priced, and gated on human approval when it crosses a risk line.

Watch it runRead the source

THE PROBLEM

Four questions decide whether it ships

Teams are putting agents in front of production operations. When it matters, four questions decide whether it goes live — is it grounded, is it safe, what did it cost, and what did it actually do. Most deployments cannot answer any of them with evidence, so the agent either ships unaccountably or does not ship.

GROUNDING

Every claim points at a passage

Citations attach to sentences, not to responses. A model that puts one marker at the end of six sentences has cited one and asserted five. A marker pointing outside the evidence is recorded as unresolved rather than dropped — a fabricated citation looks exactly like grounding, so it has to survive where a check can see it.

RUN-1A0229ED51D · VERIFY

`db.pool.wait_ms` rose before `db.query.p99_ms`, indicating the pool was the cause [4]

rb-database-connection-pool#02

“Compare `db.pool.wait_ms` against `db.query.p99_ms`. If wait time rose before query time, the pool is the cause.”

REFUSAL

It says when it does not know

Refusal is gated on signals measured to separate answerable from unanswerable, not on a score that reads the same for both. Thresholds come from explicit error budgets against 715 labelled questions whose labels are true by construction rather than assigned by a model.

RUN · ASSESS_EVIDENCE
insufficient

“what is the disaster recovery failover procedure”

only 20% of the question’s terms appear in the retrieved material


false-answer rate 0.047 [0.029, 0.076] over 319 unanswerable questions

DETERMINISM

Routing is a decision, not luck

Providers are attempted in a fixed order. Two identical requests take the same path, which is what makes a trace worth reading and a failure worth reproducing. Nothing here reads a module global or the wall clock.

ROUTER · PROVIDER EVENTS
  • groqrate_limitconsecutive=1
  • geminierrorupstream 503
  • cerebrassuccess412ms

A 429 disables a provider for a bounded window. An exhausted quota disables it for the process. Conflating them strands the pipeline on its slowest fallback.

COST

Most of the work costs nothing

If a typed rule can decide it, no token is spent. Five of seven nodes in a typical run are deterministic and take 13 milliseconds between them, against 14 seconds for the two model calls. The governance layer is close to free — which is the argument for deciding as much as possible without a model, stated as a number.

TRACE · 7 SPANS · 14.0S
classify
retrieve
assess_evidence
hypothesise
verify
propose_action
risk_gate

5 nodes decided by typed rules, 13.4ms combined · 2 model calls, 14.0s

GOVERNANCE

A risky action stops for a human

The approval node has no edge back into the graph. Reaching it ends the run, and a decision starts a new one carrying the record. It is enforced by topology rather than by care, because an approval step that can auto-proceed consumes a reviewer's attention and protects nothing.

RUN · AWAIT_APPROVAL
risk: high — approval required

Restart the orders-db connection pool on the Tier 0 path.


decision recorded → continuation run-5138840639d1
gated run → still awaiting_approval, not resumed

ECONOMICS

Cost is bounded before it is incurred

No live model call happens without an open budget. Every call is priced at worst case before it fires and reconciled after. Pricing after the fact is accounting; pricing before is control.

SPEND LEDGER
providerreservedactual
mistral$0.000603$0.000475
mistral$0.000626$0.000407
mistral$0.000638$0.000364

Reserved before the call at the price of the most expensive provider that could serve it, reconciled after. Ratio 1.50x — a bound, not an estimate.

A NOTE ON WHAT THIS IS

SandScope is a demonstration product built to production standards on synthetic data. The engineering is real — the services, the failover, the retrieval, the evaluation, the pipeline. The customers are simulated, and saying so is cheaper than being found out.

Every number on this page is measured and reproducible from the repository. Ten defects found during the build are published, including the six that only appeared once the assembled system was actually run.