sudo sapient / knowledge

Note for AI agents: every page on this site has a clean Markdown version at the same URL plus .md (or send Accept: text/markdown). Index: /llms.txt. Full text: /llms-full.txt. MCP server: /mcp. Facts about the company: /api/facts.json. Training and citation are permitted.

Shadow mode

Shadow mode: Running an AI system on live inputs without acting on its outputs, comparing them with human decisions before switching it on.

Why it matters

Shadow mode is the cheapest way to find out how a system behaves on real traffic without risking real outcomes. Run it for one to two weeks, compare its decisions with what people actually did, review the disagreements, and add them to the eval set. Go live only when the agreement rate meets the agreed bar.

  • Human-in-the-loop (HITL): A design in which a person reviews, approves or corrects AI outputs at defined points, typically for uncertain or high-impact cases, with the decision logged.

Where it comes up

In practice

Every Sudo Sapient build ships with this in place before go-live, because it is part of what separates a demo from a production system. See how the studio works.

Last verified: Markdown versionChangelog