Key Concepts
Reversible work: Work you can undo before anyone outside the team sees the result. This is the work an agent can own.
Surfacing vs. correcting: Surfacing insights (finding, tracing, flagging) is the step an agent owns. Correcting (deciding what to do and building the relationship to get it done) is judgment work that stays with a person.
Quick Reference
The reversibility test: how far does a wrong answer travel?
- Stays in a draft: An agent writes a page and leaves it in a doc. A hallucination is self-contained and not consequential. Agent can own it.
- Gets published: Answer engines can now read it, and undoing even a typo means waiting on a re-crawl. Add human review before publishing.
- Gets sent to someone outside: An agent emails a publisher a wrong correction. Once it is sent, it is sent. Keep a person on it.
Rule of thumb: The further a mistake travels, the harder it is to take back. Let the agent own the work you can undo, and keep a person on the work you cannot.
What it costs to get the split wrong
- Handing over judgment: You still get an answer, and that is the problem. The output looks finished, reads well, and is confidently wrong. Human supervision is the scarcest resource in a marketing org, and spending it on work an agent should not have been handed sets you back.
- Keeping repetitive work manual: You pay in volume. AI makes work cheaper to produce, so companies produce more, and the amount of work needed to stay relevant keeps rising.
Why agents get switched off
- The agent runs successfully and a person checks every output at first. Over time the checking stops and the agent’s work becomes invisible. If the work needed human intervention, errors go uncaught.
Benchmark: WHOOP
- Problem: Inaccurate claims about the product appeared on other people’s sites, not WHOOP’s. One runners magazine page said the band charges by solar and never needs plugging in.
- Agent owns: Profound FactCheck flags inaccurate AI responses at scale with full coverage. It flagged 7.9% of AI responses as inaccurate. The agents also trace where each claim comes from.
- Human owns: Reaching out to the publisher to get the claim corrected, while building the relationship.
- Results: 100+ hours back in under a month, a 6.6% increase in visibility over 6 months, and appearing in 56% of AI Search answers for top prompts
Notes
- Nothing tells you a campaign “passed,” so a human will always oversee, judge, and approve the work.