Issue 117 min read
When Generation Gets Cheaper Than Judgment
A research-backed systems essay on AI slop, slop cannons, and how healthy AI workflows help judgment scale with generation.
- Authors
- Van Nguyen
- Published
- ยท updated
- Tags
- essay, ai, management, engineering leadership, systems

A company usually notices AI slop after the first wave of productivity looks successful.
That first wave is not fake. It often contains real leverage: drafts appear sooner, blank pages disappear, teams explore more options, and people who were blocked by format or fluency get a better starting point.
The marketing team publishes twice as many posts. Sales gets a stream of personalized outbound. Product has more specs, more research summaries, more competitive analysis, and more launch plans. Support drafts answers faster. Engineering has migration guides, incident summaries, test plans, and documentation that did not exist last week.
For a while, the dashboard looks like proof.
Then the drag appears. The customer anecdote is attached to the wrong segment. The strategy memo cites a report nobody can find. The support answer is mostly right except for the one local exception that matters. The architecture plan is fluent, complete, and subtly incompatible with the codebase. The docs sound clear until someone depends on them.
Nobody can point to the moment quality dropped, because every artifact looked finished.
This is the strange thing about slop: it often enters dressed as polish.
Before talking about AI, picture a submarine running dead reckoning toward harbor. The navigator plots each leg from the last believed position: compass bearing, speed, elapsed time. Most legs are fine. A half-degree error here, a few minutes of drift there โ nothing that looks alarming on its own.
At ordinary speed, position fixes deny that error room to grow. Every few legs, the boat surfaces, gets a fix, and snaps the believed track back to truth. Between fixes, the navigator still steers carefully. The gap stays small enough to matter only in theory.
Then the boat speeds up. Same crew. Same fix discipline. Five times as many legs between surfacing. Each leg still looks fine. The chart still shows a crisp line into the harbor mouth โ because the chart shows what was believed, not where the boat actually is.
The compass did not need to break. The per-leg error did not need to explode. The wreck happens because arrival rate outran judgment: too many legs between the moments someone re-grounds the work in reality.
Nobody can point to the leg where things went wrong, because every leg looked fine. Every artifact looked finished.
Generative AI puts every team underway at flank speed. That can be good. In bounded writing tasks, ChatGPT has reduced time and improved judged quality.[1] In customer support, AI assistance has raised productivity.[2] In professional consulting experiments, AI improved performance on tasks inside the model's competence frontier.[3][1]
The same evidence also carries the warning label. Benefits are uneven. The frontier is jagged. AI can help on one task and degrade performance on another. It can raise the floor while weakening the ceiling. It can accelerate a workflow before the organization has learned where review should become stricter.
The better version is not slower AI. It is better-shaped AI: generation aimed at work the organization understands, paired with review that knows what would actually matter if the output were wrong.
So the useful question is not "Did AI touch this?" The useful question is whether this workflow preserved judgment where judgment matters.
AI slop is not AI-made content. It is output whose apparent polish exceeds its truth, fit, originality, or usefulness.
A slop cannon is the person, team, or pipeline that industrializes that mismatch by generating plausible-looking output faster than the organization can ground, inspect, and own it.
Act I: Generation Gets Cheap
The first unhelpful shortcut is treating slop as an authorship category. That makes the problem sound like a purity test: human work on one side, AI work on the other.
That boundary does not survive contact with real work. A human can write an empty memo. An AI-assisted draft can be excellent. A polished AI-assisted deliverable can also be slop if it is generic, ungrounded, mismatched to the task, or published without enough review.
The better unit is the artifact plus its workflow.
Did the task sit inside the model's frontier? Was the draft grounded in authoritative sources or local context? Did a human reviewer check truth, fit, and consequence, or only tone and formatting? Was the output routed into a low-risk draft space, or did it become something customers, executives, engineers, or future models would rely on?
A useful workflow model is to treat slop as a latent quality failure score. The equation is not meant to grade people. It names the places where a system can preserve judgment:
Where:
is grounding quality. is unsupported-claim severity. is redundancy or homogenization. is mismatch to the task or local context. is risk-weighted publication volume.
The equation is not a law of nature. It is a reminder that slop has more than one failure mode. It can be false. It can be unsupported. It can be redundant. It can be strategically wrong. It can be harmless as one draft and harmful as a thousand published artifacts.
The slop-cannon dynamic appears when volume multiplies defect escape:
This is why "it is only a little worse" is not reassuring. A small defect probability at high volume can produce more escaped harm than a larger defect probability in a constrained workflow.
The same math also points to the constructive path. Teams do not have to reject volume to protect quality. They can lower defect probability with better inputs, raise catch rate with sharper review, and reserve the highest-throughput paths for work where the cost of escape is low.
The dead-reckoning example maps directly to each term: legs per hour is
This is not just a content-marketing problem. It appears anywhere a team rewards visible throughput more strongly than grounded correctness: product specs, sales collateral, support macros, internal wikis, test plans, migration docs, vendor comparisons, research summaries, incident retrospectives, strategy decks, and executive updates.
The common shape is the same. The organization adds a powerful generator but leaves the old judgment loop in place.
The fix is to treat judgment as part of the production system, not as a heroic afterthought. Better prompts help, but better provenance, clearer acceptance criteria, and reviewers with time to inspect the load-bearing claims help more.
Act II: Polish Breaks Intuition
Once slop is understood as escaped defect rather than AI authorship, the detector conversation changes.
The tempting control is to ask whether something "sounds like AI." That is an incomplete primary defense. Humans are not reliable universal judges of synthetic text.[4] Automated detectors are brittle under paraphrase, new models, decoding changes, and adversarial edits.[5][6] Some detectors have also misclassified non-native English writing as AI-generated.[7][2]
More importantly, authorship is not the same as quality. If a customer support answer gives the wrong refund policy, it does not become safe because a human wrote it. If a research summary invents a source, it does not matter that the prose has a human rhythm. If a strategy memo ignores the company's actual constraints, the problem is not its origin. The problem is fit.
The better review surface is concrete defect classes: unsupported claims, contradiction, irrelevance, missing local constraints, weak source traceability, generic filler, and risk mismatch.
This is where signal detection theory is more useful than vibes:
This distinction matters because anti-slop systems can fail in two directions. They can miss weak work because it is fluent. They can also create false accusations and slow good work because anything unfamiliar gets labeled as AI-ish.
A better review system protects both sides: it catches the defects that matter and gives good work a clear path through. That is especially important for writers whose style, language background, or domain vocabulary does not match the detector's idea of normal.
A good reviewer therefore does not start with "Was this made by AI?" They start with:
- Which claims would be costly if wrong?
- Which source would prove or falsify them?
- What local constraint might this draft be missing?
- What contradiction would a domain expert notice immediately?
- Where does this sound specific without being grounded?
The point is not to distrust every sentence. The point is to make review inspect the load-bearing beams instead of the paint.
Act III: The Sameness Sink
Slop is not only falsehood. This is the part many organizations miss.
A memo can be factually acceptable and still be slop because it is generic. A campaign can contain no hallucinated claims and still sound like every other campaign. A strategy deck can be well formatted and plausible while saying nothing that came from this market, this product, this team, this customer base, or this moment.
The research backs this intuition. In one experiment, access to generative AI ideas improved judged story quality on average but reduced collective diversity.[8] In another, AI writing suggestions pushed Indian and U.S. participants' writing closer together, with loss of culturally specific nuance.[9][3]
This is why slop cannot be defined only as wrongness. Some slop is sameness. It is competent enough to pass quickly and generic enough to make the world smaller.
For a company, sameness is not an aesthetic misdemeanor. It is a strategic risk. Your hiring page starts sounding like every other hiring page. Your product narrative becomes category average. Your product requirements inherit default assumptions. Your customer research turns into a summary of what a model expects customers like yours to say.
The subtle thing is that average quality can rise while variance collapses. The weakest drafts get better. The strongest local judgment gets diluted. The organization feels more professional and becomes less itself.
The opportunity is to use average as a floor, not a destination. AI can help teams get to a competent first draft faster, but the last mile should carry more local taste, not less: sharper examples, stronger constraints, stranger questions, and the details only this team would know to include.
This is also why the phrase "AI slop" can mislead if it makes people imagine only obviously bad spam. The more important enterprise version is quieter: the gradual replacement of situated judgment with plausible category-average language.
The first time it happens, the draft saves an hour. The hundredth time, the organization has trained itself to stop noticing the missing hour of thought.
A healthy workflow spends some of those saved hours on taste. It asks what became easier, and also what became too easy to skip.
Act IV: Containment Beats Purity
If the problem is escaped defect, the solution is not purity. It is containment.
Purity asks, "Was this AI-generated?" Containment asks, "Where is this allowed to flow before it is checked?"
That frame keeps the tool available. It lets people draft, explore, translate, summarize, and rehearse without pretending that every draft is ready to become memory.
That distinction changes the operating system. Raw drafts can be useful. Brainstorming can be messy. Low-stakes transformations can be fast. But unverified synthetic output should not silently become public truth, customer commitment, compliance language, codebase documentation, or the source packet for the next draft.
A good review policy is a decision rule, not a vibe:
This rule says to inspect high-harm, high-uncertainty work more aggressively than low-stakes drafts. It also says that review cost matters. If an organization tries to review everything equally, the review system becomes slow, symbolic, or both.
A practical metric is risk-weighted slop rate:
This is better than measuring the percentage of documents that used AI. It focuses attention on escaped harm rather than tool usage.
In practice, containment has a few boring but powerful parts.
- Classify tasks by frontier. Inside-frontier tasks can use AI aggressively. Outside-frontier tasks need stricter controls.
- Attach source packets. Fact-sensitive work should begin from authoritative inputs, not a prompt asking for something good.
- Review defects, not origins. Check grounding, contradiction, source traceability, local fit, and consequence.
- Add cognitive friction where stakes are high. Source confirmation, contradiction checks, risk labels, and explicit uncertainty are not needless process when the output can hurt someone.
- Separate draft space from truth space. Raw drafts, brainstorms, and unverified summaries should not flow directly into public channels, customer-facing commitments, or internal knowledge bases.
- Fix the incentives. If the scorecard rewards volume, visible AI adoption, or cycle-time reduction while quality is weakly audited, slop is a rational equilibrium.[10]
The hazmat metaphor is fair only in this operational sense. Uncontrolled synthetic output in high-risk workflows needs labeling, containment, exposure control, and cleanup.[11] The metaphor becomes unfair when it implies that all AI-generated material is poison by nature.
The point is not to make work sterile. It is to keep draft material from leaking into the places where people expect truth.
Closing The Loop
The recurring mistake in all four acts is confusing generation with judgment.
The submarine did not fail because the navigator stopped caring. The legs multiplied and the fixes did not. The support team did not become careless overnight. The wiki did not become unreliable because one draft passed through. The organization crossed a flow threshold.
Slop appears when the system can manufacture plausibility faster than it can verify meaning.
The cure is not to stop using the machine. The cure is to add judgment to the architecture, so speed creates more room for care instead of less.
- Tune volume to review capacity. If output rises, review capacity, source discipline, or risk segmentation has to rise with it.
- Inspect load-bearing claims. Spend review time on the facts, assumptions, constraints, and commitments that would matter if wrong.
- Use AI where the frontier is understood. Treat edge and outside-frontier work as a place for options, critique, and drafting, not unreviewed answers.
- Preserve variance.Ask where the draft became more generic, less local, or less surprising than the team's real judgment.
- Keep unverified output contained. Draft space, reviewed space, public space, and source-of-truth space should not all be the same reservoir.
- Reward restraint. A team should get credit for not publishing plausible work when the evidence is weak.
Healthy AI adoption is not less ambitious. It is more exacting. It asks leaders to stop measuring only how much faster the machine can write and start measuring whether the organization has become better at deciding what deserves to be written, trusted, shipped, and remembered.
AI slop is what happens when generation gets cheap faster than judgment gets good.
The better future is not a slower organization. It is an organization where more people can make useful drafts, more reviewers can see what matters, and the shared memory becomes more accurate because the machine is connected to better human practice.
A healthy organization does not respond by banning the cannon or by standing proudly in front of it. It builds the missing backstop: source discipline, risk-tiered review, provenance where it matters, incentives that reward quality, and training that makes reviewers better at finding defects instead of guessing origins.
The cannon can be useful. It just needs a backstop, a target, and people practiced enough to know when not to fire.
References
Selected sources are grouped by the claims they support in the essay.
Noy, S., & Zhang, W. (2023). Experimental evidence on the productivity effects of generative artificial intelligence. Science. Brynjolfsson, E., Li, D., & Raymond, L. (2025). Generative AI at work. Quarterly Journal of Economics. Dell'Acqua, F., et al. (2026). The cybernetic teammate: Evidence from a field experiment on generative AI at work. Organization Science.
Back to note 1Dugan, L., et al. (2023). Research on human detection of machine-generated text. Dugan, L., et al. (2024). RAID benchmark for AI text detection robustness. Weber-Wulff, D., et al. (2023). Testing of AI detection tools. Liang, W., et al. (2023). GPT detectors are biased against non-native English writers. Fiedler, I., et al. (2025). Human and detector performance on AI-generated thesis excerpts.
Back to note 2Doshi, A. R., & Hauser, O. P. (2024). Generative AI enhances individual creativity but reduces the collective diversity of novel content. Science Advances. Agarwal, S., Naaman, M., & Vashistha, A. (2025). Cross-cultural effects of AI writing suggestions. CHI.
Back to note 3
References
- Experimental evidence on the productivity effects of generative artificial intelligence. Noy, S., & Zhang, W. (2023). Science doi:10.1126/science.adh2586
- Generative AI at Work. Brynjolfsson, E., Li, D., & Raymond, L. (2025). The Quarterly Journal of Economics, 140(2), 889-942 doi:10.1093/qje/qjae044
- Navigating the Jagged Technological Frontier: Field Experimental Evidence of the Effects of Artificial Intelligence on Knowledge Worker Productivity and Quality. Dell'Acqua, F., et al. (2026). Organization Science, 37(2), 403-423 doi:10.1287/orsc.2025.21838
- Do humans identify AI-generated text better than machines? Evidence based on excerpts from German theses. Fiedler, A., & Dรถpke, J. (2025). International Review of Economics Education, 49 doi:10.1016/j.iree.2025.100321
- RAID: A Shared Benchmark for Robust Evaluation of Machine-Generated Text Detectors. Dugan, L., et al. (2024). Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (ACL 2024) doi:10.18653/v1/2024.acl-long.674
- Testing of detection tools for AI-generated text. Weber-Wulff, D., et al. (2023). International Journal for Educational Integrity doi:10.1007/s40979-023-00146-z
- GPT detectors are biased against non-native English writers. Liang, W., Yuksekgonul, M., Mao, Y., Wu, E., & Zou, J. (2023). Patterns, 4(7) doi:10.1016/j.patter.2023.100779
- Generative AI enhances individual creativity but reduces the collective diversity of novel content. Doshi, A. R., & Hauser, O. P. (2024). Science Advances, 10(28) doi:10.1126/sciadv.adn5290
- AI Suggestions Homogenize Writing Toward Western Styles and Diminish Cultural Nuances. Agarwal, D., Naaman, M., & Vashistha, A. (2025). Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems (CHI '25) doi:10.1145/3706598.3713564
- Multitask Principal-Agent Analyses: Incentive Contracts, Asset Ownership, and Job Design. Holmstrรถm, B., & Milgrom, P. (1991). Journal of Law, Economics, and Organization, 7 (special issue) doi:10.1093/jleo/7.special_issue.24
- Reducing Risks Posed by Synthetic Content: An Overview of Technical Approaches to Digital Content Transparency. National Institute of Standards and Technology (2024). NIST AI 100-4 doi:10.6028/NIST.AI.100-4
Behind this essay
Duxology essays are made by humans and AI agents working in the open. This panel is generated from the essay's editorial record.
- Editor-in-chief
- Van Nguyen
- Research
- Claude (Fable 5)
- Drafting
- Van Nguyen
- Review rounds
- Pre-pipeline publication (human review only)
Updates and corrections
- v1 ยท ยท Initial publication on van.dev.
- v1.1 ยท ยท Ported to duxology; empirical claims retrofitted with checkable KB citations.
How to cite
Van Nguyen (2026). "When Generation Gets Cheaper Than Judgment". Duxology. https://duxology.org/essays/2026-05-30-slop-cannons
@article{when2026,
author = {Van Nguyen},
title = {When Generation Gets Cheaper Than Judgment},
journal = {Duxology},
year = {2026},
url = {https://duxology.org/essays/2026-05-30-slop-cannons}
}