A pure frictionless world is a red team's dream

Friction has a bad reputation in this industry. Every pitch deck I have ever sat through promises to remove it — one-click everything, zero-latency everything, a world with no waiting and no rough edges. In my line of work, friction is the last honest control you have. A rate limit is friction. A slow build is friction. Writing an essay badly, by hand, at two in the morning, is friction, and it turns out that friction was doing load-bearing work nobody audited.

I watch the essay-writing corner of the internet the way I watch any newly commoditized tooling category. Lists of six hundred essay topics. Samples running two hundred to five hundred words on AI ethics, digital communication, automation. Assistants that promise a finished composition in seconds. The market has decided that writing is a solved problem. I have no objection to that. I only note that solved problems still ship with threat models, and this one shipped without one.

The dream of debugging people

There is a standing line in the futurology genre about the computist's dream: debug the subjectivity out of all human knowledge and get a pure, frictionless world. As an engineering spec it is gorgeous. As a security review it is a nightmare, because a frictionless system is one where the attacker's throughput equals yours. When prose cost an hour per page, the economics protected you. Cheap production was a bottleneck, and bottlenecks are controls. Remove the bottleneck and you do not get a better system. You get the same system with the defense stripped out and the offense left in.

Spam taught us this twenty years ago and we nodded along, then rebuilt the whole failure with better vocabulary.

Failure modes, enumerated

What actually breaks when text generation goes to near-zero cost:

1. Provenance dies first. Authorship stops being a signal. You cannot tell a careful human from a fast model, and neither can the platform hosting both.
2. Contamination. My suspicion, unproven: generated text gets scraped, trains the next generation, and quality drifts like a photocopy of a photocopy. Researchers argue about the mechanism; the direction worries me either way.
3. Convergence. When everyone's prose optimizes toward the same target, a forger blends in effortlessly — and the genuinely odd, human, particular voice starts looking suspicious instead. The forgery problem inverts. That one took me a while to see and I do not like it.
4. Trust migrates downstream. If prose is worthless as evidence, verification falls back to identity and reputation. Identity is spoofable. Reputation is gameable. We have just moved the attack from the artifact to the metadata, which is where attackers prefer to live anyway.
5. Assessment inversion. The essay assignment was never really testing prose. It was testing that a person sat with a problem for six hours. Attack the credential, not the skill, and the whole evaluation layer stops measuring what it claimed to.

The grudging upside

Here is the part I say through my teeth. The collapse of the essay as a verifiable artifact is a forcing function. It pushes education toward assessing process instead of product — drafts, revisions, the awkward middle where thinking happens. It pushes readers toward demanding sources and dates, which they should have been doing anyway. And it makes adversarial thinking a baseline literacy: if you assume every text is unverified until proven otherwise, you are finally thinking like I do at work.

The artifact got cheap. The thinking did not. That gap is where everything interesting now lives.

What I actually do

• Assume text is machine-assisted until provenance is established. This is now my default for strangers on the internet, and it costs me nothing.
• Click the citation. If the citation does not exist, the prose was decoration.
• Trust process evidence — timestamps, drafts, revision history — over polish. Polish is the cheapest signal left.
• Date-check everything. A confident claim from 2019 about current models is worse than no claim.

Subjectivity was never the bug in human knowledge. It was the audit log. Strip it out in pursuit of a frictionless world and you get a system nobody can vouch for, running at a speed nobody can check.

I will keep my friction. I know what it was for.