Part I / The LLM Task-Cost Paradox

Why better AI can cost more per task.

Token prices tell us what computation costs. They do not tell us what it costs to actually get something done.

There is a seductive way to talk about AI economics: find the price per token, compare models, pick the cheaper one, and call the difference savings.

It is not wrong. It is simply incomplete in the way a fuel receipt is incomplete. The receipt tells you what the car consumed. It does not tell you whether you arrived, how many times you circled the block, or whether you stopped for an entirely new destination because the scenery looked interesting.

For real people doing real work, the unit that matters is rarely the token. It is the completed task.

The cost of AI-assisted work is not just the cost of producing an answer. It is the cost of reaching a useful stopping point.

Start with the car, not the engine

Imagine comparing two cars. One has a smaller engine and uses less fuel. The other is faster, more comfortable, and better at navigating unfamiliar roads. If both are driven once around the same empty track, the first car wins on fuel economy.

That is the token-price comparison.

Now give the cars a job: deliver a fragile package across a city, during a strike, while the address keeps changing. The better car may consume more fuel per minute because it drives farther and offers more options. But it may still be cheaper to use if it reaches the right address with fewer wrong turns, fewer damaged packages, and less human intervention.

The relevant question is no longer “Which engine is cheaper?” It is “Which car gets the package delivered at the lowest total cost?”

The task has a budget, even when the prompt does not

Every AI-assisted task has a practical budget made of more than money. It consumes some combination of:

  • direct model and software cost;
  • the user’s time and attention;
  • review, correction, and verification effort;
  • the cost of mistakes that survive into the next step; and
  • the extra work created when a useful answer expands the original assignment.

That last category is easy to miss because it often feels like a benefit. A model proposes a sharper angle, a second audience, a better diagram, a more ambitious deliverable. The work becomes more interesting. It can also become larger than the task that justified starting it.

Effective Task Cost

To make the hidden parts visible, we need a broader unit. Call it Effective Task Cost:

ETC = Direct Cost + Remediation Leakage + Expansion Leakage
A practical model for what the completed task consumes—not a claim that every cost can be measured perfectly.

Direct Cost is the part that platforms make easiest to display: subscriptions, API usage, tokens, tools, and infrastructure.

Remediation Leakage is what gets spent fixing weak output: additional prompts, retries, comparisons, fact-checking, rewrites, manual cleanup, and the cost of correcting a mistake downstream.

Expansion Leakage is what gets spent after the model or the user widens the scope: new versions, extra pages, bonus analysis, alternative designs, additional channels, or a better idea that quietly turns a small job into a project.

The Effective Task Cost Calculator

Calculate the economic cost of an AI journey, separating completion cost from optional expansion.

€25.40Effective task cost
€43.75Scope expansion cost

The first leak: underperformance

A weak model can look inexpensive because its direct charge is low. But if it needs three rounds of repair, the cheap first answer is not the cheap task.

This is familiar outside AI. A low-cost contractor who produces work that must be redone is not low-cost. A bargain flight that requires a hotel at the wrong airport is not a bargain. A slow car can be economical if the road is clear; it is less economical when it misses every junction.

Remediation is not only the model’s fault. A vague brief, missing context, unrealistic quality bar, or poor review process can create the same leakage with an excellent model. The point is not to assign blame. The point is to count the work that actually happened.

The second leak: overperformance

The more interesting leak is the one that arrives wearing a helpful smile.

Well-configured models are increasingly good at extending a task. They notice adjacent opportunities. They suggest a cleaner structure, a companion document, a landing page, a diagram, a checklist, a content plan. Sometimes that is exactly what a capable collaborator should do.

But every useful extension creates a choice: accept it, reject it, or park it for later. If the user accepts every attractive branch in the same working session, the original budget becomes fiction.

This is not a reason to make models less imaginative. It is a reason to distinguish useful discovery from committed scope.

Find the completion boundary

Most tasks have a point at which the original job is done. The document is good enough to send. The page is ready to publish. The analysis answers the question. The code runs and has passed the checks that matter.

Call that point the completion boundary.

The task route
StartCompletion boundaryDone
Before the line: corrections are part of finishing.After the line: extensions are new work.

Before the boundary, retries and corrections belong to the cost of the task. After the boundary, a new branch may be valuable—but it should be treated as a new decision, with a new budget.

The boundary is not a magical number. It is a management habit. Without one, an AI conversation can continue indefinitely because each answer creates another plausible next move.

Task cost is not task value

A larger task cost is not automatically bad. A long conversation may produce an outcome worth far more than the time and money consumed. A short one may produce a cheap answer that is useless.

That means Effective Task Cost is only half of the decision. The other half is task value: the money saved, risk avoided, quality gained, decision improved, or opportunity created by reaching the result.

The practical comparison is therefore not “cheap model versus expensive model.” It is closer to:

Task Value − Effective Task Cost = Worth continuing?
A decision frame, not a calculator. The hard part is deciding what “value” means for this task.

A better model can cost more and still be the rational choice when it reduces remediation, improves the result, or reveals an opportunity worth pursuing. It can also cost more than the task deserves when it keeps generating impressive detours after the job is already complete.

The operating rule

When judging AI-assisted work, keep three questions separate:

  • What did the system charge? That is direct cost.
  • What did it take to finish? That is effective task cost.
  • Was the finished result worth it? That is task value.

The first question belongs to the vendor. The second belongs to the workflow. The third belongs to the person or organisation doing the work.

AI is changing the economics of all three. The useful move is not to pretend the change is simple. It is to use a better unit of analysis.

Read the 5-minute frameworkSee the working notes