Skip to content
Model my flow →

01 For support, ops and engineering teams

Shrink the AI bill. People included.

Find which LLM steps can move to decision models or code. Compare machine spend, latency and the work that still reaches people — before you refactor.

Free for the first design partners. Send the flow, get the numbers back. No signup, no SDK.

In = on belts + done
0 = 0 + 0
Per-million numbers once 40 are done: 0 of 40
Machines / 1M
…
People / 1M
…
Reach a person
…

Each ticket is one simulated ticket. Shares and timings are the demo’s assumptions.

02 The people bill

Token math is the tip of the bill.

What does an AI support flow really cost per million tickets?In the VARIA demo flow (modelled), the machines cost about $1,037 per million tickets: one decision-model call per ticket, plus an LLM that drafts refund replies. People still touch 28% of those tickets, which is 301,000 touches per million because some tickets need two. At $3 a touch that is about $904k, or $0.90 per ticket against $0.0010 for the machines. If the model’s confidence is calibrated, another 13.9% of tickets land in the wrong queue: $416k at $3 per reroute. All in, $1.32M per million, against $4.17M if people triage everything. LLM price calculators count only the machine part.
Price per human outcome +
cheapest gate for your prices0.30
gate 0.300.90 · all-in cost
Model assumptions +
Apply the token work (code rule + smaller LLM)
WATERLINE · ALL A TOKEN CALCULATOR SEESmachines $51.83people $45.2kwrong routes $20.8k1 DOT = $100 / MONTH · DRAWN TO SCALE
Per month at 50,000 tickets: machines $51.83, people $45.2k, wrong routes $20.8k.
Machines / mo
$51.83
People / mo
$45.2k
Wrong routes / mo
$20.8k
13.9% of tickets
All-in / mo
$66.1k
$1.32 per ticket
No human
72%
of tickets, by design
Agents needed
18.3
6 min / touch
People-only / mo
$208.5k
triage + replies by people
Saving / mo
$142.4k
68% vs people-only

Saving $142.4k a month. Get the breakdown with every assumption.

Modelled on the demo support flow. Wrong routes assume calibrated confidence: a ticket routed at confidence c is wrong with probability 1 − c. People-only baseline: a person triages every ticket and writes every refund reply; manual misroutes are not counted, which flatters the baseline. Calibrate on your own labelled sample before deciding.

Gartner put the average cost of a live-channel contact (phone, chat, email) at $8.01, against $0.10 for self-service. Gartner press release, 25 September 2019. VARIA defaults to $3 per human touch to stay conservative. Use your own number.

  1. 122 / 252

    The LLM bill for classification keeps growing.

    Engineers routing and classifying with a general LLM were the loudest group in our scan; 73 of those posts showed a buying signal.

  2. 61

    In support it’s mistakes and people, not tokens.

    Support threads talked about misroutes (21) and the load on agents (17). Token price wasn’t the complaint.

  3. 6 / 252

    “I don’t know what it will cost” is rare.

    People feel the bill and the mistakes after launch. The bench shows the share that reaches a person today; a price per touch is next, and the calculator on this page adds it now.

Source: VARIA field scan of 1,789 public posts (Hacker News and 19 subreddits, 12 months), October 2026. Details in Field notes.

03 How it works

Compose the flow. Simulate it. Change one thing.

Four steps, from a sketch to numbers with every assumption labelled.
  1. 01 Compose

    Draw the flow from the steps you would actually ship: one decision-model request with several questions, an LLM step, a code rule, a confidence gate, and outcomes handled by a machine or a person.

  2. 02 Simulate

    VARIA runs 10,000 items through the flow with a fixed seed. You get outcome shares, cost per 1M items, p50 and p95 wait, decision calls per item and the share that reaches a human.

  3. 03 What-if

    Change one expected share, a model, a threshold or a rule. The run repeats in milliseconds, so you compare designs side by side instead of guessing.

  4. 04 Hand off

    Export the request JSON your flow would send and the graph JSON for your repo, or let a coding agent change the flow through the MCP server and the CLI.

The parts you compose with

  • ASK

    Decision request

    One call to a decision model with several questions about the same text.

  • N

    Noul

    Yes or no, returned as a probability.

  • C

    Choice

    One of up to 255 options, with a confidence.

  • S

    Score

    A level on a scale of 2 to 10 levels, with a confidence.

  • LLM

    LLM step

    Writes text. Slow, priced per call.

  • FN

    Code rule

    Arithmetic and lookups. 1 ms, $0.

  • GT

    Confidence gate

    Below the threshold, the item goes to a person.

  • HUMAN

    Human outcome

    Every touch is time someone is paid for.

  • Several questions about the same text go in one decision request: answered in parallel, the text billed once.

04 What-if, live in your browser

Refund requests double. What happens to the bill?

This is the support-triage flow from the VARIA demo, re-implemented in your browser from the demo’s model. Its numbers land within about 2% of the demo’s (sampling noise at 10,000 items). Step through the story, or move the controls yourself.
changeTriage asks three questions in one request. Refund requests go to an LLM that drafts a reply, and a second check catches over-promises.

← scroll the flow →

INSupport ticket450 tok inputASKTicket triage300 ms · 580 tokCTeam3 teams · other · low confidenceSUrgencyscore ≥ 1.4 → 14%NAsks for refundyes → 25%AUTOBilling queue41%AUTOTechnical queue30%AUTOAccount queue16%HUMANHuman triage13% · other, low conf.HUMANPage on-call14%LLMDraft refund reply25% · 6.0 s · $0.004ASKReply checkover-promises? · 300 msAUTOSend reply22%HUMANHold for agent3.0%
Your own numbers+
Code rule: refunds under $50
LLM step
Angry customers → senior agent
Machines / 1M
$1,037
People / 1M
$904k
To a human
27.5%
Mean wait
1.89 s
p50 · median
300 ms
p95 · slow tail
6.60 s
Decision calls / item1.25
No human, by design72.5%
Wrong routes / 1M$416k
All-in with people / 1M$1.32M
Saving vs people-only$2.85M · 68%

Deltas vs the baseline. 10,000 items, seed 7.

Equal-load comparison: with refunds doubled, the original flow costs $2,017 per million tickets in machines; with the code rule and the smaller model it costs $124 (before the agent’s rule). On this page every simulated ticket keeps its random draws across chapters, so only the change moves the numbers.

05 For coding agents

Your coding agent designs the flow. VARIA tells it what it costs.

Clicking is fine for a first look. Tuning a flow by hand is not. VARIA has an MCP server and a CLI, so a coding agent such as Claude Code can read the flow, change shares and steps, and re-run the simulation from a plain-English request.
~/support-flows — claude

~/support-flows $ claude

Send angry customers to a senior agent. About 12% of tickets are angry. Keep the cost and the wait the same.

varia · get_flow("support-triage")

triage asks 3 questions in one request · 8 outcomes

varia · add_step(type="noul", into="ticket-triage", text="Is the customer angry or upset?")

question added to the existing triage request (+30 tokens)

varia · set_expected_share(question="angry-customer", yes=0.12)

angry-customer: yes 12% · no 88%

varia · add_step(type="end", kind="human", name="Senior agent", from="angry-customer:yes")

senior agent ← angry-customer: yes

Bash(<cli> simulate support-triage --items 10000)

cost / 1M $124 → $125 wait p50 · p95 300 ms · 2.60 s to a human 26.3% → 35.1%

Done. The new question rides in the existing triage call, so cost and wait stay flat. One thing to flag: to a human goes from 26.3% to 35.1%.

Illustrative session, scripted from the demo. Tool names as shown in the demo; numbers from this page’s engine; CLI name pending.

MCP tools and CLI

  • get_flow

    Read the flow: steps, questions, shares, outcomes.

  • set_expected_share

    Change what share of items answers yes, or picks an option.

  • add_step

    Add a question, an LLM step, a code rule, a gate or an outcome.

  • simulate (CLI)

    Run 10,000 items and print cost, wait and the human share. Final command name pending.

Tools seen in the demo. The full list, and access for design partners, come with the preview.

WebMCP Agents can use this page

Browser agents can use this page directly. Through WebMCP it exposes its demo engine as tools: simulate the support flow, read the pricing assumptions, look up a term, or fill in the request form for you to review and send.

Also: llms.txt · this page as Markdown · AI catalog

06 Reading latency

Why does p50 jump 22× when nothing broke?

Because a median only moves when half of the items change path. In the demo flow the fast path takes 0.3 s and the LLM path 6.6 s. While fewer than half of the tickets take the LLM path, p50 stays at 0.3 s; past half, it jumps to 6.6 s. The mean grows smoothly. Read p50 next to p95 and the mean, and watch the share on the slow path.

In the “refunds double” chapter 49.7% of simulated tickets take the slow path, right on the edge. A what-if that moves it from 49% to 51% shows p50 jumping 22× while the mean moves 4%.

p50
0.30 s
p95
6.60 s
mean
3.39 s

Drag across the chart. Fast path 0.3 s, slow path 6.6 s — the demo flow’s two routes.

07 Pick your flow

Which decisions are you about to automate?

The same bench, seven jobs. Each card is a flow we can model for you; the first one is where we hear the most pain.
  1. 01
    INASKFNLLMAUTO

    Move classification off the LLM

    Engineers and eng leads whose LLM classifies, tags or routes

    money lever · LLM bill · latency

    When the LLM bill keeps growing, see which steps can move to a decision model or code — and what happens to latency — before you refactor.

    MotherDuck: 100k rows classified in 40 s for $0.50 with a decision model, vs 32 min and $37 with an LLM (21 Sep 2026). source

    Model this flow →
  2. 02
    INASKGTHUMANAUTO

    Support triage

    Heads of support at SaaS and e-commerce teams with thousands of tickets a month

    money lever · Agent hours · hiring

    Before you hand tickets to AI, see how much work stays with people and what people and machines cost, so you can defend the budget and the hiring plan.

    Model this flow →
  3. 03
    INASKGTFNHUMAN

    Refund and approval thresholds

    Ops and risk teams in e-commerce and fintech

    money lever · Losses · review costneeds calibration · next

    Pick the auto-approve threshold in dollars: losses from wrong approvals against the cost of manual review, for every gate.

    Model this flow →
  4. 04
    INLDASKAUTOHUMAN

    Email and document intake

    Operations in finance, legal and real estate

    money lever · Staff hours

    Thousands of emails and PDFs a week: see how much can be sorted automatically and how much goes to people, so you don’t hire for the peaks.

    Nathan Wilbanks: 63,045 emails categorised in 2 min 54 s, 23.4M input tokens, $0.98 (18 Sep 2026). source

    Model this flow →
  5. 05
    INASKGTHUMANEND

    Moderation and trust & safety

    T&S teams and builders of community bots

    money lever · Moderator load · riskneeds calibration · next

    Before you auto-remove or auto-reply, find the balance between false positives, moderator load and wait time.

    Model this flow →
  6. 06
    INASKSGTHUMAN

    Paper screening

    Systematic-review teams in pharma, universities and consulting

    money lever · Expert hoursneeds calibration · next

    Planning a review of thousands of abstracts: estimate how many people still have to read at the recall you need, to set the budget and the deadline.

    Model this flow →
  7. 07
    INASKLLMFNEND

    Automation agencies

    Agencies and integrators selling AI automation (n8n, Make, custom)

    money lever · Deal conversion

    Show a client the flow, the economics and the load on their people in ten minutes — and price the project on numbers.

    Model this flow →

Tell VARIA what you’re automating.

A decision model reads your sentence, picks the closest flow and the answers you need, and the page rearranges around it. Nothing is generated: every block you see was written and checked by us.

Your text goes to a decision model (Jev by TypeSafe) to tailor this page. VARIA does not store it. Please don’t paste personal data.

08 Alternatives

VARIA vs what you use today

Most teams estimate in a spreadsheet, trust a vendor’s ROI calculator, or build first and measure with observability. Each answers a different question.
VARIA compared with spreadsheets, Flowcost.ai, vendor ROI calculators, LLM observability and workflow builders
QuestionVARIASpreadsheetExcel, SheetsFlowcost.aiworkflow cost estimatorVendor ROI calculatorAI support vendorsLLM observabilityLangfuse, LangSmith, HeliconeWorkflow buildern8n, Dify, Vellum
Answers before anything is builtyesyesyesyesnono
A distribution, not one number (Monte Carlo, p50 / p95)yesnodeterministicnomeasured, after launchper run, after launch
Models probabilities, confidence gates and routesyesmanualretry & escalation rulesnonono
Counts the work left to peopleyesmanualnovendor’s numbersnono
Your flow, your pricesyesyesyesnoyesyes
A coding agent can drive it (MCP / CLI)yesnobrief export; CLI soonnoAPIpartly
Measures real accuracynext: calibratenononoyesevals

Competitor capabilities as published on their sites on 8 October 2026 (flowcost.ai, langfuse.com, smith.langchain.com, helicone.ai, n8n.io, dify.ai, vellum.ai). Tell us if something changed.

When VARIA is the wrong tool

  • Your flow already runs in production with good traces — start from your observability data. VARIA’s next step is to compare its expected shares with those traces.
  • You are tuning the accuracy of one prompt — use an eval tool.
  • There are no decisions in your pipeline, just one LLM call — a price calculator is enough.

09 Evidence

Field notes: what we measured

Our own measurements and public numbers, with method and limits. Nothing here is a customer quote; VARIA is in preview.
Nscan · 6 Oct 2026 · $0.11

We asked 1,789 public posts what hurts.

Hacker News (503) and 19 subreddits (1,286), last 12 months. Each post was typed by a decision model with six questions in one request: is it about AI decisions over a stream, is the pain the author’s own, which job, which pain, any buying signal, who is writing. Cost $0.11, 1,789 calls, 0 errors. On topic: 551. First-hand pain: 252.

Posts with a first-hand pain, by job (n = 252)
  • LLM cost of classification & routing122
  • Support triage61
  • Email & documents19
  • Approvals: refunds, KYC, payments11
  • Hiring & leads9
  • Moderation6
  • Agencies4
  • Paper screening0

Limits: the sample is defined by our search queries, not a census. A spot check found 3–4 off-topic posts in 24.

GTour logs · 29–30 Sep 2026

A decision call is not a 300 ms constant.

The demo assumes 300 ms per decision-model call. Our own logs, from a client on consumer broadband far from the API region, over HTTP/2 with keep-alive: the model itself answers in about 60 ms; the network and the queue make the rest, and the tail moves with the time of day. That is why latency in VARIA is a per-step input. Set it from your own logs.

Decision-model call latency, p50 → p95 (ms)
Server time · 3,034 calls · 30 Sep, off-peak
p50 60 · p95 107
Client, off-peak · 3,034 calls · 30 Sep, 00:02–05:52 UTC
p50 382 · p95 857
Client, busy hours · 7,257 calls · 29 Sep, to 15:37 UTC
p50 1,184 · p95 4,074
LDpublic numbers, attributed
  • MotherDuck: 100k rows classified in SQL: 40 s and $0.50 with a decision model; 32 min and $37 with an LLM.

    21 Sep 2026 · source
  • Nathan Wilbanks: 63,045 emails categorised in 2 min 54 s: 23.4M input tokens, $0.98 (output is free).

    18 Sep 2026 · source

“Text classification in MotherDuck just got ~50x faster at ~1% of the cost.”

10 Instrument label

What’s real today, what’s modelled, what’s next

A simulator is only useful if you know which numbers are measured. Here is the label we put on ours.

AUTOReal today

  • Costs: tokens × public price ($0.042 per 1M input tokens for Jev, output free) plus the LLM price you enter. Every sum in the demo recomputes to the dollar.
  • Paths and shares: every item walks your flow; 10,000 items with a fixed seed.
  • Request JSON: the exact request your flow would send to the decision model.

GTModelled — your assumptions

  • Answer shares, confidence and latency per step — you set them.
  • Wrong routes: if confidence is calibrated, a ticket routed at confidence c is wrong with probability 1 − c. Each costs what you enter (default: one reroute touch).
  • People-only baseline: a person triages every ticket and writes every refund reply; manual misroutes are not counted.
  • Replay is an animation of the simulation, not live calls.

LDNext

  • A price per human outcome, wrong routes, “all-in with people”, “share with no human”, agents needed and the saving against people-only. The calculators on this page already add them; the bench gets them next.
  • The same random draws in every what-if (common random numbers), so only your change moves the numbers. This page’s engine already works this way.
  • Calibrate on your own labelled sample (~200 items) with your own key.
  • Thresholds in dollars: the gate where people + mistakes + machines cost least. The calculator on this page already finds it for the demo flow.
  • People as capacity: agents per shift and the queue at peak.
  • Expected shares as a production baseline, to catch drift.
  • Flow → code: from the bench to a running pipeline.

11 Answers

Questions engineers and support leads ask

Q01

What is VARIA?

VARIA is a decision-flow simulator for AI pipelines. You compose a flow of AI decisions: decision-model questions (Noul, Choice, Score), LLM steps, code rules, confidence gates and human handoffs. VARIA runs 10,000 items through it and shows cost per 1M items, p50 and p95 wait, decision calls per item and the share of work that reaches a person, before you build the pipeline.

Q02

Who is VARIA for?

Two groups first: engineers whose LLM classifies or routes and whose bill keeps growing, and heads of support or operations deciding how much of a queue to hand to AI. Agencies that sell automation use it to show a client the economics of a flow.

Q03

What does AI customer support cost per ticket?

In the VARIA demo support flow (modelled), the machines cost about $0.0010 per ticket: one decision-model call plus an LLM reply for refund requests. People still touch 28% of tickets, 0.30 touches per ticket on average, so at $3 a touch the people cost about $0.90 per ticket. Wrong routes add about $0.42 if confidence is calibrated, for $1.32 all in, against $4.17 when people triage every ticket. Use your own prices; Gartner put a live-channel contact at $8.01 in 2019.

Q04

How much of a support queue can AI handle?

It depends on how your flow routes uncertain and sensitive tickets. In the VARIA demo flow, 72% of tickets finish without a person and 28% reach one: unclear team or low confidence (13%), urgent pages to on-call (14%) and refund replies held for review (3.0%). VARIA shows this split for your own flow before you automate.

Q05

How do I estimate the cost of an LLM pipeline before building it?

List the steps, the tokens each step reads and the share of items that reaches each step. Cost per item is the sum of tokens × price × share, plus the per-call price of LLM steps times their share. Wait time comes from the mix of paths: add up step latencies along each path, then read p50, p95 and the mean across items. VARIA does this by simulating 10,000 items through the flow.

Q06

How much does a Jev request cost?

Jev by TypeSafe is priced at $0.042 per 1M input tokens; output is free. A support ticket with three questions in one request reads about 580 tokens, so a request costs about $0.0000244 and a million of them about $24.36. Several questions about the same text in one request are billed once for the text. VARIA is not affiliated with TypeSafe.

Q07

How does VARIA calculate the cost per million decisions?

It multiplies the tokens each step reads by the public price ($0.042 per 1M input tokens for Jev; output is free), multiplies by the share of items that reach the step, and adds the per-call price you enter for LLM steps. Code steps cost $0. In the demo support flow that comes to $1,037 per million tickets: $27.49 of decision-model calls and $1009.20 of LLM replies.

Q08

Are the simulated numbers measurements?

No. Costs follow published pricing, but answer shares, confidence and latency are assumptions you set. The next step is calibration: run the flow on about 200 of your labelled items with your own key and replace the assumptions with measured shares and accuracy.

Q09

How is VARIA different from LLM observability tools like Langfuse or LangSmith?

Observability measures a pipeline that already runs: traces, cost, latency and evals from real traffic. VARIA estimates a pipeline before it exists and lets you compare designs. They work together: model the flow in VARIA, ship it, then compare the expected shares with what your traces show.

Q10

How is it different from a vendor’s AI ROI calculator?

A vendor’s calculator uses the vendor’s assumptions about their own product. VARIA models your flow with your prices and keeps every human outcome visible, so you see the work that stays with people next to the machine cost.

Q11

What are Noul, Choice and Score?

They are Jev’s three question types. Noul returns the probability of yes. Choice picks one of up to 255 options and returns a confidence. Score returns a level on a scale of 2 to 10 levels, with a confidence. Several questions about the same text can go in one request; they are answered in parallel and the text is billed once.

Q12

Is VARIA affiliated with TypeSafe or Jev?

No. VARIA is an independent project. It models flows built on decision models such as Jev by TypeSafe and uses their public pricing. Jev is a trademark of its owner.

Q13

Can Claude Code or another coding agent use VARIA?

Yes. VARIA has an MCP server (tools such as get_flow, set_expected_share and add_step) and a CLI with a simulate command, so an agent can change the flow from a plain-English request and re-run the simulation. This website also exposes demo tools to browser agents through WebMCP.

Q14

Why does p50 latency jump in some what-if scenarios?

A median moves only when half of the items change path. If a fast path takes 0.3 s and a slow LLM path 6.6 s, p50 stays at 0.3 s until 50% of items take the slow path, then jumps to 6.6 s. Always read p50 with p95, the mean and the share on the slow path.

Q15

Where does my data go?

What you send in the request form comes to the VARIA team and is used only to model your flow. The bench itself is a single HTML file that runs locally. Calibration, when it ships, will call the decision model with your own API key, so your examples go only to the provider you already use.

Q16

How much does VARIA cost, and how do I get access?

VARIA is in preview and has no public pricing yet. Send us your flow through the form: we model the first flows for free and send you the numbers. Access to the bench for design partners is planned.

12 Your flow

Send us your flow. Get the numbers back.

Describe the decisions your pipeline makes and the volume. We model it in VARIA and send you cost per 1M, the wait, and the share that lands on people. Free for the first design partners.
  1. 1You describe the flow and the volume.
  2. 2We model it in VARIA and run the what-ifs that matter to you.
  3. 3You get cost per 1M, the wait, and the human share — with every assumption labelled.

Only the email is required. Free for the first design partners. Used only to reply to you.