Skip to content

For AI product teams

Ship LLM featuresknowing what each call costs.

Every model call shows up inside the request that made it, with its tokens, cost and latency. When agents dig through your telemetry, FerrisKey decides what they can touch.

Did that prompt change help?

Pick a change and compare cost, tokens, latency and user feedback, measured on real requests before and after.

prompt v12→prompt v13· last 24 h, 18k requests each

metricprompt v12 vs prompt v13change
cost / 1k requests$4.10$6.9068 %
input tokens2,4004,30079 %
p95 latency2.1 s2.3 s10 %
thumbs up81 %82 %1 %

v13 costs 68 % more and buys one point of satisfaction. The extra 1,900 tokens come from the new examples block, so trim that before rolling out.

Where the time goes today.

The steps it takes now, next to the steps it takes with FerrisTrace.

Today

3 steps · 3 tools
  1. 1provider consolesee the total
  2. 2spreadsheetmap API keys to features
  3. 3githunt for the prompt change

With FerrisTrace

1 step · 1 tool
  1. 1FerrisTracespend broken down by feature, so the spike points at its cause

You see cost per feature as it moves, before the invoice tells you.

Find out what your AI features cost to run.

Send your LLM calls over OpenTelemetry and their cost and latency show up next to the rest of your traces.