Skip to main content

Monitoring Savings

Compare actual costs and the requested-model baseline over representative traffic in Analytics. Check routing/model changes and usage in Request Logs. A non-routed or cached request can differ from a routed one; avoid treating one response as a forecast.

Starter includes full analytics and CSV request-log export. Scale adds per-key routing controls and caps. Founding includes those current live controls; paid-tier names describe planned billing-on behavior. Predictions and team cost attribution are roadmap features.

For buffered requests, cost headers are conditional on usage and known pricing. For streams, inspect terminal logs after completion and handle incomplete outcomes. Header reference.