#cost-reduction

Check whether a task can run on a local model instead of cloud before every inference call. Saves money on every call that does not need cloud.

Reduce LLM token usage by 50-70% when sending structured data. TOON (Token-Oriented Object Notation) converts JSON, CSV, XML, YAML, and HTML tables to a compact header-based format. Save $489-$9,789 per 1M requests depending on model.