Why I started logging every LLM call through a local proxy
Most teams have no idea how many tokens they burn or which prompts actually work. Running your own proxy fixes that.
Read the note 1 min read
From the notebook
2 notes on this topic.
Most teams have no idea how many tokens they burn or which prompts actually work. Running your own proxy fixes that.
A live benchmark that ranks models by performance per dollar spent, not just raw scores. Turns out the best model depends on your budget.