Why I started logging every LLM call through a local proxy
Most teams have no idea how many tokens they burn or which prompts actually work. Running your own proxy fixes that.
Read the note 1 min read
From the notebook
2 notes on this topic.
Most teams have no idea how many tokens they burn or which prompts actually work. Running your own proxy fixes that.
A proxy tool used to bypass censorship shipped with TLS verification disabled by default, then buried the fix in unrelated commits.