The router everyone built then threw away
Manifest deprecated their LLM router after six months. The reason is not what I expected.
Read the note 1 min read
From the notebook
latency.
1 note on this topic.
From the notebook
1 note on this topic.