Vikrant
Mesh LLM runs inference across random strangers' laptops
Iroh built a system that splits LLM inference across volunteer nodes. The networking stack handles dropouts mid-inference. Wild.
Read post
distributed-systems
3 posts tagged.
- llm
-
machine-learningVikrant
Europe wants to train frontier models on a mesh of university GPUs
A GitHub repo sketches how Europe could pool scattered compute across universities and research labs to train a GPT-4 class model without buying a new datacenter.
Read post
-
formal-verificationVikrant
Formal verification caught bugs SQLite's test suite missed
Turso used a TLA+ variant called Quint to model their libSQL fork and found over ten real bugs in SQLite's transaction logic that billions of existing tests never saw.
Read post