Mesh LLM runs inference across random strangers' laptops
Iroh built a system that splits LLM inference across volunteer nodes. The networking stack handles dropouts mid-inference. Wild.
Read the note 1 min read
From the notebook
p2p.
1 note on this topic.