Apple shipped distributed inference for M-series chips
MLX now runs multi-node inference across Mac Studios. Apple proved you can scale transformer serving without spinning up cloud instances.
Read the note 1 min read
From the notebook
mlx.
1 note on this topic.