Rio's open-source LLM was just a rebadged merge
A city government announced a locally trained language model. Turns out it was two existing models stitched together with the weights renamed.
Read the note 1 min read
From the notebook
model-merging.
1 note on this topic.