Chat templates are why models say 'as an AI'
A new paper shows the system prompt is not what makes models say 'as a language model'. It is the chat template wrapper that turns raw output into self-aware hedging.
Read the note 1 min read
From the notebook
research.
5 notes on this topic.
Estrogen masculinizes neural pathways in mice
A 2010 study found that estrogen, not testosterone, drives sex-specific brain development in newborn male mice. The testicular hormone converts to estrogen in the brain.
Read the note 1 min read
What LLM labs actually hire for
Research engineer roles at the big labs filter for production ML skills first, paper count second.
Read the note 1 min read
Kids treat chatbots like people more than adults do
New research shows children anthropomorphise LLMs at much higher rates than adults, which changes how we should think about guardrails.
Read the note 1 min read
Mean-field theory might be lying about how neural networks actually learn
Physicists found that the standard mean-field approximation for neural networks breaks down when you look at correlations between neurons.
Read the note 1 min read