Vikrant
Someone built a formal verifier for LLM-written CUDA code
A new tool checks if ChatGPT's GPU kernels are actually correct before you run them in production.
Read post
gpu
3 posts tagged.
- llm
-
machine-learningVikrant
Training LLMs on an 8GB GPU is now a weekend project
Someone just released a minimal codebase for supervised fine-tuning, direct preference optimisation, and group relative policy optimisation on consumer hardware.
Read post
-
machine-learningVikrant
Norway built an LLM training cluster on 2 PB of Huawei flash
The Norwegian University of Science and Technology is running LLM workloads on Chinese storage hardware. The performance numbers are interesting.
Read post