Vikrant
What happens when you train an LLM on fifth-grade material only
Researchers built an LLM using exclusively elementary-level text. The results challenge assumptions about what makes a model fluent.
Read post
llm
34 posts tagged.
- machine-learning
-
llmVikrant
ThoughtDAG lets you edit LLM conversation history as a graph
A new interface shows chat threads as directed acyclic graphs where you can rewrite nodes and re-run paths. Fixes the branching problem most chat UIs ignore.
Read post
-
llmVikrant
Someone built a formal verifier for LLM-written CUDA code
A new tool checks if ChatGPT's GPU kernels are actually correct before you run them in production.
Read post
-
machine-learningVikrant
Someone fit a reasoning model into 14MB
Needle2 runs on phones, smartwatches, and Raspberry Pis. The entire model is smaller than a single photo.
Read post
-
llmVikrant
Hobby programmers reject LLMs because the struggle is the point
Why learning communities ban code assistants while enterprises mandate them.
Read post
-
securityVikrant
LLM-generated CVE reports are polluting security databases
Someone is flooding the National Vulnerability Database with fake SQLite vulnerabilities written by language models, and it is breaking actual security work.
Read post
-
machine-learningVikrant
Training LLMs on an 8GB GPU is now a weekend project
Someone just released a minimal codebase for supervised fine-tuning, direct preference optimisation, and group relative policy optimisation on consumer hardware.
Read post
-
llmVikrant
LLM code review found 41 security issues for three thousand dollars
A security firm ran Claude through GlobaLeaks' codebase and found medium-severity bugs for seventy-six dollars per finding. The question is whether a human would have caught the same issues faster.
Read post
-
llmVikrant
The router everyone built then threw away
Manifest deprecated their LLM router after six months. The reason is not what I expected.
Read post
-
llmVikrant
Someone built a honeypot that catches LLM scrapers in the act
A researcher deployed a fake human verification page that only AI crawlers would fall for. The logs are filling up.
Read post
-
securityVikrant
OpenAI published their Codex security playbook
OpenAI open-sourced the internal security guidelines they used when building Codex. Turns out threat modelling an AI code generator is different from threat modelling a database.
Read post
-
machine-learningVikrant
What LLM labs actually hire for
Research engineer roles at the big labs filter for production ML skills first, paper count second.
Read post
-
open-sourceVikrant
Debian might ban AI-generated code contributions
A Debian general resolution proposes banning LLM-generated patches. The reasoning is direct: you cannot verify the training data's licensing.
Read post
-
ai-safetyVikrant
Kids treat chatbots like people more than adults do
New research shows children anthropomorphise LLMs at much higher rates than adults, which changes how we should think about guardrails.
Read post
-
machine-learningVikrant
Cisco released a family of small security models that actually run locally
Antares models are 1B to 8B parameters, fine-tuned on security tasks, and Apache 2.0 licensed. This is not another rebranded Llama wrapper.
Read post
-
llmVikrant
Kimi K3 fixed 15 CVEs that other models would not touch
A Chinese LLM patched critical security bugs in a codebase where OpenAI's models and Anthropic's Claude refused to engage. The refusal problem is real.
Read post
-
llmVikrant
LLMs that remember you are creepy and useful in equal measure
Gwern argues personalised LLM assistants could filter spam, draft replies, and catch your mistakes before you send them. The privacy trade-off is obvious.
Read post
-
securityVikrant
The MCP security audit no one asked for but everyone needs
Anthropic's Model Context Protocol promised to standardise how AI agents talk to tools. A new audit shows most implementations ship with auth disabled by default.
Read post
-
llmVikrant
Mesh LLM runs inference across random strangers' laptops
Iroh built a system that splits LLM inference across volunteer nodes. The networking stack handles dropouts mid-inference. Wild.
Read post
-
llmVikrant
LLM burnout is real
The moment you realise you are debugging prompt chains instead of writing code.
Read post
-
llmVikrant
LLM coding assistants have a variance problem
Dan Luu measured the same coding task twenty times with the same prompt. The variance in output quality was higher than the difference between model versions.
Read post
-
llmVikrant
An LLM that turns inline comments into Git diffs
Sidenote lets you comment on a rendered blog post, then an LLM writes the actual markdown diff. No forking, no pull requests.
Read post
-
llmVikrant
Micro-Agent: smaller models ganging up on GPT-4
vLLM's Micro-Agent proves that three coordinated 8B models can outperform a single frontier model on complex reasoning tasks.
Read post
-
llmVikrant
Someone wrapped every major LLM API in 500 lines of Bash
A GitHub repo called Bash4LLM+ does what Python libraries do in thousands of lines, using only shell builtins and curl.
Read post
-
llmVikrant
Rio's open-source LLM was just a rebadged merge
A city government announced a locally trained language model. Turns out it was two existing models stitched together with the weights renamed.
Read post
-
machine-learningVikrant
Data2prompt stuffs entire projects into LLM context windows
A CLI tool that flattens your data science repo into one massive prompt. Smart filtering meets the 200K token era.
Read post
-
llmVikrant
Someone ran a trillion-parameter LLM on consumer hardware with Optane memory
An enthusiast loaded a 1T-parameter model into 768GB of Intel Optane DIMMs and got 4 tokens per second on a single GPU. Slow, but it worked.
Read post
-
llmVikrant
LLM code smells: hedging language and structural filler
A developer catalogues the tell-tale signs of AI-generated code. The patterns are obvious once you see them.
Read post
-
llmVikrant
LLM agents forget your constraints halfway through the code
New research shows agents generating backend code slowly drop requirements like authentication checks. The longer the generation, the worse the decay.
Read post
-
llmVikrant
Someone finally built a Rosetta Stone for LLM pricing
Models.dev is an open-source database that tracks pricing, context windows, and rate limits across every major LLM provider. No more tab-sprawl to compare GPT-4 versus Claude costs.
Read post
-
machine-learningVikrant
DeepSeek-V4-Flash revives the steering vector idea
Steering vectors let you nudge a model's behaviour without retraining. They fell out of favour when newer models stopped responding to them. DeepSeek-V4-Flash brought them back.
Read post
-
llmVikrant
Torrix: observability without the database tax
A new LLM observability tool runs without PostgreSQL or Redis. That is not a feature list, that is an architecture decision.
Read post
-
ai-securityVikrant
AI found a CVE in its own training set and we are pretending that is a win
Mythos discovered a vulnerability that was already documented in the data it was trained on. The industry is calling this autonomous discovery.
Read post
-
securityVikrant
An AI agent found a real vulnerability in curl
Mythos, an autonomous security agent, caught a buffer overflow in curl that human auditors missed. The tooling works.
Read post