DEV Community

#llm

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Your MCP Tools Are Leaking: A Benchmark for Description Canonicalisation

Your MCP Tools Are Leaking: A Benchmark for Description Canonicalisation

Comments
3 min read
SGLang's +75% sampler speedup skips Qwen3 chat requests

SGLang's +75% sampler speedup skips Qwen3 chat requests

Comments
9 min read
LLM Research Blog: The Model that Fits our Project

LLM Research Blog: The Model that Fits our Project

Comments
4 min read
Your LLM gateway's token budget is a suggestion

Your LLM gateway's token budget is a suggestion

Comments
7 min read
Safety Rules Don’t Survive the Context Window: Quantifying and Fixing Agent Compliance Decay

Safety Rules Don’t Survive the Context Window: Quantifying and Fixing Agent Compliance Decay

Comments
6 min read
Exploring Open-Source Large Language Models: Choosing the Right Model for MiniChefGPT

Exploring Open-Source Large Language Models: Choosing the Right Model for MiniChefGPT

1
Comments
6 min read
Prompt Caching: How to Slash Local LLM TTFT & Latency

Prompt Caching: How to Slash Local LLM TTFT & Latency

1
Comments
6 min read
We ran an AI agent swarm on Claude Opus for $98. A single 2.5-cent call gave the same forecast

We ran an AI agent swarm on Claude Opus for $98. A single 2.5-cent call gave the same forecast

Comments
4 min read
What Actually Happens When a Transformer Thinks Step by Step: The Mechanics of Chain-of-Thought

What Actually Happens When a Transformer Thinks Step by Step: The Mechanics of Chain-of-Thought

Comments
5 min read
A repair layer is not a reliability layer

A repair layer is not a reliability layer

Comments
4 min read
I audited 8,946 published AI feedback reports on IELTS essays: do they quote the student exactly?

I audited 8,946 published AI feedback reports on IELTS essays: do they quote the student exactly?

Comments
3 min read
Where the time goes in a live AI call assistant: my code takes 150 ms, the model takes the rest

Where the time goes in a live AI call assistant: my code takes 150 ms, the model takes the rest

Comments
4 min read
How to Enable Ollama GPU Acceleration on Intel Arc in Windows

How to Enable Ollama GPU Acceleration on Intel Arc in Windows

3
Comments
2 min read
A 14.4 GB model on a 16 GB Mac: keep the right experts, not all of them

A 14.4 GB model on a 16 GB Mac: keep the right experts, not all of them

Comments
3 min read
Your Local LLM Isn't Bad at Tool Calling, Your Pipeline Is: Fixing Tool-Call Accuracy in vLLM

Your Local LLM Isn't Bad at Tool Calling, Your Pipeline Is: Fixing Tool-Call Accuracy in vLLM

Comments
7 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.