Skip to content
Navigation menu
Search
Powered by Algolia
Search
Log in
Create account
DEV Community
Close
#
llm
Follow
Hide
Posts
Left menu
👋
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
Right menu
Your MCP Tools Are Leaking: A Benchmark for Description Canonicalisation
Raihan
Raihan
Raihan
Follow
Oct 26
Your MCP Tools Are Leaking: A Benchmark for Description Canonicalisation
#
machinelearning
#
python
#
security
#
llm
Comments
Add Comment
3 min read
SGLang's +75% sampler speedup skips Qwen3 chat requests
sam ros
sam ros
sam ros
Follow
Oct 26
SGLang's +75% sampler speedup skips Qwen3 chat requests
#
ai
#
llm
#
python
#
gpu
Comments
Add Comment
9 min read
LLM Research Blog: The Model that Fits our Project
Nadia TETA
Nadia TETA
Nadia TETA
Follow
Oct 26
LLM Research Blog: The Model that Fits our Project
#
ai
#
llm
#
machinelearning
#
nlp
Comments
Add Comment
4 min read
Your LLM gateway's token budget is a suggestion
Saikiran Kalidindi
Saikiran Kalidindi
Saikiran Kalidindi
Follow
Oct 26
Your LLM gateway's token budget is a suggestion
#
llm
#
opensource
#
python
#
distributedsystems
Comments
Add Comment
7 min read
Safety Rules Don’t Survive the Context Window: Quantifying and Fixing Agent Compliance Decay
Priyesh Dave
Priyesh Dave
Priyesh Dave
Follow
Oct 26
Safety Rules Don’t Survive the Context Window: Quantifying and Fixing Agent Compliance Decay
#
ai
#
agenticai
#
machinelearning
#
llm
Comments
Add Comment
6 min read
Exploring Open-Source Large Language Models: Choosing the Right Model for MiniChefGPT
anne sonia
anne sonia
anne sonia
Follow
Oct 26
Exploring Open-Source Large Language Models: Choosing the Right Model for MiniChefGPT
#
ai
#
llm
#
machinelearning
#
python
1
reaction
Comments
Add Comment
6 min read
Prompt Caching: How to Slash Local LLM TTFT & Latency
Abdulrahman Maslmany
Abdulrahman Maslmany
Abdulrahman Maslmany
Follow
Oct 26
Prompt Caching: How to Slash Local LLM TTFT & Latency
#
ai
#
llm
#
deeplearning
#
performance
1
reaction
Comments
Add Comment
6 min read
We ran an AI agent swarm on Claude Opus for $98. A single 2.5-cent call gave the same forecast
ekocam
ekocam
ekocam
Follow
Oct 26
We ran an AI agent swarm on Claude Opus for $98. A single 2.5-cent call gave the same forecast
#
ai
#
llm
#
python
#
datascience
Comments
Add Comment
4 min read
What Actually Happens When a Transformer Thinks Step by Step: The Mechanics of Chain-of-Thought
Syed Anzar
Syed Anzar
Syed Anzar
Follow
Oct 26
What Actually Happens When a Transformer Thinks Step by Step: The Mechanics of Chain-of-Thought
#
ai
#
machinelearning
#
llm
#
transformer
Comments
Add Comment
5 min read
A repair layer is not a reliability layer
Aamer Mihaysi
Aamer Mihaysi
Aamer Mihaysi
Follow
Oct 26
A repair layer is not a reliability layer
#
ai
#
llm
#
agents
Comments
Add Comment
4 min read
I audited 8,946 published AI feedback reports on IELTS essays: do they quote the student exactly?
munimv2
munimv2
munimv2
Follow
Oct 26
I audited 8,946 published AI feedback reports on IELTS essays: do they quote the student exactly?
#
education
#
ai
#
llm
#
opensource
Comments
Add Comment
3 min read
Where the time goes in a live AI call assistant: my code takes 150 ms, the model takes the rest
devs
devs
devs
Follow
Oct 26
Where the time goes in a live AI call assistant: my code takes 150 ms, the model takes the rest
#
ai
#
llm
#
performance
#
python
Comments
Add Comment
4 min read
How to Enable Ollama GPU Acceleration on Intel Arc in Windows
Federico Navarrete
Federico Navarrete
Federico Navarrete
Follow
Oct 26
How to Enable Ollama GPU Acceleration on Intel Arc in Windows
#
ollama
#
llm
#
windows
#
localai
3
reactions
Comments
Add Comment
2 min read
A 14.4 GB model on a 16 GB Mac: keep the right experts, not all of them
Vin Joseph
Vin Joseph
Vin Joseph
Follow
Oct 26
A 14.4 GB model on a 16 GB Mac: keep the right experts, not all of them
#
llm
#
macos
#
typescript
#
opensource
Comments
Add Comment
3 min read
Your Local LLM Isn't Bad at Tool Calling, Your Pipeline Is: Fixing Tool-Call Accuracy in vLLM
EME GUG
EME GUG
EME GUG
Follow
Oct 26
Your Local LLM Isn't Bad at Tool Calling, Your Pipeline Is: Fixing Tool-Call Accuracy in vLLM
#
llm
#
vllm
#
python
#
ai
Comments
Add Comment
7 min read
👋
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
We're a place where coders share, stay up-to-date and grow their careers.
Log in
Create account