DEV Community

#evaluation

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Your Agent's Pass Rate Doesn't Tell You Whether It Can Notice Its Own Mistake

Your Agent's Pass Rate Doesn't Tell You Whether It Can Notice Its Own Mistake

Comments
5 min read
Model Text Summarization API Cost Comparison: Node.js Invoice Quality Routing

Model Text Summarization API Cost Comparison: Node.js Invoice Quality Routing

Comments
6 min read
7 Ways to Summarize Invoice Text with Chat Completions APIs — Before Posting

7 Ways to Summarize Invoice Text with Chat Completions APIs — Before Posting

Comments
4 min read
AI Agent Evaluation Framework: Claude Code Eval Loop Steps

AI Agent Evaluation Framework: Claude Code Eval Loop Steps

Comments
18 min read
A pre-flight checklist before domain continued pre-training

A pre-flight checklist before domain continued pre-training

Comments
5 min read
Part 5: The scorecard: 11 criteria, and why every score needs evidence

Part 5: The scorecard: 11 criteria, and why every score needs evidence

1
Comments
4 min read
Which Sport Is It? Recognising a Sport Only From How the Players Move

Which Sport Is It? Recognising a Sport Only From How the Players Move

Comments
9 min read
How LLM Evaluation Produces Comparable Numbers: Inside the LFORLA RL Game Agents Benchmark

How LLM Evaluation Produces Comparable Numbers: Inside the LFORLA RL Game Agents Benchmark

Comments
4 min read
Designing a Reliable 4-Layer LLM API for Moderation Review Chatbots

Designing a Reliable 4-Layer LLM API for Moderation Review Chatbots

Comments
5 min read
OpenAI Claude Gemini API Text Summarization for Hiring Rubrics — 3 Portability Checks

OpenAI Claude Gemini API Text Summarization for Hiring Rubrics — 3 Portability Checks

Comments
8 min read
Extra Retrieval Rounds Can Make RAG Worse at Saying "I Don't Know"

Extra Retrieval Rounds Can Make RAG Worse at Saying "I Don't Know"

Comments 1
5 min read
E-commerce Product Retrieval: Duplicate Tests and Source Tracing (and Why I Chose One)

E-commerce Product Retrieval: Duplicate Tests and Source Tracing (and Why I Chose One)

Comments
4 min read
How LLM Evaluation Produces Comparable Numbers: Inside the LFORLA Satellite Geo QCM Benchmark

How LLM Evaluation Produces Comparable Numbers: Inside the LFORLA Satellite Geo QCM Benchmark

Comments
4 min read
Flip One Field: A Fairness Test That Beats Aggregate Parity

Flip One Field: A Fairness Test That Beats Aggregate Parity

Comments
2 min read
It Was Never the Restriction

It Was Never the Restriction

Comments
11 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.