Skip to content
Navigation menu
Search
Powered by Algolia
Search
Log in
Create account
DEV Community
Close
#
evaluation
Follow
Hide
Posts
Left menu
đź‘‹
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
Right menu
Your Agent's Pass Rate Doesn't Tell You Whether It Can Notice Its Own Mistake
Igor Eduardo
Igor Eduardo
Igor Eduardo
Follow
Oct 26
Your Agent's Pass Rate Doesn't Tell You Whether It Can Notice Its Own Mistake
#
ai
#
agents
#
evaluation
#
llm
Comments
Add Comment
5 min read
Model Text Summarization API Cost Comparison: Node.js Invoice Quality Routing
YvesSterling6854
YvesSterling6854
YvesSterling6854
Follow
Oct 26
Model Text Summarization API Cost Comparison: Node.js Invoice Quality Routing
#
ai
#
python
#
node
#
evaluation
Comments
Add Comment
6 min read
7 Ways to Summarize Invoice Text with Chat Completions APIs — Before Posting
IgnazCole6453
IgnazCole6453
IgnazCole6453
Follow
Oct 26
7 Ways to Summarize Invoice Text with Chat Completions APIs — Before Posting
#
node
#
summarize
#
invoices
#
evaluation
Comments
Add Comment
4 min read
AI Agent Evaluation Framework: Claude Code Eval Loop Steps
Aoba Works
Aoba Works
Aoba Works
Follow
Oct 25
AI Agent Evaluation Framework: Claude Code Eval Loop Steps
#
agentevals
#
claudecode
#
aiagents
#
evaluation
Comments
Add Comment
18 min read
A pre-flight checklist before domain continued pre-training
Conor Bronsdon
Conor Bronsdon
Conor Bronsdon
Follow
Oct 24
A pre-flight checklist before domain continued pre-training
#
ai
#
llm
#
finetuning
#
evaluation
Comments
Add Comment
5 min read
Part 5: The scorecard: 11 criteria, and why every score needs evidence
Shakar Bisetty
Shakar Bisetty
Shakar Bisetty
Follow
Oct 25
Part 5: The scorecard: 11 criteria, and why every score needs evidence
#
ai
#
agents
#
architecture
#
evaluation
1
 reaction
Comments
Add Comment
4 min read
Which Sport Is It? Recognising a Sport Only From How the Players Move
JaviMaligno
JaviMaligno
JaviMaligno
Follow
Oct 24
Which Sport Is It? Recognising a Sport Only From How the Players Move
#
ai
#
vision
#
sports
#
evaluation
Comments
Add Comment
9 min read
How LLM Evaluation Produces Comparable Numbers: Inside the LFORLA RL Game Agents Benchmark
RESK
RESK
RESK
Follow
Oct 24
How LLM Evaluation Produces Comparable Numbers: Inside the LFORLA RL Game Agents Benchmark
#
llm
#
evaluation
#
benchmark
#
reinforcementlearnin
Comments
Add Comment
4 min read
Designing a Reliable 4-Layer LLM API for Moderation Review Chatbots
BenedictVance6863
BenedictVance6863
BenedictVance6863
Follow
Oct 23
Designing a Reliable 4-Layer LLM API for Moderation Review Chatbots
#
ai
#
llm
#
customersupport
#
evaluation
Comments
Add Comment
5 min read
OpenAI Claude Gemini API Text Summarization for Hiring Rubrics — 3 Portability Checks
JasperFlint6947
JasperFlint6947
JasperFlint6947
Follow
Oct 23
OpenAI Claude Gemini API Text Summarization for Hiring Rubrics — 3 Portability Checks
#
ai
#
python
#
evaluation
Comments
Add Comment
8 min read
Extra Retrieval Rounds Can Make RAG Worse at Saying "I Don't Know"
Igor Eduardo
Igor Eduardo
Igor Eduardo
Follow
Oct 23
Extra Retrieval Rounds Can Make RAG Worse at Saying "I Don't Know"
#
ai
#
rag
#
evaluation
#
llm
Comments
1
 comment
5 min read
E-commerce Product Retrieval: Duplicate Tests and Source Tracing (and Why I Chose One)
jaxmonroe3187
jaxmonroe3187
jaxmonroe3187
Follow
Oct 23
E-commerce Product Retrieval: Duplicate Tests and Source Tracing (and Why I Chose One)
#
search
#
rag
#
ecommerce
#
evaluation
Comments
Add Comment
4 min read
How LLM Evaluation Produces Comparable Numbers: Inside the LFORLA Satellite Geo QCM Benchmark
RESK
RESK
RESK
Follow
Oct 22
How LLM Evaluation Produces Comparable Numbers: Inside the LFORLA Satellite Geo QCM Benchmark
#
llm
#
evaluation
#
benchmark
#
geo
Comments
Add Comment
4 min read
Flip One Field: A Fairness Test That Beats Aggregate Parity
Basavaraj SH
Basavaraj SH
Basavaraj SH
Follow
Oct 21
Flip One Field: A Fairness Test That Beats Aggregate Parity
#
llm
#
evaluation
#
fairness
#
python
Comments
Add Comment
2 min read
It Was Never the Restriction
JaviMaligno
JaviMaligno
JaviMaligno
Follow
Oct 20
It Was Never the Restriction
#
ai
#
agents
#
evaluation
#
enterprise
Comments
Add Comment
11 min read
đź‘‹
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
We're a place where coders share, stay up-to-date and grow their careers.
Log in
Create account