DEV Community

#evals

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Evals before prompts: a small eval harness for an LLM feature
ahmad_dogar_7d098f5e48f72 profile

Evals before prompts: a small eval harness for an LLM feature

#ai #llm #evals #testing
Comments
9 min read
Pick Your LLM With Your Own Prompt: A Side-by-Side Model Comparison Tool
aws_sa_sg profile

Pick Your LLM With Your Own Prompt: A Side-by-Side Model Comparison Tool

#ai #evals #chatgpt #claude
Comments
7 min read
Jev is not as cheap as you think. Unless it is.
jagostoni profile

Jev is not as cheap as you think. Unless it is.

#ai #jev #evals #webdev
Comments
6 min read
The Safety Check That Runs on the Conversation, Not the Turn
basavaraj_sh_1ea7d95f0f2e profile

The Safety Check That Runs on the Conversation, Not the Turn

#llm #ai #evals #trustandsafety
Comments 1
2 min read
The Model Changed. My Skill Didn't. The Score Still Dropped.
oliverzehentleitner profile

The Model Changed. My Skill Didn't. The Score Still Dropped.

#ai #evals #agents #codereview
1
Comments 1
7 min read
Write the eval before the prompt
zeybek profile

Write the eval before the prompt

#llm #testing #aiengineering #evals
1
Comments
7 min read
How to Evaluate AI Agents: Reliability, Cost, Latency, and Failure Modes
fernandoabishai profile
FA33

How to Evaluate AI Agents: Reliability, Cost, Latency, and Failure Modes

#ai #agents #evals #reliability
Comments
7 min read
You changed one line of your agent's prompt. What else broke?
vivek_1122 profile

You changed one line of your agent's prompt. What else broke?

#ai #agents #evals #testing
Comments 2
3 min read
Where AI agent test cases come from: synthetic vs. production data
nicolai_bohn_rhesis profile

Where AI agent test cases come from: synthetic vs. production data

#agents #ai #llm #evals
Comments 3
4 min read
What a Passing Eval Still Doesn’t Tell You
sjarmak profile

What a Passing Eval Still Doesn’t Tell You

#aie #evals #testing #agents
7
Comments 2
4 min read
Building Better Agents through End-to-End Evals

Synthetic worlds expose real mess
ryan_stevens profile

Building Better Agents through End-to-End Evals

#ai #agents #evals #aie
36
Comments 12
3 min read
Inside the $30-a-Week Self-Improving Agents Eliminating Enterprise Back-Office Friction

AI Engineer Conference Coverage
karasilv profile

Inside the $30-a-Week Self-Improving Agents Eliminating Enterprise Back-Office Friction

#ai #agents #evals #aie
13
Comments 1
3 min read
Can You Tell an Eval from a Review?
shimo4228 profile

Can You Tell an Eval from a Review?

#claudecode #evaluation #evals #llmops
Comments 1
21 min read
Badge or evidence: what a deployed-agent engineer should be able to show
ascotlan profile

Badge or evidence: what a deployed-agent engineer should be able to show

#agents #career #canada #evals
2
Comments 3
8 min read
My grader got every real answer right. Four red teams still broke it.
vishalhabib99 profile

My grader got every real answer right. Four red teams still broke it.

#ai #testing #quantum #evals
Comments 5
3 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.