Skip to content
Navigation menu
Search
Powered by Algolia
Search
Log in
Create account
DEV Community
Close
#
benchmark
Follow
Hide
Posts
Left menu
👋
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
Right menu
Your Benchmark Has No Cost Axis: Score Free Endpoints by Quota per Accepted Patch
Casey Zhang
Casey Zhang
Casey Zhang
Follow
Oct 26
Your Benchmark Has No Cost Axis: Score Free Endpoints by Quota per Accepted Patch
#
benchmark
#
ai
#
testing
#
python
Comments
Add Comment
6 min read
Which of your LLM calls are really decisions? What we measured with a System One model
Devji
Devji
Devji
Follow
for
Dwayo AI
Oct 26
Which of your LLM calls are really decisions? What we measured with a System One model
#
ai
#
llm
#
benchmark
#
machinelearning
Comments
Add Comment
7 min read
Parakeet v3 vs Whisper vs Apple's on-device model in 25 languages, every transcript published
yapapp
yapapp
yapapp
Follow
Oct 26
Parakeet v3 vs Whisper vs Apple's on-device model in 25 languages, every transcript published
#
machinelearning
#
speechrecognition
#
whisper
#
benchmark
1
reaction
Comments
1
comment
3 min read
Reading a Hardware-Equivalence Claim Like an Evaluator: A Checklist Applied to an NPU vs GPU Pretraining Twin
Ward Ed
Ward Ed
Ward Ed
Follow
Oct 26
Reading a Hardware-Equivalence Claim Like an Evaluator: A Checklist Applied to an NPU vs GPU Pretraining Twin
#
ai
#
machinelearning
#
benchmark
#
llm
Comments
Add Comment
2 min read
vLLM on three GPUs: Qwen2.5-7B tokens per second and cost per 1M tokens on RTX A6000, L40S and H100
Runcrate
Runcrate
Runcrate
Follow
Oct 26
vLLM on three GPUs: Qwen2.5-7B tokens per second and cost per 1M tokens on RTX A6000, L40S and H100
#
vllm
#
llm
#
gpu
#
benchmark
1
reaction
Comments
Add Comment
5 min read
Benchmark 2026: Probamos 50 Agentes de IA para Ecommerce con 10 Preguntas Difíciles (Arquitectura, Latencia y Conversión)
iTRAFIC
iTRAFIC
iTRAFIC
Follow
Oct 25
Benchmark 2026: Probamos 50 Agentes de IA para Ecommerce con 10 Preguntas Difíciles (Arquitectura, Latencia y Conversión)
#
ecommerce
#
ai
#
webdev
#
benchmark
Comments
Add Comment
3 min read
Six open models, one question: 1.3 s for the fastest answer, 16 s for the slowest, and hidden thinking made the difference
Runcrate
Runcrate
Runcrate
Follow
Oct 25
Six open models, one question: 1.3 s for the fastest answer, 16 s for the slowest, and hidden thinking made the difference
#
llm
#
benchmark
#
python
#
ai
Comments
Add Comment
5 min read
How LLM Evaluation Produces Comparable Numbers: Inside the LFORLA RL Game Agents Benchmark
RESK
RESK
RESK
Follow
Oct 24
How LLM Evaluation Produces Comparable Numbers: Inside the LFORLA RL Game Agents Benchmark
#
llm
#
evaluation
#
benchmark
#
reinforcementlearnin
Comments
Add Comment
4 min read
ScaleDown CDMs: Fast, Cheap Classify, Extract and Summarize Models Tested
Ishank Choudhary
Ishank Choudhary
Ishank Choudhary
Follow
Oct 24
ScaleDown CDMs: Fast, Cheap Classify, Extract and Summarize Models Tested
#
ai
#
llm
#
machinelearning
#
benchmark
Comments
Add Comment
8 min read
What a Youden index of 77 actually means on the OWASP Benchmark
Ward Ed
Ward Ed
Ward Ed
Follow
Oct 23
What a Youden index of 77 actually means on the OWASP Benchmark
#
security
#
appsec
#
benchmark
#
testing
Comments
Add Comment
1 min read
AI 신약 설계 챌린지 2만 3,886건의 점수표를 뜯어 보니: 만점에 닿은 축과 한 번도 닿지 못한 축
Vidraft_lab
Vidraft_lab
Vidraft_lab
Follow
Oct 22
AI 신약 설계 챌린지 2만 3,886건의 점수표를 뜯어 보니: 만점에 닿은 축과 한 번도 닿지 못한 축
#
ai
#
python
#
datascience
#
benchmark
Comments
Add Comment
4 min read
Benchmarking 6 Open LLMs on a 2-Machine RPC Cluster (Consumer GPUs, ~96GB VRAM)
faliye
faliye
faliye
Follow
Oct 22
Benchmarking 6 Open LLMs on a 2-Machine RPC Cluster (Consumer GPUs, ~96GB VRAM)
#
ai
#
llm
#
benchmark
#
llama
Comments
Add Comment
6 min read
SelectPdf vs IronPDF in 2026, measured on Windows and Linux
Florentin Badea
Florentin Badea
Florentin Badea
Follow
Oct 22
SelectPdf vs IronPDF in 2026, measured on Windows and Linux
#
dotnet
#
csharp
#
pdf
#
benchmark
1
reaction
Comments
Add Comment
7 min read
How LLM Evaluation Produces Comparable Numbers: Inside the LFORLA Satellite Geo QCM Benchmark
RESK
RESK
RESK
Follow
Oct 22
How LLM Evaluation Produces Comparable Numbers: Inside the LFORLA Satellite Geo QCM Benchmark
#
llm
#
evaluation
#
benchmark
#
geo
Comments
Add Comment
4 min read
2위와 0.05점 차이도 1위일까: 허깅페이스 보드 44곳에서 자사 1위 11개의 두께를 재 봤습니다
Vidraft_lab
Vidraft_lab
Vidraft_lab
Follow
Oct 21
2위와 0.05점 차이도 1위일까: 허깅페이스 보드 44곳에서 자사 1위 11개의 두께를 재 봤습니다
#
ai
#
machinelearning
#
benchmark
#
llm
Comments
Add Comment
4 min read
👋
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
We're a place where coders share, stay up-to-date and grow their careers.
Log in
Create account