DEV Community

Jasmine Park profile picture

Jasmine Park

404 bio not found

Joined Joined on 
One tenant, one polling loop, and $9,100 we didn't budget for

One tenant, one polling loop, and $9,100 we didn't budget for

Comments
5 min read

Want to connect with Jasmine Park?

Create an account to connect with Jasmine Park. You can also sign in below to proceed if you already have an account.

Already have an account? Sign in
Our LLM service had no backpressure. The provider got 7x slower and our p99 got 25x worse.

Our LLM service had no backpressure. The provider got 7x slower and our p99 got 25x worse.

Comments
14 min read
Self-hosted LLM observability: six stacks, weighed by what they cost you to run

Self-hosted LLM observability: six stacks, weighed by what they cost you to run

Comments
5 min read
A $3,900 overnight bill from our LLM eval suite: the incident, and the spend guard I shipped after

A $3,900 overnight bill from our LLM eval suite: the incident, and the spend guard I shipped after

Comments
10 min read
We alerted on errors. The silent failure was a truncated answer.

We alerted on errors. The silent failure was a truncated answer.

Comments
5 min read
Our cache hit rate was 90 percent and the bill still climbed

Our cache hit rate was 90 percent and the bill still climbed

Comments
6 min read
What wakes you at 2am when an enterprise operator deploys your agent

What wakes you at 2am when an enterprise operator deploys your agent

Comments
5 min read
The Langfuse migration that cost us a sprint: how I now budget LLM observability

The Langfuse migration that cost us a sprint: how I now budget LLM observability

Comments
4 min read
The gateway tax: 6 OpenAI-compatible gateways.

The gateway tax: 6 OpenAI-compatible gateways.

1
Comments 1
16 min read
Langfuse alternatives: 6 LLM observability tools, sorted by the thing that bites you in month eight

Langfuse alternatives: 6 LLM observability tools, sorted by the thing that bites you in month eight

Comments
4 min read
Per-project LLM cost attribution with OTel spans: the wiring

Per-project LLM cost attribution with OTel spans: the wiring

Comments
6 min read
Span attributes that catch LLM cost regressions before billing does

Span attributes that catch LLM cost regressions before billing does

Comments
1 min read
loading...