DEV Community

Runcrate profile picture

Runcrate

GPU cloud for AI developers and their agents: on-demand GPUs, 200+ open models behind one OpenAI-compatible API, and an MCP server. runcrate.ai

Joined Joined on  Personal website https://www.runcrate.ai
4 GPUs, 2x speed: why PyTorch DDP stalled on a PCIe-only 4x RTX A6000, and two flags that took it to 3.6x

4 GPUs, 2x speed: why PyTorch DDP stalled on a PCIe-only 4x RTX A6000, and two flags that took it to 3.6x

Comments
4 min read
How long until a rented GPU runs CUDA? Launch to first matmul on six GPU types, timed

How long until a rented GPU runs CUDA? Launch to first matmul on six GPU types, timed

Comments
5 min read
vLLM on three GPUs: Qwen2.5-7B tokens per second and cost per 1M tokens on RTX A6000, L40S and H100

vLLM on three GPUs: Qwen2.5-7B tokens per second and cost per 1M tokens on RTX A6000, L40S and H100

1
Comments
5 min read
Six open models, one question: 1.3 s for the fastest answer, 16 s for the slowest, and hidden thinking made the difference

Six open models, one question: 1.3 s for the fastest answer, 16 s for the slowest, and hidden thinking made the difference

Comments
5 min read
Run your LLM evals every night on a GPU that only exists for a minute

Run your LLM evals every night on a GPU that only exists for a minute

Comments
5 min read
Fine-tune an open model on one GPU with a job that stops itself ($0.05, 4 minutes)

Fine-tune an open model on one GPU with a job that stops itself ($0.05, 4 minutes)

Comments
5 min read
How to compare GPU cloud prices without fooling yourself

How to compare GPU cloud prices without fooling yourself

Comments
5 min read
Switch from OpenAI to open models in two lines (streaming, tools and JSON mode still work)

Switch from OpenAI to open models in two lines (streaming, tools and JSON mode still work)

Comments
4 min read
Give your coding agent a GPU, and a budget: the Runcrate MCP server in Claude Code, Codex and Cursor

Give your coding agent a GPU, and a budget: the Runcrate MCP server in Claude Code, Codex and Cursor

Comments
4 min read
loading...