Relay

Runs coding agents on your own machine with your model keys, re-running tests before each pull request and keeping lessons.

relayevals.com · Free plan

Visit relayevals.com ↗would rather buy than build

Running since2026Launch year from the maker

Details

What it does: Developer tools
Who it’s for: Developers, Software companies
Pricing: Free plan, Subscription
$10 to $49
Works with: claude, openai, github copilot, google, xai, deepseek, mistral, openrouter, amazon bedrock, modal, github actions
Tags: coding agents, pull requests, test runs, bring your own key, task queue

bugzero
For developers: pulls crash reports out of Sentry or PostHog, drafts a fix in your own GitHub Actions with your AI key, and opens a PR.
Since 2026
Free plan · Developer tools · Developers
CostHawk
Shows engineering leaders how much their team uses AI models, what it costs and who is getting value from it.
Since 2026
Subscription · Developer tools · Developers
Spanlens
Logs every LLM call with cost, latency and agent traces once you change one base URL; hosted or self-hosted.
Free plan · Uptime and monitoring · Developers
stagewise
Coding environment that runs several AI agents in parallel on your codebase, using any model or coding plan you already pay for.
Since 2025
Developer tools · Developers