LangWatch

Platform for AI teams to trace, simulate and evaluate their LLM agents and keep track of model spend.

langwatch.ai

Visit langwatch.ai ↗would rather buy than build

Details

What it does: Uptime and monitoring, Developer tools
Who it’s for: Developers, Software companies
Works on: Web
Extras: Open source, Can self-host
Works with: github, claude code
Tags: agent testing, llm evals, llm observability, prompt management, ai gateway

Helicone
Gateway and dashboard that routes LLM requests and logs them so teams can debug and analyse their AI apps.
Free trial · Uptime and monitoring · Developers
Selfship
Watches your AI agent's real traffic, finds where it fails customers and opens tested pull requests with fixes.
Since 2026
Subscription · Uptime and monitoring · Developers
CoIsland
Mac app that pulls builds, deploys, pull requests and errors into one small inbox and hands fixes to a coding agent.
Free plan · Uptime and monitoring · Developers
Kelet
Monitors AI agents and LLM apps running live for engineering teams, works out why they break and proposes prompt fixes.
Since 2026
Free · Uptime and monitoring · Developers