# What is Obss - Obss

Get started
What is Obss
Build evals and custom benchmarks for real-world tasks, run AI agents on them in managed cloud machines, and measure which tools help.
Obss shows you how well AI agents, such as Claude Code, Codex, and Cursor, do real work with your product, and which tools help them.
You write tasks about your product. Obss runs each one several times, across agents, with and without your tools, and shows pass rates, cost, where agents get stuck, and a full record of every run. The repeats show whether a result holds up.
How it works
You write tasks, choose the tools to compare, and run an experiment. Then you read pass rates and cost on
Matrix
, check which differences are real on
Comparisons
, see where agents got stuck on
Frictions
, fix what you find, and run again.
How Obss works
explains each step.
Here is a finished
Matrix
from the
Stripe interface evals
template. Each row is an agent and treatment, each column is a task, and each cell is a pass rate.
What you can do
Measure a tool's impact
Test whether a skill, MCP server, CLI, or SDK beats
Raw Agent
, which has no tools.
Compare agents and models
Run the same tasks across agents, models, and effort levels, and weigh pass rate against cost.
Track results over time
Run a fixed set of tasks on a schedule to catch regressions.
Find and fix frictions
See where agents get stuck, fix it in your product or setup, and measure again.
Ways to work with Obss
All four work on the same projects, so work you start in one shows up in the others.
Where
Best for
Obss Plugin
Your AI assistant, such as Codex, Claude Code, or Cursor: create tasks, launch experiments, and read results while you work
CLI
Terminal work, scripts, and automation with JSON output
Ask Obss
Plain-language questions and everyday work in the dashboard, and in
Slack
Dashboard
Reading
Matrix
,
Frictions
, and
Traces
, and entering secrets
Secrets, such as API keys and OAuth sign-ins, stay in the dashboard. When the CLI, the plugin, or Ask Obss needs one, it gives you a link to the dashboard page where you enter it.
Obss bills in runs. Every organization starts on a free plan that resets its runs each month, and no credit card is required. Your model providers bill model use separately, through your own keys or subscriptions. See
Pricing
for plans, and subscribe or top up from
Organization settings → Usage & billing
.
Start here
Quickstart
Launch your first experiment and read its results.
How Obss works
Learn the main parts and how they combine into runs.
Install the Obss Plugin
Let your AI assistant work with Obss for you.
Use the CLI
Install
obss
and work from your terminal.
Quickstart
Powered by
This documentation is built and hosted on Mintlify, a developer documentation platform