Skip to main content
Obss has four main parts: tasks (the work), treatments (the tools an agent gets), agents (such as Claude Code or Codex), and the runs they produce. When you know how they fit together, you know exactly what a result compares.

The loop

You can do all of this from the dashboard, Ask Obss, the Obss Plugin in your AI assistant, or the CLI.

Where files, machines, and tools attach

Each part of a run has one home. Files and a machine belong to a task, tools belong to a treatment, and you choose agents when you launch. You create files under Manage → Files, machines under Manage → Machines (Environments), and tools under Manage → Tools. Agents can be built-in or custom (private beta). Learn more in Machines and files, Tools, and Agents. Because each part has one home, a comparison between two treatments changes only the tools, and a comparison between two agents changes only the agent. An experiment runs every combination of task, treatment, agent, and trial, and each combination is one run. To learn how runs are counted and why the comparison is fair, read Experiments. To measure a tool’s impact, choose a baseline at launch and compare each treatment’s pass rate with it on Matrix. The difference is the treatment’s lift.

Main terms

The Glossary defines every other term.

Next steps