Strengths & Limitations

Balanced assessment

Strengths

  • Resolves over 50% of real GitHub issues on SWE-Bench Verified benchmark.
  • Fully open-source core under MIT license allowing transparency and customization.
  • Scales to thousands of parallel agents in cloud or self-hosted environments.
  • Integrates directly with GitHub, GitLab, Slack, and CI/CD pipelines without setup friction.
  • Provides SDK, CLI, and GUI options for flexible workflows.

Limitations

  • Local setup previously required spinning up sandboxes, though cloud beta now addresses this.
  • Enterprise features are under a separate license and not fully open-source.
  • Public pricing details are unavailable and require contacting sales.