Last updated: 2026-10-30
What is SWE-bench?
Benchmark testing whether an agent can resolve real GitHub issues by reading the repo, writing a patch, and passing the project's tests. The closest thing to a "can it ship code?" score. The original test set has 2,294 issues; the commonly reported Verified subset has 500, so check which one a score refers to.
See also
← Back to the full AI agent glossary.