BeyondSWE

BeyondSWE: Can Current Code Agent Survive Beyond Single-Repo Bug Fixing? BeyondSWE is a comprehensive benchmark that evaluates code agents along two key dimensions — resolution scope and knowledge scope — moving beyond single-repo bug fixing into the real-world deep waters of software engineering. ✨ Highlights 500 real-world instances across 246 GitHub repositories, spanning four distinct task settings Two-dimensional evaluation: simultaneously… See the full description on the dataset page:

Source: Hugging Face Hub (AweAI-Team/BeyondSWE). Metadata imported from the dataset’s Hub tags.