Tag: benchmark

All the articles with the tag "benchmark".

• SlopCodeBench: Measuring Code Erosion Under Iterative Specification Refinement

  G. Orlanski , D. Roy , A. Yun , C. Shin , A. Gu , A. Ge , D. Adila , A. Albarghouthi , and F. Sala

  View code on GitHub Paper View paper on arXiv | 2025 | Technical Report

  SlopCodeBench evaluates AI coding agents under iterative specification updates. Unlike single-shot benchmarks, SCBench reveals verbosity and structural erosion that make agent-written code unmaintainable over time.