About CRUXEval
Definition and scoring
- Organisation
- CRUXEval authors
- Category
- Coding
- Version
- Not evaluated
- Direction
- higher is better
- Ranking use
- Not Weighted
- Contamination risk
- Unknown
A code-reasoning benchmark based on predicting program inputs and outputs. Results stay tied to the exact model variant and evaluation system. Multiple systems for the same model use the best published score on this page; overall Lumina scoring uses the median of ranking-eligible rows.
Open benchmark source ↗