A task with its own rules.
How important are skills for agents?
- Organisation
- Vals AI
- Version
- 2026
Loading benchmark header
Loading benchmark registry
Knowledge / Benchmark profile
How important are skills for agents?
Observed results
1 ranked models · higher is better · labels show rank and score
| Model | Rank | Model ID | Provider | Score | Unit |
|---|---|---|---|---|---|
| Muse Glimmer 30B | #1 | muse-glimmer-30b | Meta | 44.3 | percent |
One best compatible score per canonical product · higher is better
| Rank | Model | Weights | Evidence | Score |
|---|---|---|---|---|
| 01 | Muse Glimmer 30BMeta | Open weights | Public reference | 44.3% |
Each distinct published measurement is retained. Same-snapshot canonical and configuration projections appear once.
| Published model / configuration | Score | Evidence & protocol | Source & dates |
|---|---|---|---|
Muse Glimmer-30B; high reasoning; temperature=1.0; top_p=0.95; top_k=64Muse Glimmer 30BExact identitymuse-glimmer-30b-high Canonical product: muse-glimmer-30b | 44.3% | Public referenceprovider-reportedVersion & system86 tasks / with skills Meta SkillsBench evaluation with mounted skill folders, four attempts | Muse Glimmer Evaluation MethodologyObserved Checked |
From result to context
How important are skills for agents?
The summary shows one best compatible source result per canonical product. Versions, effort settings and execution systems remain attached to the underlying records.
Scores from different versions or harnesses may not be interchangeable. The published source rows preserve those distinctions and their original units. A source result is not automatically an input to a current index.
This catalogue entry preserves available source evidence. Current indices admit only their specifically reviewed tracks and configurations.
Contamination risk: Unknown. Lifecycle: Archived.