Skip to content
Signalcrest
Back to entity feed
aientity · one source so far

swebench

for ML benchmark curators

Steadyarxiv
Signal score
8
as of 2d ago
Live items
1
Trajectory
Accelerating
7-day est. ~12

Why this scored 8

every term, weighted
Velocity+0.0 / 40

Its fastest-moving item, measured against the pace of its own source

Acceleration+9.9 / 25

Whether that velocity is itself speeding up, as a per-hour rate

Cross-source spread+0.0 / 25

How many independent communities its own items come from

Recency+0.0 / 10

Decays to zero over 14 days, counted from when we first saw it

Saturation penalty1.8 / 30

Subtracted once something is big and old — sized by its biggest item, aged from when we first saw it

Composite8.1

Weights are hand-tuned, not learned — we're calibrating them against realized trends as history accumulates. On an entity's first sighting there's no previous reading to compare against, so acceleration starts from a neutral prior rather than a measurement, and velocity falls back to engagement over its whole lifetime until a second reading exists. Full methodology

Outlook

low confidence · estimate, not a guarantee

7-day

~12

range 023

14-day

~12

range 026

30-day

~12

range 031

Signal history

7-day window (free)
312

projected trajectory (estimate, not a guarantee)

The evidence

The live items this entity's score aggregates — every community independently talking about it right now. This is the corroboration, shown, not claimed.

  1. 1
    19

    Coding Agents Have Converged: Why the SWE-bench Leaderboard Can No Longer Order Its Top Entries, and What to Measure Instead

    Shows SWE-bench leaderboard saturation and suggests new metrics for coding agents. · for ML benchmark curators

    arxivSteadyai3d ago
  2. 2
    0

    SWE-bench/SWE-bench_Verified (dataset)

    Software engineering dataset · for software engineers

    huggingfaceSteadydata13 saturated47d ago