7 Agent Eval Mistakes That Cost Me Weeks (And the One-Line Fixes That Ended Them)
Shows common LLM agent evaluation errors and simple fixes for developers.
Why this scored 18
every term, weightedEngagement gained per hour since the last capture, against the fastest item on its own source
Whether that velocity is itself speeding up, as a per-hour rate
How many independent communities are talking about the same entity
Decays to zero over 14 days
Subtracted once something is big and old — we rank what's next, not what's peaked
Weights are hand-tuned, not learned — we're calibrating them against realized trends as history accumulates. On a topic's first sighting there's no previous reading to compare against, so acceleration starts from a neutral prior rather than a measurement, and velocity falls back to engagement over its whole lifetime until a second reading exists. Full methodology
Outlook
low confidence · estimate, not a guarantee7-day
~13
range 0–25
14-day
~9
range 0–23
30-day
~0
range 0–19
Signal history
7-day window (free)projected trajectory (estimate, not a guarantee)
Embed a live signal badge
[](https://www.signalcrest.app/topic/dev%3A4662589)
Drop this in a README or blog post — it updates automatically as the score moves.