Skip to content
Signalcrest
Back to feed
devtoai

Three perfect scores weren't enough: testing AI outage decisions one fact at a time

Another Kaggle task evaluates AI outage decisions fact-by-fact, stressing reliability testing.

Steady
Signal score
17
as of 1d ago
Trajectory
⏳ Too early
needs a few more snapshots

Why this scored 17

every term, weighted
Velocity+0.0 / 40

Engagement gained per hour since the last capture, against the fastest item on its own source

Acceleration+7.8 / 25

Whether that velocity is itself speeding up, as a per-hour rate

Cross-source spread+0.0 / 25

How many independent communities are talking about the same entity

Recency+9.5 / 10

Decays to zero over 14 days

Saturation penalty−0.2 / 30

Subtracted once something is big and old — we rank what's next, not what's peaked

Composite17.1

Weights are hand-tuned, not learned — we're calibrating them against realized trends as history accumulates. On a topic's first sighting there's no previous reading to compare against, so acceleration starts from a neutral prior rather than a measurement, and velocity falls back to engagement over its whole lifetime until a second reading exists. Full methodology

Signal history

7-day window (free)
1542
Embed a live signal badge
Signalcrest signal badge
[![Signalcrest signal](https://www.signalcrest.app/api/badge/dev%3A4729642)](https://www.signalcrest.app/topic/dev%3A4729642)

Drop this in a README or blog post — it updates automatically as the score moves.