Voidly
Atlas · closed-loop active learning

Uncertain forecasts

Help the classifier learn

These are the 54 recent forecasts the classifier is least sure about — predictions sitting near the 0.5 decision threshold. Each one is a high-value labeling opportunity: a single confirmed outcome here teaches the model more than ten labels on easy cases.

Click any candidate to see its full SHAP breakdown, evidence permalinks, and an anonymous label-suggestion form. No login. No personal data required. Three independent reviewers must agree before a label is promoted into the next retrain dataset.

Method: Impact-aware ranking — Settles 2009 (UW TR-1648). Uncertainty fallback — Lewis 1994. Calibrated uncertainty — arXiv 2510.03162 (2025). · Refreshed every 15 min · Raw JSON · Methodology

Does the loop actually improve the model? Honest answer: not yet.

Loop state: plumbed_idle. The loop is wired end to end (queue -> submit-label -> aggregate -> promote -> retrain) and is idle until reviewers label candidates at /atlas/active-learning. We surface the simulated lift even when it is negative.

0.870
Baseline median F1
0.800
After active-learning labels
-0.0696
Simulated median-F1 lift

Queue: 527 candidates. Human label-submission counts are internal operator metrics and are not shown.

  • Active-learning value depends on humans actually labelling. loop_state plumbed_idle means no human labels yet.
  • simulated_f1_lift uses PROXY labels (incident-table positives within +/-3 days, else negative), not human labels. It is an optimistic estimate; treat it as "is the queue surfacing learnable rows", not a promotion signal.

Live source: /v1/sentinel/active-learning-loop-status

uncertainty = 1 - |p - 0.5| × 2 · Lewis & Gale 1994
How submissions become labels

How submissions become labels

  1. You read the evidence, pick a label, and submit anonymously.
  2. Submission lands in an append-only audit log (active_learning_submissions.jsonl). Nothing is overwritten or deleted.
  3. Once 3+ independent reviewers agree on the same candidate, the daily aggregator promotes a consensus label.
  4. The next weekly classifier retrain consumes the consensus file and gates promotion as usual.

Privacy: contact email is optional and only stored in the audit log — never echoed in any read endpoint and stripped from the consensus output. Your IP is hashed for spam-flood detection only (16-hex truncated SHA-256, useless for re-identification).

60 candidate forecasts — ranked by uncertainty

CubaCU
Nov 17, 2026
open
Probability
50%
Distance
0.0pp
Impact
0.60
unc 1.00 × vol 0.60 × drift 1.00
very close to threshold · not yet resolved
Suggest a label →
SwedenSE
Date unavailable
open
Probability
50%
Distance
0.0pp
Impact
0.79
unc 1.00 × vol 0.79 × drift 1.00
very close to threshold · not yet resolved
Suggest a label →
FRFR
Date unavailable
open
Probability
50%
Distance
0.2pp
Impact
0.81
unc 1.00 × vol 0.82 × drift 1.00
very close to threshold · not yet resolved
Suggest a label →
KenyaKE
Date unavailable
open
Probability
50%
Distance
0.2pp
Impact
0.14
unc 1.00 × vol 0.61 × drift 0.23
very close to threshold · not yet resolved
Suggest a label →
CICI
Date unavailable
open
Probability
50%
Distance
0.3pp
Impact
0.06
unc 0.99 × vol 0.42 × drift 0.14
very close to threshold · not yet resolved
Suggest a label →
CICI
Date unavailable
open
Probability
50%
Distance
0.3pp
Impact
0.06
unc 0.99 × vol 0.42 × drift 0.14
very close to threshold · not yet resolved
Suggest a label →
HNHN
Date unavailable
open
Probability
50%
Distance
0.3pp
Impact
0.50
unc 0.99 × vol 0.53 × drift 0.95
very close to threshold · not yet resolved
Suggest a label →
DODO
Date unavailable
open
Probability
50%
Distance
0.3pp
Impact
0.17
unc 0.99 × vol 0.51 × drift 0.34
very close to threshold · not yet resolved
Suggest a label →
OMOM
Date unavailable
open
Probability
50%
Distance
0.3pp
Impact
0.41
unc 0.99 × vol 0.70 × drift 0.58
very close to threshold · not yet resolved
Suggest a label →
LYLY
Date unavailable
open
Probability
50%
Distance
0.3pp
Impact
0.08
unc 0.99 × vol 0.72 × drift 0.12
very close to threshold · not yet resolved
Suggest a label →
PakistanPK
Date unavailable
open
Probability
50%
Distance
0.3pp
Impact
0.63
unc 0.99 × vol 0.74 × drift 0.86
very close to threshold · not yet resolved
Suggest a label →
EthiopiaET
Date unavailable
open
Probability
50%
Distance
0.4pp
Impact
0.25
unc 0.99 × vol 0.73 × drift 0.34
very close to threshold · not yet resolved
Suggest a label →
IndonesiaID
Nov 1, 2026
resolved
Probability
50%
Distance
0.4pp
Impact
0.29
unc 0.99 × vol 0.79 × drift 0.37
very close to threshold · already resolved as correct
Suggest a label →
TurkeyTR
Date unavailable
open
Probability
50%
Distance
0.4pp
Impact
0.29
unc 0.99 × vol 0.78 × drift 0.37
very close to threshold · not yet resolved
Suggest a label →
IranIR
Date unavailable
open
Probability
50%
Distance
0.4pp
Impact
0.81
unc 0.99 × vol 0.82 × drift 1.00
very close to threshold · not yet resolved
Suggest a label →
EgyptEG
Oct 28, 2026
resolved
Probability
50%
Distance
0.4pp
Impact
0.42
unc 0.99 × vol 0.73 × drift 0.58
very close to threshold · already resolved as wrong
Suggest a label →
GEGE
Date unavailable
open
Probability
50%
Distance
0.5pp
Impact
0.07
unc 0.99 × vol 0.57 × drift 0.13
very close to threshold · not yet resolved
Suggest a label →
CICI
Date unavailable
open
Probability
51%
Distance
0.5pp
Impact
0.06
unc 0.99 × vol 0.42 × drift 0.14
very close to threshold · not yet resolved
Suggest a label →
MoroccoMA
Date unavailable
open
Probability
49%
Distance
0.5pp
Impact
0.08
unc 0.99 × vol 0.73 × drift 0.11
very close to threshold · not yet resolved
Suggest a label →
HRHR
Date unavailable
open
Probability
51%
Distance
0.5pp
Impact
0.03
unc 0.99 × vol 0.45 × drift 0.06
very close to threshold · not yet resolved
Suggest a label →
IndiaIN
Date unavailable
open
Probability
51%
Distance
0.6pp
Impact
0.71
unc 0.99 × vol 0.90 × drift 0.79
very close to threshold · not yet resolved
Suggest a label →
HaitiHT
Date unavailable
open
Probability
51%
Distance
0.6pp
Impact
0.07
unc 0.99 × vol 0.36 × drift 0.20
very close to threshold · not yet resolved
Suggest a label →
RussiaRU
Date unavailable
open
Probability
49%
Distance
0.6pp
Impact
0.81
unc 0.99 × vol 0.82 × drift 1.00
very close to threshold · not yet resolved
Suggest a label →
TurkeyTR
Nov 13, 2026
open
Probability
49%
Distance
0.7pp
Impact
0.29
unc 0.99 × vol 0.78 × drift 0.37
very close to threshold · not yet resolved
Suggest a label →
FRFR
Date unavailable
open
Probability
51%
Distance
0.7pp
Impact
0.80
unc 0.99 × vol 0.82 × drift 1.00
very close to threshold · not yet resolved
Suggest a label →
VenezuelaVE
Oct 29, 2026
resolved
Probability
49%
Distance
0.8pp
Impact
0.42
unc 0.98 × vol 0.74 × drift 0.57
very close to threshold · already resolved as wrong
Suggest a label →
NONO
Date unavailable
open
Probability
51%
Distance
0.8pp
Impact
0.04
unc 0.98 × vol 0.71 × drift 0.02
very close to threshold · not yet resolved
Suggest a label →
FRFR
Date unavailable
open
Probability
51%
Distance
0.9pp
Impact
0.80
unc 0.98 × vol 0.82 × drift 1.00
very close to threshold · not yet resolved
Suggest a label →
KHKH
Date unavailable
open
Probability
49%
Distance
0.9pp
Impact
0.50
unc 0.98 × vol 0.73 × drift 0.70
very close to threshold · not yet resolved
Suggest a label →
CameroonCM
Date unavailable
open
Probability
51%
Distance
1.0pp
Impact
0.15
unc 0.98 × vol 0.74 × drift 0.21
very close to threshold · not yet resolved
Suggest a label →
GEGE
Date unavailable
open
Probability
51%
Distance
1.0pp
Impact
0.07
unc 0.98 × vol 0.57 × drift 0.13
very close to threshold · not yet resolved
Suggest a label →
CameroonCM
Date unavailable
open
Probability
51%
Distance
1.0pp
Impact
0.15
unc 0.98 × vol 0.74 × drift 0.21
very close to threshold · not yet resolved
Suggest a label →
CameroonCM
Date unavailable
open
Probability
51%
Distance
1.1pp
Impact
0.15
unc 0.98 × vol 0.74 × drift 0.21
very close to threshold · not yet resolved
Suggest a label →
UzbekistanUZ
Date unavailable
open
Probability
51%
Distance
1.2pp
Impact
0.19
unc 0.98 × vol 0.72 × drift 0.28
very close to threshold · not yet resolved
Suggest a label →
MyanmarMM
Nov 12, 2026
open
Probability
49%
Distance
1.2pp
Impact
0.71
unc 0.98 × vol 0.72 × drift 1.00
very close to threshold · not yet resolved
Suggest a label →
SwedenSE
Date unavailable
open
Probability
49%
Distance
1.2pp
Impact
0.77
unc 0.98 × vol 0.79 × drift 1.00
very close to threshold · not yet resolved
Suggest a label →
SwedenSE
Date unavailable
open
Probability
49%
Distance
1.2pp
Impact
0.77
unc 0.98 × vol 0.79 × drift 1.00
very close to threshold · not yet resolved
Suggest a label →
GHGH
Date unavailable
open
Probability
49%
Distance
1.3pp
Impact
0.14
unc 0.98 × vol 0.53 × drift 0.27
very close to threshold · not yet resolved
Suggest a label →
RussiaRU
Date unavailable
open
Probability
49%
Distance
1.4pp
Impact
0.80
unc 0.97 × vol 0.82 × drift 1.00
very close to threshold · not yet resolved
Suggest a label →
AlgeriaDZ
Date unavailable
open
Probability
49%
Distance
1.4pp
Impact
0.05
unc 0.97 × vol 0.63 × drift 0.08
very close to threshold · not yet resolved
Suggest a label →
FRFR
Date unavailable
open
Probability
49%
Distance
1.4pp
Impact
0.79
unc 0.97 × vol 0.82 × drift 1.00
very close to threshold · not yet resolved
Suggest a label →
TurkeyTR
Nov 1, 2026
resolved
Probability
48%
Distance
1.6pp
Impact
0.28
unc 0.97 × vol 0.78 × drift 0.37
very close to threshold · already resolved as wrong
Suggest a label →
IranIR
Oct 29, 2026
resolved
Probability
52%
Distance
1.6pp
Impact
0.79
unc 0.97 × vol 0.82 × drift 1.00
very close to threshold · already resolved as wrong
Suggest a label →
CameroonCM
Date unavailable
open
Probability
52%
Distance
1.6pp
Impact
0.15
unc 0.97 × vol 0.74 × drift 0.21
very close to threshold · not yet resolved
Suggest a label →
RussiaRU
Nov 18, 2026
open
Probability
48%
Distance
1.7pp
Impact
0.80
unc 0.97 × vol 0.82 × drift 1.00
very close to threshold · not yet resolved
Suggest a label →
FRFR
Date unavailable
open
Probability
52%
Distance
1.7pp
Impact
0.79
unc 0.97 × vol 0.82 × drift 1.00
very close to threshold · not yet resolved
Suggest a label →
RussiaRU
Date unavailable
open
Probability
52%
Distance
1.7pp
Impact
0.79
unc 0.97 × vol 0.82 × drift 1.00
very close to threshold · not yet resolved
Suggest a label →
IndiaIN
Nov 15, 2026
open
Probability
48%
Distance
1.7pp
Impact
0.69
unc 0.97 × vol 0.90 × drift 0.79
very close to threshold · not yet resolved
Suggest a label →
ItalyIT
Date unavailable
open
Probability
48%
Distance
1.7pp
Impact
0.11
unc 0.97 × vol 0.77 × drift 0.15
very close to threshold · not yet resolved
Suggest a label →
DODO
Date unavailable
open
Probability
48%
Distance
1.7pp
Impact
0.17
unc 0.97 × vol 0.51 × drift 0.34
very close to threshold · not yet resolved
Suggest a label →
DODO
Date unavailable
open
Probability
48%
Distance
1.7pp
Impact
0.17
unc 0.97 × vol 0.51 × drift 0.34
very close to threshold · not yet resolved
Suggest a label →
IranIR
Nov 10, 2026
open
Probability
52%
Distance
1.8pp
Impact
0.79
unc 0.96 × vol 0.82 × drift 1.00
very close to threshold · not yet resolved
Suggest a label →
BahrainBH
Date unavailable
open
Probability
52%
Distance
1.8pp
Impact
0.09
unc 0.96 × vol 0.51 × drift 0.18
very close to threshold · not yet resolved
Suggest a label →
SwedenSE
Date unavailable
open
Probability
48%
Distance
1.9pp
Impact
0.76
unc 0.96 × vol 0.79 × drift 1.00
very close to threshold · not yet resolved
Suggest a label →
AzerbaijanAZ
Date unavailable
open
Probability
52%
Distance
1.9pp
Impact
0.41
unc 0.96 × vol 0.73 × drift 0.58
very close to threshold · not yet resolved
Suggest a label →
EgyptEG
Nov 9, 2026
resolved
Probability
48%
Distance
1.9pp
Impact
0.40
unc 0.96 × vol 0.73 × drift 0.58
very close to threshold · already resolved as correct
Suggest a label →
AzerbaijanAZ
Date unavailable
open
Probability
52%
Distance
1.9pp
Impact
0.41
unc 0.96 × vol 0.73 × drift 0.58
very close to threshold · not yet resolved
Suggest a label →
AEAE
Date unavailable
open
Probability
48%
Distance
1.9pp
Impact
0.57
unc 0.96 × vol 0.75 × drift 0.79
very close to threshold · not yet resolved
Suggest a label →
EgyptEG
Date unavailable
open
Probability
52%
Distance
2.0pp
Impact
0.40
unc 0.96 × vol 0.73 × drift 0.58
very close to threshold · not yet resolved
Suggest a label →
EgyptEG
Nov 13, 2026
open
Probability
52%
Distance
2.0pp
Impact
0.40
unc 0.96 × vol 0.73 × drift 0.58
very close to threshold · not yet resolved
Suggest a label →

Related