EVALUATE — Confidence Scoring

Package: tools-impact-engine-evaluate

Purpose

Assign a confidence score based on methodology reliability.

Inputs (from MEASURE)

  • Effect estimate + CI bounds

  • Model type

  • Diagnostics

Produces

  • Confidence score (0-1)

  • Scenario returns (R_best, R_med, R_worst from CI bounds)

Confidence by Methodology

Model Type

Confidence Range

Rationale

Experiment (RCT)

0.85 - 1.0

Gold standard causal inference

Quasi-experiment

0.60 - 0.84

Strong but with assumptions

Time-series

0.40 - 0.59

Trend-based, confounding risk

Observational

0.20 - 0.39

Correlation, high bias risk