Why monitor prediction distributions rather than waiting for accuracy metrics?
- A Ground truth labels often arrive late or never, so distributions are leading indicators
- B Accuracy cannot be computed in production
- C It is cheaper
- D Regulators require it
Answer
Ground truth labels often arrive late or never, so distributions are leading indicators
By the time accuracy degrades measurably, the model has already been making poor decisions for some time.





