06
Domain 06
Trust & Structure
Cross-validation strategies, SHAP, conformal intervals, fairness slices, k-means, and forecasting validation.
6 questions
- Q31Why might 0.91 be optimistic, and which splitter fixes it?6,000 customers, 80,000 tickets, plain KFold. Why 0.91 is a mirage.
- Q32How should a loan officer read this plot?Read a SHAP waterfall the way a loan officer must.
- Q33What does the 90% guarantee mean?A 90% conformal interval. What exactly is being promised?
- Q34What will go wrong, and what is the fix?RFM clustering on raw dollars. Guess which column wins.
- Q35What should the team conclude?Equal accuracy, unequal false negatives. Is the model fair?
- Q36What is the most likely cause of the gap?4% MAPE offline, 14% live. The split that saw the future.