ML system evaluation and metrics Questions

Design comprehensive evaluation strategies including offline metrics (precision, recall, F1, AUC, calibration), online metrics (A/B test setup, statistical significance), and business metrics. Understand metric limitations and how to avoid gaming metrics.