InterviewStack.io LogoInterviewStack.io

Customer Health Metrics and Scoring Questions

Designing, implementing, and operating customer health measurement systems that combine multiple signals into scores or segments to predict outcomes such as churn, retention, and expansion. Includes selecting and justifying leading indicators versus lagging indicators and choosing relevant data inputs such as product usage patterns, engagement frequency, feature adoption, support ticket volume, payment and billing signals, account changes, and customer sentiment including net promoter score. Covers approaches to constructing scores using rule based logic, weighted indices, statistical models, and machine learning models, as well as feature engineering, handling missing data, and robustness checks. Describes calibration of score ranges and thresholds into actionable risk or opportunity categories, validation techniques including backtesting and cohort analysis, evaluation metrics and performance monitoring, and methods for measuring business impact through lift analysis and controlled experiments. Also addresses operationalization and production considerations such as batch versus real time scoring, event driven pipelines, integration with customer relationship management systems and workflow automation, dashboards and alerts for operational teams, prioritization and playbook design for interventions, monitoring for data drift and model staleness, feedback loops for retraining and improvement, explainability for stakeholder trust, and governance for privacy and data compliance.

MediumTechnical
46 practiced
You have a continuous health score (0-100). Describe a method to map scores into three operational buckets (green/amber/red) with defensible thresholds. Include how you'd use historical outcomes, business capacity, and calibration plots to choose thresholds, and describe one way to validate thresholds before full rollout.
HardTechnical
45 practiced
Implement in Python a function that takes per-user time-series event counts (timestamped events like logins) and returns candidate leading indicators by detecting change points (sudden drops or spikes) over the past 90 days. Use any reasonable library (e.g., ruptures) and output per-account indicators such as 'recent_drop' boolean and 'drop_magnitude' as a percent. Provide clear comments.
HardTechnical
62 practiced
Write a performant SQL procedure or query pattern that computes features across overlapping time windows (e.g., weekly and monthly aggregates) without double-counting events when the same event-type contributes to both windows. Describe how you would index or partition tables for performance on large datasets.
MediumTechnical
82 practiced
Given the following simplified sessions table schema:
sessions(session_id PK, account_id, user_id, start_ts timestamp, end_ts timestamp, device text)
Write a SQL query that computes per account, over the last 28 days: active_days (number of distinct days with >=1 session), avg_session_length_seconds, and days_since_last_session. Use standard SQL and window functions where helpful.
HardTechnical
84 practiced
Design a method to automatically detect concept drift for specific features used in the health score and suggest when to trigger model retraining. Include statistical tests, thresholds, drift attribution, and a feedback loop with quality checks before retraining.

Unlock Full Question Bank

Get access to hundreds of Customer Health Metrics and Scoring interview questions and detailed answers.

Sign in to Continue

Join thousands of developers preparing for their dream job.