Growth & Business Optimization Topics
Growth strategies, experimentation frameworks, and business optimization. Includes A/B testing, conversion optimization, and growth playbooks.
Metrics Selection and Diagnostic Interpretation
Addresses how to choose appropriate metrics and how to interpret and diagnose metric changes. Includes selecting primary and secondary metrics for experiments and initiatives, balancing leading indicators against lagging indicators, avoiding metric gaming, and handling conflicting signals when different metrics move in different directions. Also covers anomaly detection and root cause diagnosis: given a metric change, enumerate potential causes, propose investigative steps, identify supporting diagnostic metrics or logs, design quick experiments or data queries to validate hypotheses, and recommend remedial actions. Communication of nuanced or inconclusive results to non technical stakeholders is also emphasized.
Growth and Product Metrics Analysis
Analysis skills specific to growth and product contexts: interpreting funnel metrics, cohort and retention analyses, attribution of acquisition versus activation, detecting seasonality and external event impacts, and diagnosing conversion or engagement changes. Candidates should be able to form hypotheses about what drove changes, propose targeted follow up analyses or A B tests, and identify which additional metrics are needed to evaluate unit economics and growth efficiency.
Metric Frameworks and Goal Alignment
Understand how to choose, define, and apply metric frameworks that align product work to company objectives. Topics include common frameworks such as Acquisition, Activation, Retention, Revenue, Referral as well as selecting a single North Star metric that represents overall business success. Candidates should be able to define metrics at multiple levels including feature level, product level, and business level; distinguish leading indicators from lagging indicators and explain how leading metrics predict lagging outcomes; decompose a North Star into measurable submetrics and team level signals that teams can influence directly; set measurable targets and success criteria; and explain why a given metric is the most appropriate North Star for a particular business model. Practice scenarios include choosing metrics for feature launches, improving conversion or retention, reducing friction in checkout flows, and increasing engagement or virality, and describing how those metrics map to business outcomes and Objectives and Key Results.
A/B Testing and Optimization Methodology
Discuss your experience designing and running A/B tests on content elements: headlines, formats, messaging, calls-to-action, visual design, content length, etc. Share specific examples of tests you've run with results and how you implemented learnings. Discuss statistical significance and proper experimental design. Show how you prioritize testing opportunities and build a testing roadmap.
Company and Product Specific Growth Assessment
Demonstrate you've researched the company's growth metrics, market position, competitive landscape, and growth stage. Discuss how you'd assess their current growth constraints and what you'd prioritize if hired. Show thoughtfulness about their specific situation.
Experimentation Strategy and Advanced Designs
When and how to use advanced experimental methods and how to prioritize experiments to maximize learning and business impact. Candidates should understand factorial and multivariate designs interaction effects blocking and stratification sequential testing and adaptive designs and the trade offs between running many factors at once versus sequential A and B tests in terms of speed power and interpretability. The topic includes Bayesian and frequentist analysis choices techniques for detecting heterogeneous treatment effects and methods to control for multiple comparisons. At the strategy level candidates should be able to estimate expected impact effort confidence and reach for proposed experiments apply prioritization frameworks to select experiments and reason about parallelization limits resource constraints tooling and monitoring. Candidates should also be able to communicate complex experimental results recommend staged follow ups and design experiments to answer higher order questions about interactions and heterogeneity.
Feature Success Measurement
Focuses on measuring the impact of a single feature or product change. Key skills include defining a primary success metric, selecting secondary and guardrail metrics to detect negative side effects, planning measurement windows that account for ramp up and stabilization, segmenting users to detect differential impacts, designing experiments or observational analyses, and creating dashboards and reports for monitoring. Also covers rollout strategies, conversion and funnel metrics related to the feature, and criteria for declaring success or rollback.
Growth Metrics and Key Performance Indicators
Comprehensive knowledge of growth metrics and key performance indicators used to measure user acquisition, engagement, retention, and revenue. Candidates should understand definitions, business meaning, and how to calculate metrics from raw event and transaction data. Core metrics include customer acquisition cost, lifetime value, lifetime value to customer acquisition cost ratio, conversion rate, churn rate, retention rate, monthly active users, daily active users, cohort retention, activation, engagement, average revenue per user, payback period, viral coefficient, and growth rate over time. Candidates should be able to choose appropriate leading and lagging indicators, explain unit economics, and reason about tradeoffs across acquisition, activation, retention, revenue, and referral stages. Practical skills include designing instrumentation and tracking for events and transactions, selecting attribution windows, avoiding sampling and attribution pitfalls, cleaning and deduplicating event streams, and calculating metrics by cohort and segment. Candidates must be able to perform funnel analysis and cohort analysis to diagnose problems, prioritize optimization levers, set metric baselines and success criteria for controlled experiments and split tests, assess sensitivity to seasonality pricing changes and growth initiatives, and communicate metric driven recommendations and dashboards to stakeholders. They should also identify which metrics matter for different business models such as business to business versus business to consumer and subscription versus transactional models.
Experiment Design and Execution
Covers end to end design and execution of experiments and A B tests, including identifying high value hypotheses, defining treatment variants and control, ensuring valid randomization, defining primary and guardrail metrics, calculating sample size and statistical power, instrumenting events, running analyses and interpreting results, and deciding on rollout or rollback. Also includes building testing infrastructure, establishing organizational best practices for experimentation, communicating learnings, and discussing both successful and failed tests and their impact on product decisions.