From the week
The answer was on the back of the card
A short exercise on confidence intervals for a mean became harder to explain once everyone was holding a result.
Insight library
Notes on funnel diagnosis, product instrumentation, experiment design, segmentation, retention, and repeat purchase.
From the week
A short exercise on confidence intervals for a mean became harder to explain once everyone was holding a result.
From the week
Testing a slow response this week, I became impatient with the interface before I opened its event records.
Journal
I started the afternoon with flour, chives, eggs and an ambitious plan. By the end I had made dinner.
Metric design · Analysis note
A practical definition card for aligning population, eligibility, windows, deduplication, and exclusions.
Retention · Repeat purchase
Defining populations, starting events, windows, and mature observation periods for activity retention and repeat purchase.
User segmentation · Analysis design
Choosing actionable, interpretable user groups with stable samples, starting from the analysis question.
Experiment design · Pre-launch review
Reviewing decisions, assignment, measures, duration, and stopping rules before a product experiment begins.
Product instrumentation · Data definitions
How to document event meaning, firing rules, fields, identity, versions, and ownership for reviewable instrumentation.
Funnel diagnosis · Work note
A hypothetical dataset for separating traffic mix, product paths, instrumentation, and behavior changes.
Experiment design · Product decisions
A hypothetical product experiment about conflicting metrics, experiment goals, and the decision the test is meant to support.