Metadata
- Author: Hey
- Full Title:: We Increased Conversion ~30% and We Don’t Know Exactly How
- Category:: 🗞️Articles
- Document Tags:: Data Culture, Data Culture,
- URL:: https://world.hey.com/jason/we-increased-conversion-30-and-we-don-t-know-exactly-how-9b6129b2
- Read date:: 2025-02-27
Highlights
In stark contradiction with Lean Startup.
The point wasn’t to know, it was to do. And it was done. (View Highlight)
You could make the argument that we should have tried each thing separately, measured each impact, and then decided where to go next (or known when to stop). You could make the argument that changing so many things at once makes it impossible to know which variables actually mattered. You could have argued we should have been more rigorous in our evaluation so we could learn something fundamental we could apply to a future project. You could argue all those things. While you were debating those points, spending months teasing out answers, or testing each change in high-traffic succession for statistical significance, we were already basking in the results and moving our product teams to the next project. In six weeks all the work was done, we did our best, and it worked. (View Highlight)