Metadata
- Author: End User Computing Services
- Full Title:: Seven Rules of Thumb for Web Site Experimenters
- Category:: 🗞️Articles, Hypothesis testing
- URL:: https://readwise.io/reader/document_raw_content/75150367
- Finished date:: 2024-10-05
Highlights
As Al Pacino says in the movie Any Given Sunday, winning is done inch by inch. For web sites like Bing, where thousands of experiments are being run annually, most fail, and those that succeed improve key metrics by 0.1% to 1.0%, once diluted to overall impact. (View Highlight)
Our experience is that many metrics of interest in online experiments are skewed which may require a higher lower bound before you can assume normality. (View Highlight)