Don’t get paralyzed by testing everything. If you can’t get statistical significance within a month, use pre/post analysis instead. Trust intuition more, especially when:
As a younger man, I always had a "data over feelings" view of the world, but after 15+ years of performing analytical testing, seeing data manipulated in every possible direction to fit personal biases and agendas, I now view feelings as the only thing that really matters.
Epic post on how Nike lost $25B in a day by trying to make everything data-driven:
"Nike invested billions into something that was less effective but easier to measure vs something that was more effective but less easy to measure.
In conclusion: an impressive waste of money." https://t.co/YyLH98B0eH
“One admires a genius because one has the imagination to see that there is no ‘mechanism’ in him or his work, nothing that can be analyzed and rationalized”