Don’t get paralyzed by testing everything. If you can’t get statistical significance within a month, use pre/post analysis instead. Trust intuition more, especially when:
As a younger man, I always had a "data over feelings" view of the world, but after 15+ years of performing analytical testing, seeing data manipulated in every possible direction to fit personal biases and agendas, I now view feelings as the only thing that really matters.
That Nike post is the perfect articulation of the fact that as soon as all the corporations learned how to be “data driven” all the leverage had already shifted back to those able to make decisions based on taste, insight, and intuition.
Epic post on how Nike lost $25B in a day by trying to make everything data-driven:
"Nike invested billions into something that was less effective but easier to measure vs something that was more effective but less easy to measure.
In conclusion: an impressive waste of money." https://t.co/YyLH98B0eH
“One admires a genius because one has the imagination to see that there is no ‘mechanism’ in him or his work, nothing that can be analyzed and rationalized”