The gambler needs to learn new knowledge about the machines and simultaneously use what they have already learned to optimize their decisions. In the literature, these two activities are referred to as exploring and exploiting. You can’t do both things at the same time. When you explore, you are pulling new arms on the bandit trying to figure out t... See more
one of the most important and subtle questions in science is problem selection. How do you choose what to work on? No one tells you what to do. And you do have to answer this question multiple times. With a company, in some sense, you have to decide it once, and then it's an iterative process from there. Whereas in science, you're frequently pursui... See more
Problem selection and how to think, referencing “Apprentice to Genius”