"We Have No Idea How Models will Behave in Production until Production": How Engineers Operationalize Machine Learning.
How ML engineers operationalize machine learning, their workflow stages (data preparation, experimentation, evaluation and deployment, monitoring and response), and the challenges they face in each stage.
arxiv.org
