A few (maybe obvious) challenges using LLMs within software applications I've seen as companies roll out their use: - versioning : While it's possible to tie a program to a specific model version, there is no structured way to handle new model versions (e.g. deprecation, sub versioning, incremental addition). Thus porting to a new mod... See more