On-Premise or Cloud - Where Should You Host Your AI Applications?

Of course, there are major ethical issues to work out—leaps forward in technology often walk a fine line between deeply-impactful and dystopian. Among the questions we need to figure out:
- Who is responsible for AI’s mistakes?
- Who is the creator of an AI work? Is it the AI? The developers? The person who wrote the prompt? The people whose work was use
Rex Woodbury • AI in 2023: The Application Layer Has Arrived

A solution is to self-host an open-sourced or custom fine-tuned LLM. Opting for a self-hosted model can reduce costs dramatically - but with additional development time, maintenance overhead, and possible performance implications. Considering self-hosted solutions requires weighing these different trade-offs carefully.