Your Prompt is My Command: On Assessing the Human-Centred Generality of Multimodal Models | Journal of Artificial Intelligence Research

To do this, we employ a technique known as AI-assisted evaluation, alongside traditional metrics for measuring performance. This helps us pick the prompts that lead to better quality outputs, making the end product more appealing to users. AI-assisted evaluation uses best-in-class LLMs (like GPT-4) to automatically critique how well the AI's output... See more

How does text-based prompting supplant or augment GUIs?

Some of the language models’ ability to infer natural language (ChatGPT) is unwieldy so there has been a lot of scrum about how text-based prompts could completely replace graphical user interfaces. My sense is that this won’t happen overnight as GUIs give way to higher fidelity or correctnes

... See more