GitHub - cliangyu/Cola: [NeurIPS2023] Official implementation of the paper "Large Language Models are Visual Reasoning Coordinators"

LLaVA v1.5, a new open-source multimodal model stepping onto the scene as a contender against GPT-4 with multimodal capabilities. It uses a simple projection matrix to connect the pre-trained CLIP ViT-L/14 vision encoder with Vicuna LLM, resulting in a robust model that can handle images and text. The model is trained in two stages: first, updated ... See more

Guideline following Large Language Model for Information Extraction

Model Card for GoLLIE 34B

We present GoLLIE, a Large Language Model trained to follow annotation guidelines. GoLLIE outperforms previous approaches on zero-shot Information Extraction and allows the user to perform inferences with annotation schemas defined on the fly. Different from... See more

Boosting annotator efficiency with Large Language Models

In July and August, we released LLM-assisted recipes for data annotation and prompt engineering:

• NER: ner.llm.correct, ner.llm.fetch


• Spancat: spans.llm.correct, spans.llm.fetch


• Textcat: textcat.llm.correct, textcat.llm.fetch


• Prompt engineering and terms: ab.llm.tournament terms.llm.fetch

Prodigy's