LLMs
by Nicolay Gerold · updated 2mo ago
LLMs
- Zerox OCR
A dead simple way of OCR-ing a document for AI ingestion. Documents are meant to be a visual representation after all. With weird layouts, tables, charts, etc. The vision models just make sense!
The general logic:- Pass in a PDF (URL or file buffer)
- Turn the PDF into a series of images
- Pass each image to GPT and ask nicely for Markdown
- Aggregat
from GitHub - getomni-ai/zerox: Zero shot pdf OCR with gpt-4o-mini by Tyler Maran
Nicolay Gerold added 2mo ago
- Mem0: The Memory Layer for Personalized AI
Mem0 provides a smart, self-improving memory layer for Large Language Models, enabling personalized AI experiences across applications.Note: The Mem0 repository now also includes the Embedchain project. We continue to maintain and support Embedchain ❤️. You can find the Embedchain codebase in the embedchai
... See morefrom GitHub - mem0ai/mem0: The memory layer for Personalized AI
Nicolay Gerold added 2mo ago
You can think your way into solving a deterministic system, but you cannot think your way into solving a probabilistic system.
The first thing that I want to call out is that deterministic software has edge cases, while probabilistic software has long tails.
I find that a lot of junior folks try to really think hard about edge cases around probabili... See morefrom Tips for probabilistic software - jxnl.co by Jason Liu
Nicolay Gerold added 3mo ago
- Large variety of ready-to-use LLM evaluation metrics (all with explanations) powered by
ANY
LLM of your choice, statistical methods, or NLP models that runs
locally on your machine
:- G-Eval
- Summarization
- Answer Relevancy
- Faithfulness
- Contextual Recall
- Contextual Precision
- RAGAS
- Hallucination
- Toxicity
- Bias
- etc.
from GitHub - confident-ai/deepeval: The LLM Evaluation Framework
Nicolay Gerold added 4mo ago
- Large variety of ready-to-use LLM evaluation metrics (all with explanations) powered by
- Principles for growable tools
There are three critical pieces to building a tool that can grow around its users over time.- Design around play . Sometimes I call this design around experimentation . Using the tool for day-to-day work should involve playing and experimenting with what’s possible with the tool. Whether that’s writing small programs to
from Beyond customization: build tools that grow with us | thesephist.com
Nicolay Gerold added 4mo ago
- A core research interest of mine is imagining new kinds of interfaces to text documents that are made possible by modern AI and software. I think an interesting place to look for such ideas may be interface designs for reading and writing legal documents .
Legal document-wrangling tools have a handful of properties that make it fertile ground for in... See morefrom Legal documents are pushing text interfaces forward | thesephist.com
Nicolay Gerold added 4mo ago
- Humans are bad at coming up with search queries. Humans are good at incrementally narrowing down options with a series of filters, and pointing where they want to go next. This seems obvious, but we keep building interfaces for finding information that look more like Google Search and less like a map.
All information tools have to give users some wa... See morefrom Navigate, don't search by thesephist.com
Nicolay Gerold added 4mo ago
- A new v0.4.0 release of lm-evaluation-harness is available !
New updates and features include:- Internal refactoring
- Config-based task creation and configuration
- Easier import and sharing of externally-defined task config YAMLs
- Support for Jinja2 prompt design, easy modification of prompts + prompt imports from Promptsource
- More advanced configuration opt
from GitHub - sqrkl/lm-evaluation-harness: A framework for few-shot evaluation of language models.
Nicolay Gerold added 4mo ago
- Study finds RLHF reduces LLM creativity and output variety : A new research paper posted in /r/LocalLLaMA shows that while alignment techniques like RLHF reduce toxic and biased content, they also limit the creativity of large language models, even in contexts unrelated to safety.
from Shortwave — rajhesh.panchanadhan@gmail.com [Gmail alternative]
Nicolay Gerold added 4mo ago