Sublime

By using this repo https://t.co/HOobVEmInD you can convert any decoder model (such as Llama 3.1 or Gemma 2) into an encoder (such as RoBERTa). Why would you want to do that? Because modern decoders support huge context sizes (128k+ tokens) while the longest context of an encoder is 4K (LongFormer), but encoders excel in such tasks as... See more

chatgpt embeds an invisible watermark throughout its messages. so i built a decoder to find and remove it. here is a recording of me copying an output, pasting it into the the decoder, showing the hidden unicode characters, and then deciphering those characters (string of punctuation and an... See more

PDFs are satan’s file format. Almost everyone that builds RAG needs to deal with them - and it sucks. Solutions on the market are either too slow, too expensive or not OSS. It should be easier. Which is why we’re open sourcing https://t.co/0gCZxzbkWu

Every company I talk to is literally trying to solve this problem: How to automatically extract structured data from unstructured documents. For example, they want to process driver's licenses, no matter the file type or format. I recorded the solution for this:... See more