Nicolay Gerold

Things we readily use

There are a few types of k8s resources we use without hesitation. I’m only listing resources here that we create explicitly; most of these resources implicitly create other resources (like Pods) that I will not mention but which we of course (indirectly) use.

• Deployments : Most of our pods are created through deployments.

... See more

How enterprises are using open source LLMs: 16 examples.

Many use Llama-2: Brave, Wells Fargo, IBM, The Grammy Awards, Perplexity, Shopify, LyRise, Niantic....

Quote: “A lot of customer are asking themselves: Wait a second, why am I paying for super large model that knows very little about my business? Couldn’t I just use one of these open-source... See more

• Solution : Apply the Single Responsibility Principle - each microservice should focus on one single capability that it masters.


• Benefits : This specialization makes microservices easier to comprehend, test, scale, and upgrade. It's like having a coordinated team where each member excels at their role.


• Pitfalls : Violating this principle leads to

... See more

Just thinking about food, sex or dopamine increases the amount as much as the action itself. Once you reach that thing the amount of dopamine goes up even further.

koboldcpp

🤗 Transformers

Huggingface is an open source platform and community for deep learning models for language, vision, audio and multimodal. They develop and maintain the transformers library, which simplifies the process of downloading and training state of the art deep learning models.

This is the best library if you have a background in... See more

TL;DR

LLMLingua utilizes a compact, well-trained language model (e.g., GPT2-small, LLaMA-7B) to identify and remove non-essential tokens in prompts. This approach enables efficient inference with large language models (LLMs), achieving up to 20x compression with minimal performance loss.

... See more

" Knowledge is powerful, be careful how you use it! "

A collection of inspiring lists, manuals, cheatsheets, blogs, hacks, one-liners, cli/web tools, and more.

Created by trimstray and contributors

📔 What is it?

This repository is a collection of various materials and tools that I use every day in my work. It contains a lot of useful information... See more