Nicolay Gerold

Pretrained model on protein sequences using a masked language modeling (MLM) objective. It was introduced in

this paper and first released in

this repository. This model is trained on uppercase amino acids: it only works with capital letter amino acids.

Model description

ProtBert is based on Bert model which pretrained on a large corpus of protein... See more

TorchMultimodal (Beta Release)

Introduction

TorchMultimodal is a PyTorch library for training state-of-the-art multimodal multi-task models at scale. It provides:

• A repository of modular and composable building blocks (models, fusion layers, loss functions, datasets and utilities).


• A repository of examples that show how to combine these building

... See more

slowllama

Fine-tune Llama2 and CodeLLama models, including 70B/35B on Apple M1/M2 devices (for example, Macbook Air or Mac Mini) or consumer nVidia GPUs.

slowllama is not using any quantization. Instead, it offloads parts of model to SSD or main memory on both forward/backward passes. In contrast with training large models from scratch... See more

Fast-csv

Fast-csv is library for parsing and formatting CSVs or any other delimited value file in node.

Features

• CSV Formatting


• CSV Parsing


• Built using typescript.


• Flexible formatting and parsing options, to fit almost any scenario.


• Built with streams first to avoid creating large memory footprint when parsing large files.


• Battle tested in production,

... See more

Most execution problems are culture or strategy problems (misalignment, different strategies). Indicator: does the bandage you applied keep falling off?

If there isn’t enough light (type and quality - sunlight) in the morning with a low solar angle, the wakefulness system doesn’t get triggered properly. Artificial light doesn’t activate it properly, get sunlight in the light as soon to waking as possible. Get outside with no sunglasses, through glass decreases the efficiency by 50%, once the sun is... See more

#sapling

Over winter break last year, I tried learning everything I could about AWS. I took a bunch of notes and decided to compile them all here. While AWS can feel overwhelming, I think it’s a great tool to know for personal projects because of how cheap, fast, and battle-tested services like S3, Lambda, and Dynamo are. I hope this helps!

Foundatio... See more

It’s highly individual to genes, epigenetics and environment on what diet your body can thrive.

Almost every company I talk to, and basically every solution vendor, has been pushing for people to use AI to “talk-to-your-data,” an approach allows the AI to retrieve content from a company’s proprietary databases and then work with the documents and data it retrieves. The problem is that AIs hallucinate, or make up plausible information, all the... See more