Nicolay Gerold
@nicolaygerold
Nicolay Gerold
LoRAX (LoRA eXchange) is a framework that allows users to serve thousands of fine-tuned models on a single GPU, dramatically reducing the cost of serving without compromising on throughput or latency.
📖 Table of contents
📖 Table of contents
- 📖 Table of contents
- 🌳 Features
- 🏠 Models
- 🏃♂️ Getting started with Docker
- Launch LoRAX Server
- Prompt via REST API
- Prompt via Python
predibase • GitHub - predibase/lorax: Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs
Muscular endurance is about maintaining joint stability when you do something fast or heavy. Joint pain mostly is a sign of missing muscular endurance.
Andrew Huberman • Dr. Andy Galpin: How to Build Strength, Muscle Size & Endurance
The quality of dataset is 95% of everything. The rest 5% is not to ruin it with bad parameters.
After 500+ LoRAs made, here is the secret
Here's my read on the situation:
* The TAM is massive, still so many businesses trying to figure out AI
* If you do deployments you’ll need to spend a of time hand holding clients through scoping projects (not unlike other dev works) since the material is so new
* Lot’s of opportunity in education
* The hard part isn’t the expertise, it’s distribution... See more
* The TAM is massive, still so many businesses trying to figure out AI
* If you do deployments you’ll need to spend a of time hand holding clients through scoping projects (not unlike other dev works) since the material is so new
* Lot’s of opportunity in education
* The hard part isn’t the expertise, it’s distribution... See more
Greg Kamradt • Tweet
A “market” is a set of buyers, with sufficiently similar needs, constraints, and goals, that the same product can be sold to all of them. The “AI” market consist of companies like OpenAI and Cohere, and indeed that is a large and growing market, but unless you’re competing directly with them, you’re not “in the AI market.”
A chatbot is in the... See more
A chatbot is in the... See more
Jason Cohen • AI startups require new strategies: This time it's actually different
I think he kinda beats up his own definition. A chabot also isn’t a market. A chatbot can solve many different problems. It can be helping your own employees get up to speed quicker during onboarding, serve as discovery, help out confused customers on a website. A chatbot is also in the solution space. And a chatbot is just an AI packaged up to talk with some information source.
I agree with the general statement. AI is in the solution space and we have to find the right problem to solve with it. But there are so many problems out there that you can find one that is solvable with AI. And I am yet to see one process, product, employee that I cannot improve with AI.
- ClickHouse: It's a high performance columnar database that's great for real time queries. It enables querying and storing large amounts of data on commodity hardware. Some of my customers have millions of page views and I don't have an unlimited budget, so it's been very handy.
- PostgreSQL: My favorite database. Sane defaults, battle-tested, and well
The Tech Stack of a One-Man SaaS
Advice I’d give my younger self: Don’t focus on energy output (working too hard). Focus on energy production (recharging activities). If you produce more energy than you burn, it’s impossible to burn out.
4. The person who is well rested might be able to work 16-hour days 6 days per week. The person who never works but scrolls TikTok all day can... See more
4. The person who is well rested might be able to work 16-hour days 6 days per week. The person who never works but scrolls TikTok all day can... See more
Shortwave — rajhesh.panchanadhan@gmail.com [Gmail alternative]
When the levels of a hormone are too high, the brain will stop to produce stimulating hormones to stop the Production. It can be supplemented through Kelp and seaweed.
Andrew Huberman • How to Control Your Metabolism by Thyroid & Growth Hormone
The Nemotron-3 8B family is available in the Azure AI Model Catalog, HuggingFace, and the NVIDIA AI Foundation Model hub on the NVIDIA NGC Catalog. It includes base, chat, and question-and-answer (Q&A) models that are designed to solve a variety of downstream tasks. Table 1 shows the full family of foundation models.
Model
Variant
Key Benefit
Base
N... See more
Model
Variant
Key Benefit
Base
N... See more