Nicolay Gerold
@nicolaygerold
Nicolay Gerold
baserun.ai💪💪💪
Testing & Observability Platform for LLM Apps
From prompt playground to end-to-end tests, baserun helps you ship your LLM apps with confidence and speed.
Testing framework for LLM Part
It's up to the architect to foresee these outcomes and decide whether they are comfortable with them. Does it matter where this lands, or does it make sense to constrain the available choices in some way? Will this make life easier in the long term and help you to manage costs, or will it merely undermine agility without delivxering any tangible... See more
How to make architecture decisions
SGLang is a structured generation language designed for large language models (LLMs). It makes your interaction with LLMs faster and more controllable by co-designing the frontend language and the runtime system.
The core features of SGLang include:
The core features of SGLang include:
- A Flexible Front-End Language : This allows for easy programming of LLM applications with multiple
sgl-project • GitHub - sgl-project/sglang: SGLang is a structured generation language designed for large language models (LLMs). It makes your interaction with models faster and more controllable.
Prompting and Controllable Generation
They have a fast jsond ecoding feature with a finite state machine.
Kaizen is the Japanese word for improvement. Thephrase was popularized as part of the Toyota Production System. At Toyota, all personnel are given a (literal or metaphorical) red handle to pull that stops the entire production line. If a worker identifies a problem with production, the idea is for them to pull the red handle, gather coworkers and... See more
ZachGoldberg • Startup-CTO-Handbook/StartupCTOHandbook.md at main · ZachGoldberg/Startup-CTO-Handbook
Fast-csv
Fast-csv is library for parsing and formatting CSVs or any other delimited value file in node.
Features
Fast-csv is library for parsing and formatting CSVs or any other delimited value file in node.
Features
- CSV Formatting
- CSV Parsing
- Built using typescript.
- Flexible formatting and parsing options, to fit almost any scenario.
- Built with streams first to avoid creating large memory footprint when parsing large files.
- Battle tested in production,
C2FO • GitHub - C2FO/fast-csv: CSV parser and formatter for node
What is Substrate?
Substrate is an AI inference platform. In particular, it excels at enabling complex multi-model workloads . At its core, Substrate is 1) a collection of cutting-edge AI models – tuned for optimum performance, and 2) a set of composable APIs for relating these models to each other. We believe having both of these components in one... See more
Substrate is an AI inference platform. In particular, it excels at enabling complex multi-model workloads . At its core, Substrate is 1) a collection of cutting-edge AI models – tuned for optimum performance, and 2) a set of composable APIs for relating these models to each other. We believe having both of these components in one... See more
Nextra: the next docs builder
My top issues with the foundations of the "modern data stack":
- Snowflake - you may only pay for what you use, but you pay through the nose for it. The cost is so high that in many cases it can exceed the cost of binders full of dbas.
- Fivetran - convenient, but they tried to triple my licensing cost last year, they have almost constant 15 minute
r/dataengineering - Reddit
LNO: Framework to prioritize time. There are leverage, neutral, and overhead tasks, where you get 10x, 1x or < 1x output. You should focus your best and the most hours on leverage tasks. Delegate or strike N and O tasks. The same activity can be all three depending on the context and how you execute it. Track L, N, O tasks.