Nicolay Gerold

SGLang is a structured generation language designed for large language models (LLMs). It makes your interaction with LLMs faster and more controllable by co-designing the frontend language and the runtime system.

The core features of SGLang include:

• A Flexible Front-End Language : This allows for easy programming of LLM applications with multiple

... See more

A serverless vector database

built from first principles on object storage: 10-100x cheaper, usage-based pricing, massive scalability

Principles for growable tools

There are three critical pieces to building a tool that can grow around its users over time.

1. Design around play . Sometimes I call this design around experimentation . Using the tool for day-to-day work should involve playing and experimenting with what’s possible with the tool. Whether that’s writing small programs to

... See more

design-resources-for-developers

Public

Unwatch

Stop ignoring

Watch

974

Notifications

Participating and @mentions

Only receive notifications from this repository when participating or @mentioned.

All Activity

Notified of all notifications on this repository.

Ignore

Never be notified.

Custom

Select events you want to be notified of in addition to participating and... See more

Service firms are hired for two reasons:

• Do a job that the client doesn’t have the bandwidth or expertise to do.


• Offer third-party expertise in decisions (cynically, to cover the client’s a**.)

That execution-oriented first bucket tends to include IT implementations (like cloud migration projects), financial audits, and outsourced customer support –... See more

There’s a simple algorithm for identifying the highest leverage relaxation for yourself: (Energy produced ÷ time it takes)

So what abstractions do we have as of today? For example, let’s take the resource abstraction (Dagster, Prefect, referred to as an operator in Airflow). You abstract complex environments and connections away with a simple construct like that. You have the immediate benefits of defining that once and using it in every task or pipeline with... See more

So right now, LLMs (Large Language Models) are all the rage. But in the future, it’s possible that the way we get things done is composing things with a combination of LLMs, SMMs (Small, Mighty Models), agents and tools.

It’s what I call Cognitive Composition (because it sounds cool and I have a longtime love affair with alliteration).

This is how we... See more