Nicolay Gerold

Phi-1.5

Phi-1.5 is a "small" 1.3 billion parameter LLM with an impressive performance for its size.

Annotated figures from the Textbooks Is All You Need II paper

How does this small model accomplish such a good performance? The secret ingredient seems to be the high-quality data.

The pretraining is based on the Textbooks Is All You Need approach that... See more

Pydantic Logfire — Uncomplicated Observability

From the team behind Pydantic, Logfire is an observability platform built on the same belief as our open source library — that the most powerful tools can be easy to use.

What sets Logfire apart:

• Simple and Powerful: Logfire's dashboard is simple relative to the power it provides, ensuring your entire

... See more

We went to OpenAI's office in San Francisco yesterday to ask them all the questions we had on Quivr (YC W24), here is what we learned:

1. Their office is super nice & you can eat damn good croissant in SF!

2. We can expect GPT 3.5 & 4 price to keep going down

3. A lot of people are using the Assistants API to build their use cases

4. It costs 2M$ to... See more

Here was his secret to getting clients on Upwork 👇 He'd find a job posting that seemed like a good fit, then would ask himself... "If I got this job, what would I do on day 1?" Then he would do that (before even applying). As he put it, the "cheat code" was that rather than making his application all about him and his expertise, he'd make it about... See more

Depending on the user profile and specific use case, there may be other drivers of dataset value:

• Provable compliance becomes more valuable as a data asset traverses its maturity curve. In the early days, when the utility of the data is unknown, participants are less inclined to pay for compliance. But as the ecosystem matures, this becomes more of

... See more

Cortisol is derived from colestoral and is a steroid hormone like the sex hormones, but is their competitive partner. Sex hormones and cortisol compete for colestoral depending on your state. CRH is made in the Brain and causes the pituitary to release ACTH, which triggers the a drenals to release cortisol. Cortisol motivates movement and satiety.

Use nested objects for future extensibility

A follow on from the previous tip: try to logically group fields together. The following:

customer.address = {

line1: "Main Street 123",

city: "San Francisco",

postal_code: "12345"

};

Enter fullscreen mode

Exit fullscreen mode

is much cleaner than:

customer.address_line1 = "Main street 123";

customer.address_city... See more

Almost every company I talk to, and basically every solution vendor, has been pushing for people to use AI to “talk-to-your-data,” an approach allows the AI to retrieve content from a company’s proprietary databases and then work with the documents and data it retrieves. The problem is that AIs hallucinate, or make up plausible information, all the... See more

We can't share the exact formula for our search ranking, but here are the few parameters we consider:

• Exact match (rank #1)


• Frequency of matching lexemes using ts_rank


• Similarity score using similarity


• Type of record


• Popularity of the search result


• Similarity between the result’s alias and query


• Inverse of the result’s string length