Nicolay Gerold

The text embedding set trained by Jina AI, Finetuner team.

Intended Usage & Model Info

jina-embeddings-v2-base-en is an English, monolingual embedding model supporting 8192 sequence length.

It is based on a Bert architecture (JinaBert) that supports the symmetric bidirectional variant of ALiBi to allow longer sequence length.

The backbone... See more

I went to a ClickHouse meetup here in Dubai.

Never used the tool, but I'm happy to learn.

ClickHouse is:

- a database

- built for analytics

- open source

Furthermore, it:

- can be run on a single node or in a cluster

- stores data in columnar format

- uses both "vectorized query execution" and "runtime code generation" to maximize CPU usage

In the meetup,... See more

The way that most RLHF is done to date has the entire response from a language model get an associated score. To anyone with an RL background, this is disappointing, because it limits the ability for RL methods to make connections about the value of each sub-component of text. Futures have been pointed to where this multi-step optimization comes at... See more

When the levels of a hormone are too high, the brain will stop to produce stimulating hormones to stop the Production. It can be supplemented through Kelp and seaweed.

- The generative AI revolution is swiftly giving rise to a myriad of startups, with an increasing need to categorize them by their function in the AI landscape, including foundational model providers, infrastructure enablers, and application developers.

- Generative AI is transforming industries across the globe, not just in Silicon Valley, with... See more

How much do you think we’re going to get tons of specialization versus no, once the brain gets big enough and we do these fine tunings, that’s going to be it. It will be like AWS, GCP, and Azure.

Ali: I think the answer is closer to the latter. It’s going to have lots of specialization. Having said that, it’s not a dichotomy in the sense that maybe... See more

Most problems occur that people cannot regulate the stress (levels of cortisol and epinephrine in the brain) to stay calm and select the right action.