LLMs

How do models represent style, and how can we more precisely extract and steer it?

A commonly requested feature in almost any LLM-based writing application is “I want the AI to respond in my style of writing,” or “I want the AI to adhere to this style guide.” Aside from costly and complicated multi-stage finetuning processes like Anthropic’s RL with... See more

We consider these aspects of our problem:

• Latency : How fast does the system need to respond to user input?


• Task Complexity : What level of understanding is required from the LLM? Is the input context and prompt super domain-specific?


• Prompt Length : How much context needs to be provided for the LLM to do its task?


• Quality : What is the acceptable

... See more

One interesting thing about LLMs is that they can actually recover (and without error loops). You can have a step that doesn't work right, and a later step can use its common-sense knowledge to ignore some of the missing results, conflicting information, etc. One of the problems with developing with LLMs is that the machine will often cover up... See more

Two ways for an AI company to protect itself from competition: (a) depend not just on AI but also deep domain knowledge about a particular field, (b) have a very close relationship with the end users.

🤖 Cutting-edge framework for orchestrating role-playing, autonomous AI agents. By fostering collaborative intelligence, CrewAI empowers agents to work together seamlessly, tackling complex tasks.

• Why CrewAI


• Getting Started


• Key Features


• Examples


• Local Open Source Models


• CrewAI x AutoGen x ChatDev


• Contribution


• 💬 CrewAI Discord Community


• Hire Consulting


• License

... See more

Here's my read on the situation:

* The TAM is massive, still so many businesses trying to figure out AI

* If you do deployments you’ll need to spend a of time hand holding clients through scoping projects (not unlike other dev works) since the material is so new

* Lot’s of opportunity in education

* The hard part isn’t the expertise, it’s distribution... See more

In the simplest form, we can use the model’s detection confidence to determine a score. But even here there are quite a few options to choose from:

• Lowest confidence - the score is the lowest confidence of all detected objects


• Average confidence - average of all confidences of detected objects


• Minimizing confidence delta - difference between

... See more

Setting up the necessary machine learning infrastructure to run these big models is another challenge. We need a dedicated model server for running model inference (using frameworks like Triton oder vLLM), powerful GPUs to run everything robustly, and configurability in our servers to make sure they're high throughput and low latency. Tuning the... See more