GitHub - OthersideAI/self-operating-computer: A framework to enable multimodal models to operate a computer.

🤖 Cutting-edge framework for orchestrating role-playing, autonomous AI agents. By fostering collaborative intelligence, CrewAI empowers agents to work together seamlessly, tackling complex tasks.

• Why CrewAI


• Getting Started


• Key Features


• Examples


• Local Open Source Models


• CrewAI x AutoGen x ChatDev


• Contribution


• 💬 CrewAI Discord Community


• Hire Consulting


• Licen

... See more

multimodal-maestro

👋 hello

Multimodal-Maestro gives you more control over large multimodal models to get the outputs you want. With more effective prompting tactics, you can get multimodal models to do tasks you didn't know (or think!) were possible. Curious how it works? Try our HF space!

First, here a generalized framework for an autonomous agent :

1. Initialize Goal : Define the objective for the AI.


2. Task Creation : The AI checks its memory for the last X tasks completed (if any), and then uses it’s objective, and the context of it’s recently completed tasks, to generate a list of new tasks.


3. Task Execution : The AI executes the ta

... See more

emerging of LLMs not as a chatbot, but the kernel process of a new Operating System. E.g. today it orchestrates:

- Input & Output across modalities (text, audio, vision)

- Code interpreter, ability to write & run programs

- Browser / internet access

- Embeddings database for files and internal memory storage & retrieval

The two most important problems (at least how I am thinking about them currently), are:

Finding a rigorous scientific framework for how different agent skills, personalities, and instructions combine to be most capable for different problems (think of this as social management science for AI agents) .

Figuring out how you formally validate and verify... See more