Darren LI

I don’t think anyone truly appreciates the power that they have to shape this world, it’s certainly not their fault. When you think we’re on a planet with seven billion other people, it’s very easy to think that surely someone else has more experience, more knowledge, more power to help improve this world. But it’s a pretty frightening realisation... See more

StreamingLLM can enable Llama-2, MPT, Falcon, and Pythia to perform stable and efficient language modeling with up to 4 million tokens and more.

But why make this point? Well, splitting the hair between profit and usage is important to measuring long-term success. If a project gets great adoption but cannot drive revenue, it will die. Some wishful thinking might argue that the community will take over, but there’s been little evidence to indicate this happens.

Key unlock: LLMs will be able to interact much more effectively with the tools we use today.