Sublime
An inspiration engine for ideas
The two biggest launches in AI in the past month are now constrained by capacity. This is what we meant by Jevons paradox. https://t.co/Nj1T6FJ4sL
i think we are going to initially offer 10 uses per month for chatgpt plus and 2 per month in the free tier, with the intent to scale these up over time.
it probably is worth $1000 a month to some users but i'm excited to see what everyone does with it!
Sam Altmanx.com
Good news for @AnthropicAI devs:
We've doubled the max output token limit for Claude 3.5 Sonnet from 4096 to 8192 in the Anthropic API.
Just add the header "anthropic-beta": "max-tokens-3-5-sonnet-2024-07-15" to your API calls. https://t.co/3kT1ATHP6s
The monthly message limits on T3 Chat are hurting us a lot.
You get 1500 messages for $8. 99.9% of users don’t get close to using all of them.
But people see the limit and assume they’ll hit it. It keeps them from subscribing.
Power users who DO hit it are willin... See more
Theo - t3.ggx.comWe are seeing a huge amount of demand for Gemini 2.0 Flash right now (not surprising given $0.10 / 1M tokens + quality)! If you need higher rate limits, see below.
Paid tier gets you 2,000 RPM and 4,000,000 TPM right away. Let us know if you need more!
https://t.co/hjT214znEB
Logan Kilpatrickx.com
Crazy fact that everyone deploying LLMs should know—GPT-4 is "smarter" at temperature=1 than temperature=0, even on deterministic tasks.
I honestly didn't believe this myself until I tried it, but shows up clearly on our evals. ht to @eugeneyan for the tip!
⚡ Our Realtime service now handles over 20,000 updates per second!
It wasn't easy to achieve this scale so we had to write about it. (Spoiler, we use the awesome @ElectricSQL).
↓
Trigger.devx.comThe best way to set a limit is to first find the current “upper bound” of the desired metric, and use that as the cap to create a perceived sense of scarcity but doesn’t necessarily limit the behavior.