Scaling up RL is all the rage right now, I had a chat with a friend about it yesterday. I'm fairly certain RL will continue to yield more intermediate gains, but I also don't expect it to be the full story. RL is basically "hey this happened to go well (/poorly), let me slightly increase (/decrease) the probability of every action I took for the... See more

why your coding agents don't need rag anymore nik pash from cline explained why he no longer recommends rag for autonomous coding agents, and his points hit harder than i expected. the application layer is shrinking. all the clever engineering we build around llms keeps becoming obsolete as... See more