What Just Happened
Clearly someone needs to try this at scale – pick 1000 published scientific papers at random, ask o1 or o1-pro to look for errors, and see what turns up. I'm going to give it a shot. Anyone interested in helping out?
(Incidentally, h/t @gibbnicholas for also noticing that o1-pro can spot the math error in the black plas... See more
Steve Newmanx.comBut there are already signs that AI can help. Research has successfully demonstrated that it is possible to correctly determine the most promising directions in science by analyzing past papers with AI, ideally combining human filtering with the AI software. And other work has found that AI shows considerable promise autonomously conducting scienti
... See moreEthan Mollick • Co-Intelligence: Living and Working With AI
Wow: Just tried PaperQA, an open source AI-powered literature review whose research paper claims it achieves "superhuman synthesis of scientific knowledge"
I tested it against papers I wrote and it seems like the real deal, putting together a good summary with accurate details. https://t.co/E0VE7ORpLo