How to Build a GPT-3 for Science

Research papers are full of valuable information, including figures, charts, statistical relationships, and references to other papers. Breaking them down into various components and using them at scale could help us train machines for different types of science-related jobs, prompts or queries. Simple questions might be answered with training on o... See more

Research publications are some of the world’s most important repositories for content and information ever created. They tie ideas and findings together across time and disciplines, and are forever preserved by a network of libraries. They are supported by evidence, analysis, expert insight, and statistical relationships. They are extremely valuabl... See more

Because scientific papers are not easily accessible, we can’t easily use the data to train generative models like GPT-3 or DALL-E. Can you imagine if a researcher could propose an experiment and an AI model could instantly tell them if it had been done before (and better yet, give them the result)? Because scientific papers are not easily accessibl... See more