Openish ML
Notes on open machine learning, mostly as a source for my openml.fyi newsletter
Openish ML
“At Google Research and Brain and DeepMind, we've invented the majority of machine learning techniques we're all using today, over the last 10 years of pioneering work. So that’s always been in our DNA, and we have quite a lot of senior research scientists that maybe other orgs don't have.”
Weaving Pathways for Justice with GPT: LLM-driven automated drafting of interactive legal applications
Steenhuis, Quintenpapers.ssrn.com
I appreciate the attention to detail here, and it’s generally a really careful, thoughtful post, but you then throw away pretty much all the good effort by settling on a term that the vast majority of people are not going to be able to tell apart from open source. “publicly available”, “free to use”… lots of other, non-confusing options right there.
Today Google released Gemini with a 60-page report in which they repeatedly say the training data is key ("We find that data quality is critical to a highly-performing model"), while providing almost no information about how it was made, how it was filtered, or its contents.