Generative AI
by Johann Van Tonder · updated 4mo ago
Generative AI
Writing code from scratch is gone. This was the most exciting part of the profession. Now what remains are debugging/fixing. The same concerns graphical design (original character design in games is gone), writing music (new melodies can be generated by clicking "refresh" and then improved), literature. You never start from scratch anymore. Which i
... See moreJohann Van Tonder added 4mo ago
“From this point on, the intelligence of LLMs… will only continue to improve. Human intelligence will not.”
OpenAI’s paper on using AI to debug AI code
Johann Van Tonder added 4mo ago
- I've been asked by few first year PhD about how to start LLM research on X, say long context modeling. My number one suggestion -- though it seems a bit of unconventional -- is *not* to read any papers related to long-context, but to talk to the model - Talk to the model about a text book, course slides, financial reports, novels, nonfictions, any... See more
Johann Van Tonder added 6mo ago
- @emollick Put in the reps. If you aren't hitting the chatGPT cap multiple times a day, you have 0 business reading a research paper The open area of research is what can we use LLMs for, not how do we build better LLMs and the papers are outdated anyways
Johann Van Tonder added 6mo ago
- It is odd when folks get mad when I say AI is already useful. We are only 18 months into LLMs & there have already been many controlled trials finding LLMs are useful, firms have public case studies with real metrics, etc Lots of reasons to critique AI, “uselessness” isn’t one.
Johann Van Tonder added 6mo ago
- A few places you should probably use AI to help you, based on the research we have (but do whatever you want): -Idea generation -Writing (not writing for you, maybe, but second opinions/proofing/etc) -Advice/finding frameworks to solve problems -Summarizing documents & meetings
Johann Van Tonder added 6mo ago
- Learned something interesting from the CEO of a fairly big tech co. Usually 28 year olds are more productive programmers than 22 year olds, because they have more experience. But apparently 22 year olds are now as good as 28 year olds because they're more at ease using AI.
Johann Van Tonder added 6mo ago
- AI will magnify the already great difference in knowledge between the people who are eager to learn and those who aren't.
Johann Van Tonder added 6mo ago
- In a situation like this, there are two general pieces of advice one can give: keep your options open, and pay close attention to what's happening. Then if you can't predict the changes AI will cause, you'll at least be able to react quickly to them.
Johann Van Tonder added 6mo ago
4 questions of organizations [about using AI].
- What did you do that was valuable that's no longer valuable?
- What impossible things can you now do that you could not before?
- What can you democratize and bring down market?
- What can you do upmarket so you have new ways of competing?
... See more
Ethan Mollick, https://www.forbes.com/sites/jenamcgregor/2024/Johann Van Tonder added 7mo ago