Once an architecture has been defined, it can serve as the basis for incremental development. The first increment can be a skeletal system in which at least some of the infrastructure—how the elements initialize, communicate, share data, access resources, report errors, log activity, and so forth—is present, but much of the system’s application... See more
The fidelity of the system increases as extensions are added, or early versions are replaced by more complete versions of these parts of the software. In some cases, the parts may be low-fidelity versions or prototypes of the final functionality; in other cases, they may be surrogates that consume and produce data at the appropriate rates but do... See more
If you are looking for something to read/study this weekend, I added lots of LLM-related bonus from-scratch coding resources over the last few months (from implementing Llama 3.2 to preference tuning with DPO): https://github.com/rasbt/LLMs-from-scratch?tab=readme-ov-file#bonus-material
I hope you find them useful! (My... See more
“One thing you do learn with flying is, when you’re off course a little bit, my instructor always said ‘small adjustments normalize the situation,’ ” Carlisle says. “In basketball, life and basketball coaching, small adjustments and normalizing the situation as much as possible have a lot to do with problem solving.”
How to become expert at thing:
1 iteratively take on concrete projects and accomplish them depth wise, learning “on demand” (ie don’t learn bottom up breadth wise)
2 teach/summarize everything you learn in your own words
3 only compare yourself to younger you, never to others