Nicolay Gerold
@nicolaygerold
Nicolay Gerold
Jazz.ToolsPowerSyncFireproofAutomergeDXOSElectricSQLand of course, Berlin's own: Yjs .
Shortwave — rajhesh.panchanadhan@gmail.com [Gmail alternative]
slowllama
Fine-tune Llama2 and CodeLLama models, including 70B/35B on Apple M1/M2 devices (for example, Macbook Air or Mac Mini) or consumer nVidia GPUs.
slowllama is not using any quantization. Instead, it offloads parts of model to SSD or main memory on both forward/backward passes. In contrast with training large models from scratch... See more
Fine-tune Llama2 and CodeLLama models, including 70B/35B on Apple M1/M2 devices (for example, Macbook Air or Mac Mini) or consumer nVidia GPUs.
slowllama is not using any quantization. Instead, it offloads parts of model to SSD or main memory on both forward/backward passes. In contrast with training large models from scratch... See more
okuvshynov • GitHub - okuvshynov/slowllama: Finetune llama2-70b and codellama on MacBook Air without quantization
If there isn’t enough light (type and quality - sunlight) in the morning with a low solar angle, the wakefulness system doesn’t get triggered properly. Artificial light doesn’t activate it properly, get sunlight in the light as soon to waking as possible. Get outside with no sunglasses, through glass decreases the efficiency by 50%, once the sun is... See more
Andrew Huberman • Master Your Sleep & Be More Alert When Awake
MLEs are happy to delegate experiment tracking and execution work to ML experiment execution frameworks, such as Weights & Biases 3 , but prefer to choose subsequent experiments themselves. To be able to make informed choices of subsequent experiments to run, MLEs must maintain awareness of what they have tried and what they haven’t (Lg2 calls it... See more
Shreya Shankar • "We Have No Idea How Models will Behave in Production until Production": How Engineers Operationalize Machine Learning.
learnings from one experiment into the next, like a guided search to find the best idea (Lg2, Sm4,
Lg5). Lg5 described their ideological shift from random search to guided search:
Previously, I tried to do a lot of parallelization. If I focus on one idea, a week at a time,
then it boosts my productivity a lot more.
By following a guided search, engineers are, essentially, significantly pruning a large subset of
experiment ideas without executing them. While it may seem like there are unlimited computational
resources, the search space is much larger, and developer time and energy is limited. At the end of
the day, experiments are human-validated and deployed. Mature ML engineers know their personal
tradeoff between parallelizing disjoint experiment ideas and pipelining ideas that build on top of
each other, ultimately yielding successful deployments
Our craving for sugar comes from the gut. Neurons recognize the glucose in the intestines after it has been infested and converted from sugar. They send a signal to the brain. We learn to associate foods that contain sugar even if they don’t taste like it through these circuits. We learn to associate the texture, viscosity,…
Andrew Huberman • Dr. Charles Zuker: The Biology of Taste Perception & Sugar Craving
Dream UX of AI Hardware:
Exact Transcript: I want the ability to get an exact time-stamped transcript of the day’s conversations. This is where Avi’s Tab and the Rewind Pendant differ. Tab uses AI to summarize what you’re talking about but has no transcripts, whereas Rewind’s will have full transcripts. I want the full transcripts because ideas are... See more
Exact Transcript: I want the ability to get an exact time-stamped transcript of the day’s conversations. This is where Avi’s Tab and the Rewind Pendant differ. Tab uses AI to summarize what you’re talking about but has no transcripts, whereas Rewind’s will have full transcripts. I want the full transcripts because ideas are... See more
Rohit Krishnan • The Dream AI Hardware
But now we are only logging that error message. It would be better to define a custom Exception that we can then handle in our API in order to return a specific error code to the user:
import pandas as pd
import logging
class DataLoadError(Exception):
"""Exception raised when the data cannot be loaded."""
def __init__(self, message="Data could not be... See more
import pandas as pd
import logging
class DataLoadError(Exception):
"""Exception raised when the data cannot be loaded."""
def __init__(self, message="Data could not be... See more
How to Write Clean Code in Python
And then, in the primary function of your API:
try:
df = load_data('path/to/data.csv')
# Further processing and model prediction
except DataLoadError as e:
# Return a response to the user with the error message
# For example: return Response({"error": str(e)}, status=400)Sympathetic nervous system (responsible for attention) has a 24 hour cycle. We have altradian rhythms during the day:
Andrew Huberman • How Your Brain Works & Changes
Watching intense light between 10 and 4 at Night reduces the capacity to produce dopamine.