H
@harshxharsh
H
Neural Networks
Computational models inspired by the human brain, consisting of layers of interconnected nodes ("neurons") that process data to learn patterns.
Computational models inspired by the human brain, consisting of layers of interconnected nodes ("neurons") that process data to learn patterns.
AI Product Manager Glossary
abandon the finish line.
Time to First Token (TTFT)
The time it takes from sending a request to when the first token of the response appears. Even if the full answer takes longer, a fast TTFT makes the system feel more responsive to the user.
The time it takes from sending a request to when the first token of the response appears. Even if the full answer takes longer, a fast TTFT makes the system feel more responsive to the user.
AI Product Manager Glossary
Write for one person: If you try to write for everyone, you write for no one. Focus on one person. It could be your loved one, your boss, or your peers. What do you want to share with that person?
google.com • Inbox (6,480) - tyler.faught92@gmail.com - Gmail
We're living in an era where AI can generate polished designs, code, and writing with a single prompt—but something crucial is being lost. Willem Van Lancker argues that “productive friction”—the struggle of learning through trial, error, and critique—is essential for developing true expertise and taste.
Inference
The process of using a trained model to make predictions on new data. In the case of large language models, this means generating a response based on the input prompt. It’s what happens when you “ask” the model something.
The process of using a trained model to make predictions on new data. In the case of large language models, this means generating a response based on the input prompt. It’s what happens when you “ask” the model something.
AI Product Manager Glossary
Failure Modes
Coherent and non-overlapping categories of errors that emerge from analyzing LLM traces (e.g., hallucination, incorrect format, or missed instruction). Each binary failure type is easy to recognize and forms the basis for targeted metrics.
Coherent and non-overlapping categories of errors that emerge from analyzing LLM traces (e.g., hallucination, incorrect format, or missed instruction). Each binary failure type is easy to recognize and forms the basis for targeted metrics.
AI Product Manager Glossary
Henry frankfurt also believed in the notion of bullshitting being a genus
Bullshit (general) Any utterance produced where a speaker has indifference towards the truth of the utterance.
Hard bullshit Bullshit produced with the intention to mis- lead the audience about the utterer’s agenda.
Soft bullshit Bullshit produced without the intention to mis-le
... See moreQuantization
A method to shrink the size of a model and make it run faster. It works by converting the model’s internal numbers from high precision (like 32-bit floats) to smaller ones (like 8-bit integers). This helps reduce memory usage and speed up inference with only a small drop in accuracy.
A method to shrink the size of a model and make it run faster. It works by converting the model’s internal numbers from high precision (like 32-bit floats) to smaller ones (like 8-bit integers). This helps reduce memory usage and speed up inference with only a small drop in accuracy.