-
AI 101: What are FLOPS in AI?
Along with an LLM’s “size” in parameters, FLOPS are one of the more confusing terms batted around in AI circles. So: What are FLOPS in AI? In Machine Learning? In supercomputers? Essentially, a FLOPS is a unit of measurement for raw performance of any computer, or chip, or datacenter, and in particular it is used…
-
AI 101: What is a Parameter? (in a ChatBot LLM) : Joyful Learning
These days, players like to brag about the complexity and sophistication of a new AI by describing its massive size (sound familiar? some tropes never die…)… in terms of a handful of terms: number of GPUs, size of the training dataset, and, most opaquely, number of parameters in the model. So: What is a parameter,…
-
RLHF 101: Reinforcement Learning from Human Feedback for LLM AIs
A technique called RLHF has been getting a lot of AI insider / expert buzz lately, ever since OpenAI announced that this was one of the key “fine-tuning” methodologies used to transform the raw GPT3.5 model into first, InstructGPT, and later and epically, ChatGPT. The RLHF acronym stands for “Reinforcement Learning from Human Feedback,” which,…