A simple explanation of how AI models can 'look up' information they weren't trained on, like an open-book test.
Imagine you studied for a big history test in 2020. You memorized everything perfectly.
Today, someone asks you: "Who won the Super Bowl in 2024?quot;
You wouldn't know! Your "training" stopped in 2020.
Large Language Models (LLMs) like ChatGPT have the same problem. They only know what they learned during their training. They don't know about: