You’ve surely heard that generative AI is revolutionizing how we live and work. You’ve also surely heard that it’s making incredible, inexplicable errors that the AI community calls “hallucinations.” Surely, you might think, this is all hype because both these statements cannot be true. But they are, and why the errors are possible is hidden in the twin concepts of training and knowledge bases.
Generative AI is based on large-language models (LLMs) that create a contextual picture of something, which might be an image, a programming language, or human conversation.