Information as surprise, stripped of meaning
Shannon defined information not by what a message means but by how much it reduces uncertainty: the less predictable a symbol, the more information it carries, measured in bits. Separating information from meaning let a single mathematics cover telegraph, telephone, radio and later digital data, and it showed that any message can be encoded as binary choices.
