Shannon entropy
Type: Concept
As of November 2026, Shannon entropy has been mentioned in one podcast episode on Computerphile (Dec 2025).
In information theory, the entropy of a random variable quantifies the average level of uncertainty or information associated with the variable's potential states or possible outcomes. This measures the expected amount of information needed to describe the state of the variable, considering the distribution of probabilities across all potential states. Given a discrete random variable , which may be any member within the set and is distributed according to , the entropy is where denotes the
| Mentioned in | 1 episode on 1 podcast (as of November 2026) |
|---|---|
| First heard | Dec 2025 on Computerphile |
Who talks about Shannon entropy on podcasts?
Shannon entropy came up; the most recent mention was Dec 2025 on Computerphile.
- Procedural Generation in Games - Computerphile on Computerphile (Dec 2025)
What is Shannon entropy mentioned alongside?
Shannon entropy is most often mentioned alongside Carcassonne, L-systems and Python.
Mentioned together: Carcassonne, L-systems, Python, GitHub