EngineeringToolkit

Shannon's Information Content Formula

The amount of information contained in an event with probability p(x).

Formula

I(x) = -log₂(p(x))

Discipline: Computer Science. Result unit: bits.

Variables and units

  • I(x) — Information Content (bits): Information content of event x
  • p(x) — Probability: Probability of event x