INGENIA

PRB-29

Uniform entropy

Discrete uniform entropy.

Reading speed
GoverningUniform entropy

Governing equation

H=log2nH=\\log_2 n

where

n
n ()
H
Uniform entropy (bit)

Lecture brief

Historical brief

Bernoulli trials, Poisson, Gauss, Bayes and Shannon entropy turned chance into a calculus of belief and noise. The lab computes likelihood, interval and information in SI-free counts. This sheet (PRB-29 — Uniform entropy) is the form associated with Uniform entropy. Working symbols: nn \rightarrow HH. Discrete uniform entropy. Pedagogical SI sheet with a live model and a swept parameter.

Purpose

Purpose: compute HH from nn in Probability & statistics via H=log2nH=\\log_2 n Discrete uniform entropy. Use it when a real probability & statistics question must be answered in SI before a code check.

Live realistic example

In symbols

Live case. Given n=8.000n = 8.000\,\mathrm{—}, the governing relation H=log2nH=\\log_2 n yields H=3.000bitH = 3.000\,\mathrm{bit}. One governing identity, SI units, a single sweep on the sheet. Move a slider: the numbers are this situation, not a canned story.

Calculator

Inputs

Outputs

  • Uniform entropy H3.000 bit
Reading speed

Watch on YouTube

Free library

Full library

Free PDF / open book

YouTube channels

PRB-29 · curve
00:0 / 00:08

Narration of this film

One governing identity, SI units, a single sweep on the sheet.

Discrete uniform entropy. Pedagogical SI sheet with a live model and a swept parameter.

Reading speed

Watch on YouTube