Chaos is a word that gets thrown around a lot, and I know nothing about Chaos Theory, which is at this point probably a serious branch of mathematics, but again, I know nothing about it. However, it dawned on me, that you can think about chaos in terms of information, using Cellular Automata as the intuition. Specifically, consider the initial conditions of a binary automaton, which together form a single vector of binary digits. Then you have the rule,
, which takes those initial conditions, and mechanistically generates the rows that follow. Let
be a particular set of initial conditions (i.e., a particular binary vector), so that
is the result of applying
to the initial conditions
, for some fixed number of
iterations. Now change exactly one bit of
, producing
, which in turn produces
. Now count the number of unequal bits between
and
, which must be at least one, since we changed exactly one bit of
to produce
. Let
be the number of unequal bits between
and
, and let
be the number of bits changed in
, to produce
. We can measure how chaotic
is in bits, as the ratio,
.
Said in words, is the ratio of the total number of bits that change divided by the number of bits changed in the initial conditions.
Discover more from Information Overload
Subscribe to get the latest posts sent to your email.