Information theory.. and evolution.

Beginnings.

Information theory is a fascinating concept, connecting mathematics with computer science, biology and even philosophy. Previously I have written about information sphere, and how the personality is just a representation of information. However, only recently I have read about mathematical representation of information theory. As an example, the human DNA contains only 1.6 GB worth of information in its base pairs. Yet here you are reading this article with complex brain such as yours. And here I am with all my biological systems functioning in sophisticated patterns towards a rhythmic function of writing. Just from 1.6 GB of data, I received from my parents. How is this even possible? Does it mean that we are capable of creating a complex life just with few gigabytes of data?

Entropy

Another fascinating concept associated information theory is the entropy. I use entropy to explain why and how my room is always messy. But for scientists and philosophers' entropy is a fundamental concept to describe natural phenomena. If you do not know more complex systems like humans have less entropy (very unpredictable). When the predictability of a system increases entropy also becomes higher. Naturally the universe tends to flow towards higher entropy. Which means predictable disintegration into a high entropy state is the norm of the world. Well, I am sure you are just a commoner like me. So, I will give a clear explanation on what and how, information theory is connected with entropy and us.

Entropy

Evolution and information theory

If we try to explain life in the universe, we can say that we are fundamentally binary machines which have the capacity to predict the future comparing with information from the past. And this ability is inherited to our offspring through our DNA. Through the natural selection, in each iteration of inheritance we become better and better in processing information. How and when this initially a chemical process became a distinct life Is not clear. But at some point, it did, and we have now developed a brain which we can ask ourselves who are we? Intelligent enough to understand the whole process, which is arbitrary, obsolete and unnecessary when we compare the longevity of the universe.

Continuous change

We know that the universe is incomprehensibly vast in space as well as time. And in this vastness, we cannot expect any permanence. Whatever which needs to persist has to change and adapt. Otherwise, that existence would perish. 😌 but change itself needs effort, against constant tendency of the universe to go into chaos. How exhausting that could be. I can only compare this to the Sisyphean punishment of the God. (It's not a claim that there is not 1 and his fate is different from ours) it is clear, even if God exists, he also has to face the same problems of changing universe.

Questioning existence

But here is a problem. If a thing that persist is continuously changing over time, can we call it exist? If you know some philosophy this is the ship of Theseus argument. At some point whatever is there would not resemble the thing that existed sometime back. It's not only true for imaginary ships. You and I are also caught in this continuous eternal flux of universe with interwoven reasons.

I see nothing in this life which I should collect, even information doesn't make sense. As it is formed by binary data relevant only to a fixed time frame on the universe. But that is all I can do. Just collect information as pass it forward, so it might make sense for everyone else in the future Including my future self.

Summary of information theory.

Information theory is the mathematical study of how information is measured, stored, transmitted, and processed, where the information in an event is:

Information = -log₂(probability)

and the average uncertainty of a system is measured by Shannon entropy:

Entropy = -Σ [probability × log₂(probability)]

In words: Entropy is the average amount of information (or uncertainty) in a random process.