Information:
comparing information to mass
higher mass requires more energy to move
larger volume requires more space to store
larger amount of information requires more space to store
and more bandwidth to move
Creating mass:
mass requires same amount of energy to create?
e=mc^2
energy has direct correlation to mass
In information this is not necessarily true:
to create large amount of information, large amount of energy is not necessarily required.
What is information?
- writing a book. Book may be observer as containing lot of information. Traditionally it takes a long time to write. In recent times, not necessarily - your llm can write a book in minutes.
Does book contain lot of information? What do you even mean? Ofc not. Book contains information in size of kilobytes or at most megabytes.
On the other hand creating video is very fast and simple, but it contains way more information.
Creating 8k video, what about 16k video. Amount of information in a video file is massive.
10 minute video file may be in size of gigabytes. And to create it you can use random process and generate such video in one minute.
So what does information mean?
And what is even randomness?
The video generated in 10 minutes, containing 10 gigabytes of data, does not really contain 10 gigabytes of random data. This is because even though compression algorithms used today cannot guess the randomness algorithm. Its probably possible to compress the video into size of a book or less, simply by knowing the method used in random generator.
Metadata level compression:
- do not compress the video data generated, move one step above it. Compress the method used to generate the video.
What is information?
Is it the data in the file we observe? Or is it the methods and steps used to produce that data?
#metainformation #physics