Are Shannon entropy and Residual entropy synonyms?
Конференцијски прилог (Објављена верзија)
Метаподаци
Приказ свих података о документуАпстракт
At temperatures close to absolute zero, individual symmetric or asymmetric molecules that comprise a thermodynamic system organize themselves into crystals that we can comprehend as macromolecules. Crystals can be ideal (perfect crystals) if they consist of monotonous arrays of aligned symmetric or asymmetric molecules. Unideal (imperfect crystals) comprize nonmonotonic arrays of asymmetric molecules. Therefore, nonmonotonous arrays contain an information code and a certain amount of information, I. The disorder of such a thermodynamic-intofmation system is characetrized by Shannon entropy, H, in informatics and by residual entropy, S0 or R0, in thermodynamics. Both quantities are based on the statistical coin model and in both cases probabilities are determined by the Gaussian normal distribution. However, the probabilities in thermodynamic entropy, S, are described by the Boltzmann distribution. Thus, we see that a thermodynamic system possesses three kinds of entropy: thermodynamic ...entropy, residual entropy and Shannon entropy. The relationship of these three entropies, however, still remains unclear. In order to shed more light on this problem, a comparative analysis of the three entropies was done. Thermodynamic entropy of an ideal crystal was calculated by the Boltzmann entropy equation, treating it as one large macromolecule. Shannon entropy and residual entropy were found through the Shannon equation and Boltzmann entropy equation, respectively. In the calculation of Shannon entropy, the constant in the Shannon equation was set equal to the Boltzmann constant, in order for it to be comparable with thermodynamic and residual entropy. Entropies of real gasses were also analyzed. Thermodynamic entropy of real gasses was calculated from the high temperature ideal limit to the condensation temperature using van der Waals, Berthelot and Redlich-Kwong models. Our analysis leads us to conclusion that the residual entropy, S0 or R0, of a closed thermodynamic system that contains asymmetric particles (i.e. CO, H2O, N2O) aligned in nonmonotonic series is equal to its Shannon entropy, H. So the information theory and classical thermodynamics have at least one strong common point – the equality of Shannon entropy and residual entropy, H = R0.
Кључне речи:
Thermodynamic entropy / Shannon entropy / Residual entropy / symmetric/asymmetric particles / monotonic/non-monotonic seriesИзвор:
Proceedings of the 2nd International Electronic Conference on Entropy and Its Applications, 2015Издавач:
- MDPI
Институција/група
IHTMTY - CONF AU - Popović, Marko PY - 2015 UR - https://cer.ihtm.bg.ac.rs/handle/123456789/6118 AB - At temperatures close to absolute zero, individual symmetric or asymmetric molecules that comprise a thermodynamic system organize themselves into crystals that we can comprehend as macromolecules. Crystals can be ideal (perfect crystals) if they consist of monotonous arrays of aligned symmetric or asymmetric molecules. Unideal (imperfect crystals) comprize nonmonotonic arrays of asymmetric molecules. Therefore, nonmonotonous arrays contain an information code and a certain amount of information, I. The disorder of such a thermodynamic-intofmation system is characetrized by Shannon entropy, H, in informatics and by residual entropy, S0 or R0, in thermodynamics. Both quantities are based on the statistical coin model and in both cases probabilities are determined by the Gaussian normal distribution. However, the probabilities in thermodynamic entropy, S, are described by the Boltzmann distribution. Thus, we see that a thermodynamic system possesses three kinds of entropy: thermodynamic entropy, residual entropy and Shannon entropy. The relationship of these three entropies, however, still remains unclear. In order to shed more light on this problem, a comparative analysis of the three entropies was done. Thermodynamic entropy of an ideal crystal was calculated by the Boltzmann entropy equation, treating it as one large macromolecule. Shannon entropy and residual entropy were found through the Shannon equation and Boltzmann entropy equation, respectively. In the calculation of Shannon entropy, the constant in the Shannon equation was set equal to the Boltzmann constant, in order for it to be comparable with thermodynamic and residual entropy. Entropies of real gasses were also analyzed. Thermodynamic entropy of real gasses was calculated from the high temperature ideal limit to the condensation temperature using van der Waals, Berthelot and Redlich-Kwong models. Our analysis leads us to conclusion that the residual entropy, S0 or R0, of a closed thermodynamic system that contains asymmetric particles (i.e. CO, H2O, N2O) aligned in nonmonotonic series is equal to its Shannon entropy, H. So the information theory and classical thermodynamics have at least one strong common point – the equality of Shannon entropy and residual entropy, H = R0. PB - MDPI C3 - Proceedings of the 2nd International Electronic Conference on Entropy and Its Applications T1 - Are Shannon entropy and Residual entropy synonyms? DO - 10.3390/ecea-2-A004 ER -
@conference{ author = "Popović, Marko", year = "2015", abstract = "At temperatures close to absolute zero, individual symmetric or asymmetric molecules that comprise a thermodynamic system organize themselves into crystals that we can comprehend as macromolecules. Crystals can be ideal (perfect crystals) if they consist of monotonous arrays of aligned symmetric or asymmetric molecules. Unideal (imperfect crystals) comprize nonmonotonic arrays of asymmetric molecules. Therefore, nonmonotonous arrays contain an information code and a certain amount of information, I. The disorder of such a thermodynamic-intofmation system is characetrized by Shannon entropy, H, in informatics and by residual entropy, S0 or R0, in thermodynamics. Both quantities are based on the statistical coin model and in both cases probabilities are determined by the Gaussian normal distribution. However, the probabilities in thermodynamic entropy, S, are described by the Boltzmann distribution. Thus, we see that a thermodynamic system possesses three kinds of entropy: thermodynamic entropy, residual entropy and Shannon entropy. The relationship of these three entropies, however, still remains unclear. In order to shed more light on this problem, a comparative analysis of the three entropies was done. Thermodynamic entropy of an ideal crystal was calculated by the Boltzmann entropy equation, treating it as one large macromolecule. Shannon entropy and residual entropy were found through the Shannon equation and Boltzmann entropy equation, respectively. In the calculation of Shannon entropy, the constant in the Shannon equation was set equal to the Boltzmann constant, in order for it to be comparable with thermodynamic and residual entropy. Entropies of real gasses were also analyzed. Thermodynamic entropy of real gasses was calculated from the high temperature ideal limit to the condensation temperature using van der Waals, Berthelot and Redlich-Kwong models. Our analysis leads us to conclusion that the residual entropy, S0 or R0, of a closed thermodynamic system that contains asymmetric particles (i.e. CO, H2O, N2O) aligned in nonmonotonic series is equal to its Shannon entropy, H. So the information theory and classical thermodynamics have at least one strong common point – the equality of Shannon entropy and residual entropy, H = R0.", publisher = "MDPI", journal = "Proceedings of the 2nd International Electronic Conference on Entropy and Its Applications", title = "Are Shannon entropy and Residual entropy synonyms?", doi = "10.3390/ecea-2-A004" }
Popović, M.. (2015). Are Shannon entropy and Residual entropy synonyms?. in Proceedings of the 2nd International Electronic Conference on Entropy and Its Applications MDPI.. https://doi.org/10.3390/ecea-2-A004
Popović M. Are Shannon entropy and Residual entropy synonyms?. in Proceedings of the 2nd International Electronic Conference on Entropy and Its Applications. 2015;. doi:10.3390/ecea-2-A004 .
Popović, Marko, "Are Shannon entropy and Residual entropy synonyms?" in Proceedings of the 2nd International Electronic Conference on Entropy and Its Applications (2015), https://doi.org/10.3390/ecea-2-A004 . .
Related items
Showing items related by title, author, creator and subject.
-
Entropy change of open thermodynamic systems in self-organizing processes
Popović, Marko (Society of Thermal Engineers of Serbia, 2014) -
Explaining the entropy concept and entropy components
Popović, Marko (Serbian Society of Subject Didacticians (SSoSD), 2017)