Entropy and Probability Relation Entropy is a measure of disorder or randomness associated with a physical system, while probability is a measure of the lik...
Entropy and Probability Relation
Entropy is a measure of disorder or randomness associated with a physical system, while probability is a measure of the likelihood of various microstates within a macrostate. In statistical mechanics, these two concepts are intertwined in the concept of equilibrium.
Entropy
The entropy S of a system is defined as the measure of its disorder or randomness. It is a measure of how many microstates are needed to completely describe the system, assuming that each microstate has the same probability of occurrence. The entropy S is a non-negative real number that is always greater than or equal to 0.
Probability
The probability p of a microstate occurring is a measure of its likelihood. It is defined as the ratio of the number of microstates corresponding to that microstate to the total number of microstates in the macrostate.
Equilibrium
In equilibrium, the entropy of a system is constant, meaning that the system reaches a state of maximum disorder or randomness when all possible microstates are equally likely to occur. This is because, in equilibrium, there is no driving force that can cause the system to change its state.
The Entropy-Probability Relation
The entropy S of a system is related to the probability p of a microstate occurring in the following ways:
S = -log(p): The entropy S of a system is equal to the logarithm of the probability of the microstate occurring. This means that the higher the probability of a microstate, the lower its entropy.
S is lower than log(p): In equilibrium, the entropy S is always lower than the logarithm of the probability of the microstate occurring. This means that it is more likely for a system to reach a state of lower disorder or randomness when all possible microstates have the same probability of occurrence.
Examples
In a bag of marbles, the entropy is higher than it would be if the marbles were all the same color. This is because the marbles are more likely to be grouped together in different ways when they are not all the same color.
In a thermodynamic system at equilibrium, the entropy is constant. This means that the system is perfectly ordered and all possible microstates have the same probability of occurring.
In a quantum system, the entropy is related to the uncertainty of the system's energy. The more uncertain the energy is, the higher the entropy.
Conclusion
Entropy and probability are two fundamental concepts in statistical mechanics that are closely related. Entropy is a measure of disorder or randomness, while probability is a measure of the likelihood of various microstates within a macrostate. In equilibrium, the entropy of a system is constant, meaning that the system reaches a state of maximum disorder or randomness when all possible microstates are equally likely to occur