Entropy Definition and 1000 Threads

Entropy is a scientific concept, as well as a measurable physical property that is most commonly associated with a state of disorder, randomness, or uncertainty. The term and the concept are used in diverse fields, from classical thermodynamics, where it was first recognized, to the microscopic description of nature in statistical physics, and to the principles of information theory. It has found far-ranging applications in chemistry and physics, in biological systems and their relation to life, in cosmology, economics, sociology, weather science, climate change, and information systems including the transmission of information in telecommunication.The thermodynamic concept was referred to by Scottish scientist and engineer Macquorn Rankine in 1850 with the names thermodynamic function and heat-potential. In 1865, German physicist Rudolph Clausius, one of the leading founders of the field of thermodynamics, defined it as the quotient of an infinitesimal amount of heat to the instantaneous temperature. He initially described it as transformation-content, in German Verwandlungsinhalt, and later coined the term entropy from a Greek word for transformation. Referring to microscopic constitution and structure, in 1862, Clausius interpreted the concept as meaning disgregation.A consequence of entropy is that certain processes are irreversible or impossible, aside from the requirement of not violating the conservation of energy, the latter being expressed in the first law of thermodynamics. Entropy is central to the second law of thermodynamics, which states that the entropy of isolated systems left to spontaneous evolution cannot decrease with time, as they always arrive at a state of thermodynamic equilibrium, where the entropy is highest.
Austrian physicist Ludwig Boltzmann explained entropy as the measure of the number of possible microscopic arrangements or states of individual atoms and molecules of a system that comply with the macroscopic condition of the system. He thereby introduced the concept of statistical disorder and probability distributions into a new field of thermodynamics, called statistical mechanics, and found the link between the microscopic interactions, which fluctuate about an average configuration, to the macroscopically observable behavior, in form of a simple logarithmic law, with a proportionality constant, the Boltzmann constant, that has become one of the defining universal constants for the modern International System of Units (SI).
In 1948, Bell Labs scientist Claude Shannon developed similar statistical concepts of measuring microscopic uncertainty and multiplicity to the problem of random losses of information in telecommunication signals. Upon John von Neumann's suggestion, Shannon named this entity of missing information in analogous manner to its use in statistical mechanics as entropy, and gave birth to the field of information theory. This description has been proposed as a universal definition of the concept of entropy.

View More On Wikipedia.org
  1. T

    Why is Bernoulli's Equation Isentropic

    I have trouble understanding why we classify an inviscid adiabatic incompressible flow along a streamline as isentropic I understand this from a Thermodynamic definition/explanation $$dS = dQ/T$$ Adiabatic Invsicid $$dQ =0= dS$$ So no heat added or lost no change in entropy I'm fine with that...
  2. G

    How Do Microstates, kT, and Entropy Interact in Statistical Mechanics?

    Hi community, I'm trying to get my head round all these concepts. So entropy is given by S= k ln W. where W is the number of microstates of a system. Know let's imagine there is a box containing a number of gas atoms let's say the gas atoms have a current position and velocity and say you can...
  3. zrek

    Calculating entropy for a simple scenario

    I'd like to create a simple model that demonstrates the basic values of thermodinamics of an ideal gas. I begin with two rooms, several molecules in them. Every data of every individual molecule is given (position, mass, speed, etc), so I can easily calculate the total energy, pressure...
  4. G

    Does Laplace's demon know about entropy?

    Hi. I read this thread with great interest and have similar question: In a deterministic universe, does entropy exist for Laplace's demon? Since he knows the universe to it's microstate, does the term "macrostate" even make sense to him? And say there is a "half-demon" that only knows the...
  5. I

    How can entropy increase in a deterministic universe

    Let's imagine a deterministic universe. A one where quantum mechanics simply doesn't apply. Ok. This was the universe of classical physics. Atoms exist, and they behave deterministically. Fine. Now, how can entropy increase in this universe, altough it has the same laws of physics. In a...
  6. ShayanJ

    A Twisted boundary conditions for 2d CFT entanglement entropy

    I'm trying to read this paper. Right now my problem is with equations 3.16 and 3.17. I understand that in equation 3.16 we're putting some boundary conditions on the fields, but I have two problems with these boundary conditions: 1) The fields depend on both ## t_E ## and ## x##, i.e. ##...
  7. W

    I Measuring Time w/o Entropy: Can It Be Done?

    Is there any way to measure time without reference entropy? i.e suppose the universe has maximum entropy , is there any way to define a sense of time "after" that?
  8. D

    Determine Enthelpy, Entropy, and Chemical Potential

    Homework Statement Hello, i am given an isothermal transition for nitrogen, N2, where temperature is constant at 700K, p1=1bar, and p2=100bar. For this problem i am not allowed to use any equations of states, such as Benedict-Webb-Rubin, or Beattie-Bridgeman. Rather i am given only Cp data...
  9. Joosh

    Entropy Change of Touching Blocks That Reach Equillibrium

    Hello, folks! So, I've come across this question on my Physics homework, and I'm not entirely sure how to finish all the parts. I've included the parts I've gotten correct and what I've gone to get those answers. Use the exact values you enter in previous answer(s) to make later calculation(s)...
  10. S

    I How Did the Author Derive Equation (10) in the Context of Radiation Density?

    From the paper, https://arxiv.org/abs/astro-ph/0305015, on page 3, How did the author arrived with equation (10)? By using the radiation density and (8) defined in the previous paragraph, ## ρ_r = \frac{3}{4}Ts ~## (radiation density) I think the author got it wrong (## ρ_r = \frac{4}{3}Ts ~##)...
  11. H

    Proof that entropy can never decrease

    What is the proof of the fact that for an isolated system, entropy can never decrease?
  12. M

    Thermodynamics: (Entropy) Multiplicity using hypercube

    Hello, Few years back I was reading about calculating multiplicity using hypercube (n-cube). Multiplicity was normalized using this method. I wanted to read it again but I just cannot find it now. I tried every combination of keywords. I remember it was a Wikipedia link. Any help would be...
  13. T

    What Is the Entropy Change When Ice Melts in Hot Water?

    A closed, well-insulated container is filled with 454 g of water at 94.4 °C. To the hot water, 200 g of water ice at exactly 0 °C is added. The mixture reaches an equilibrium temperature of 41.1 °C. Assume the molar heat capacity is constant and all the processes are at constant pressure. The...
  14. T

    Undergraduate Student Seeking Answers on Sustaining Entropy

    Hello everyone! I am an undergraduate student from Greece in my first semester of Mechanical Engineering, but I am fascinated with physics. I've been studying some physics books from my university's library and reached the chapter of entropy. I understand the 2nd law of thermodynamics but what...
  15. ramzerimar

    Is entropy real or just a construct?

    When we talk about entropy, we say it comes from our inability to completely describe the state of a system. Also, we say it is a property of the system (like entalphy). That's confusing me a lot. If entropy is a property, how can it come from our inability to describe the system? Or it's just a...
  16. S

    Entropy of Diffusion: Delta Initial Condition

    Homework Statement The problem requires me to find the entropy of a diffusion constant as a function of time (I guess in terms of diffusion coefficient) Homework Equations Perhaps Heat / Diffusion kernel S = k p lnp The Attempt at a Solution I assume it was a delta initial condition then...
  17. Mayan Fung

    Why does the entropy increase in free expansion of an ideal gas?

    I learned that $$ dS = \frac Q T$$ In free expansion of Ideal gas, it is obvious that Q = 0. However, the entropy increases. I guess the reason is that it is because the process is not quasistatic. If I am right, why is this process not quasistatic. If I am not, what's wrong with the formula...
  18. N

    Maximum of entropy and Lagrange multiplier

    Hello, I have to find the density of probability which gives the maximum of the entropy with the following constraint\bar{x} = \int x\rho(x)dx \int \rho(x) dx = 1 the entropy is : S = -\int \rho(x) ln(\rho(x)) dx L = -\int \rho(x) ln(\rho(x)) dx - \lambda_1 ( \int \rho(x) dx -1 ) -...
  19. J

    Entropy and the Second Law of Thermodynamics in Isolated Systems

    Hello, In my textbook I read this example: A gas in an isolated system expands after pulling out a separating plate, so its volume increases and there is no work or heat exchange. the entropy of if the ideal gas is $$\Delta S = n R \ln \frac {V_1} {V_2}$$ and the second law of thermodynamics...
  20. C

    Entropy vs Enthalpy: Which is the Better Calculation for Heat Transfer?

    When calculating heat transfer, how would one know when to use Q=T*m*(delta s) versus Q=m*(delta h). I'm confused when we should calculate using entropy versus enthalpy. Anything helps. Thank you!
  21. F

    Calculating Entropy for 26 Particles in Box

    Homework Statement 52 distinguishable particles have been in a box long enough to reach equilibrium. The box is divided into two equal-volume cells. Let's say that there are 103 sub-states (s1 through s1000) available to each particle on each side, regardless of how many other particles are...
  22. B

    Ready to Dive into Entropy, Black Holes, and More? Join PF Bryan!

    I am trained in aeronatical engineering, spent a number of year supporting sounding rockets in the exploration of the Upper Atmosphere. Retired 16 years ago. Am interested in General Relativity and Quantum physics. Looking to explore and understanding of entropy... Black holes... Etc.
  23. Greg Bernhardt

    B Sean Carroll on Why Does Time Exist at All?

    Interesting TedTalk from Sean Carroll last month. At the end he asks the question of whether the big bang was really the beginning. Is this simple multiverse talk? Thoughts?
  24. I

    Partition function, Ideal gas, Entropy

    Homework Statement For a diatomic gas near room temperature, the internal partion function is simply the rotational partition function multiplied by degeneracy ##Z_e## of the electronic ground state. Show that the entropy in this case is ## S = Nk\left[ \ln \left(...
  25. weezy

    Entropy as a measure of energy gradient?

    This video explains the entropy concept as in terms of useless and useful energy. My question is how is this concluded from say Clausius' statement of 2nd law of thermodynamics which states that there can exist no cycle that transfers heat from A to B without producing any other effect. I...
  26. D

    Chemical thermodynamics, entropy, Maxwell relation and Z

    Homework Statement A gas obeys the equation of statez=1/(1-b(molar density)) What is the molar entropy change of expanding this gas from a volume of 1 dm3 to 2 dm3 at a temperature of 300 K, given b = 0.2 dm3? Calculate your answer to three significant figures and select one answer from the...
  27. R

    Entropy unavailable to do work

    I was helping my cousin with her Physics II class and they just started discussing entropy in the Thermo section of the class and her teacher gave the "measure of disorder in a system" definition which I personally hate because even though it might be technically accurate, it doesn't really...
  28. P

    Amateur physics here, how is entropy linked to the universe?

    I learned about entropy is chemistry, can someone please explain how this term is used in physics? Thanks.
  29. R

    Calculating change in entropy with °C or K.

    Homework Statement [/B] I was given a graph in the PV plane of a cyclic process and asked to find some quantities, one of them is the change in entropy for the system. I just had a question about the units. Homework Equations dS = CVln(Tf/Ti) The Attempt at a Solution The data was given in...
  30. A

    How is Entropy Change Calculated for a Composite System?

    Homework Statement A composite system consists of an insulated partitioned volume, shown in Figure 4.9. Side 1 contains 2 mol of a monatomic ideal gas and Side 2 contains 4 moles of the same monatomic ideal gas. Initially, the two sides are separated by a fully insulated partition (adiabatic...
  31. Grinkle

    B Does QM allow for entropy decrease of a closed system?

    I recently posted a statement that according to the 2nd law of thermodynamics, entropy always increases in a closed system, no matter how small the time interval is that one looks at. I think that is true for classical thermodynamic models, please correct me if I am wrong. Does quantum...
  32. V

    B Entropy change during the formation and death of stars

    The stars formation decreases the entropy but the radiations given out increases the overall entropy i am said ...but once the fusion processes are over the star no longer gives out radiations...and still the volume in which the matter particles of the star can be becomes less as the star...
  33. A

    Why is Qir < than Qr? Carnot cycle and change in G

    I am learning physics on khan academy and they do a proof to show that delta G for a reversible reaction is negative and how for a irreversible reaction it is positive. However in the proof, they assume that the heat put in by the isotherm is less for an irreversible reaction compared with a...
  34. Elvis 123456789

    Change in entropy of an ideal gas during thermodynamic cycle

    Homework Statement An ideal gas with adiabatic index γ is taken around a complete thermodynamic cycle consisting of three steps. Starting at point A, the pressure is increased at constant volume V1 from P1 to P2 at point B. From point B to point C, the gas is allowed to expand adiabatically...
  35. Elvis 123456789

    Change in entropy of a resistor

    Homework Statement Consider a thermally insulated resistor with resistance R=20 Ω and mass m=5.0 g. The resistor is made of a material with specific heat capacity c=850 J/(g-K) and carries a current of 2.0 A for a time period of 1.0 s. a) Calculate the increase in the temperature of the...
  36. Student100

    I Gravitating particles and entropy

    <Moderator's note: this is a spin-off from another thread> Matter isn't spreading out because of gravitational attractions between matter. If you took a bunch of gravitating particles and sealed them in container, the highest state of entropy is one where all the particles coalesce, which...
  37. U

    Calculating number of microstates to find entropy

    In the Boltzmann entropy formula , the number of microstates is calculated according to Maxwell-Boltzmann statistics , i.e. , W = n!/Πki! , Σki = n . Why cannot we use some other method , such as Bose-Einstein or Fermi-Dirac statistics ?
  38. M

    How does evolution theory fit the entropy theory

    the second law of thermodynamic state that their will be more chaos, and natural selection in the opposite of that. maybe this is a stupid question but can somebody anser this
  39. O

    Connection between entropy and total pressure

    Hi guys, I'm struggling to understand why an increase of entropy is directly linked with a decrease of total (stagnation) pressure. I have an idea, but I'm not sure if this is right. My understanding of the problem is as follows: Shear stress (friction) is a part of the entropy production term...
  40. F

    I 100th anniversary of the Sackur–Tetrode equation

    Because entropy and the often misled understanding of it shows up on PF on a regular basis, I thought it might be interesting to read about the history of how it all began. (Sorry, there wasn't an abstract to paste in here. But it's only four pages anyway.)...
  41. Boltar

    Entropy for Random Number Generation

    I want to generate very random numbers. There's a few approaches to this, such as the audio input from a de-tuned radio, hooking user input such as mouse movement and hashing the results over a period of time etc.. My idea was to get a cheap Geiger Counter and just leave it monitoring background...
  42. S

    1st law, 2nd law, entropy by Gyftopoulos / Beretta is confusing

    I'm reading Thermodynamics: Foundations and Applications by Gyftoploulos and Beretta, because the authors claim to give a presentation of classical thermodynamics without "... the lack of logical consistency and completeness in the many presentations of the foundations of thermodynamics" [from...
  43. Erik Schildt

    Entropy change and reversible/irreversible processes

    Homework Statement A mass m is thrown from a height of h. Find the entropy change of the mass, the surroundings and the universe. The temperature of the surroundings is T. Homework Equations dS=dQ/T ΔU=Q+W The Attempt at a Solution The main thing I don't understand in this question is how we...
  44. JMatt7

    Entropy: gas heated by resistor

    Homework Statement A current ## I=0.2 A ## flows in a resistor ##R = 50 Ω## immersed in a rigid adiabatic vessel that contains ##n=3## moles of Helium. The initial temperature of the system is ##T_0 = 27 °C##. The resistor has a mass ## m = 10 g## and specific heat ## c = 0.2 (cal/K)/g ##...
  45. blackdranzer

    I Can the internal energy of the surroundings change in an irreversible cycle?

    consider an irreversible cycle. There will be no changes in the state variables (like U, S) of the system undergoing the cycle, but for the surroundings, there will be change in the state variables, in fact, entropy increases. my question is, what happens to the internal energy of the...
  46. R

    Entropy: measure of amount of energy unavailable to do work?

    Dear All, I am trying to understand the concept of "entropy" in thermal engineering point of view. I have basic idea about "entropy" i.e. the change in entropy is used to determine the direction in which a given process will proceed. However following two more definition (of entropy generally...
  47. Chestermiller

    Grandpa Chet's Entropy Recipe - Comments

    Chestermiller submitted a new PF Insights post Grandpa Chet's Entropy Recipe Continue reading the Original PF Insights Post.
  48. R

    I What is the role of entropy in particle decay theory?

    Maybe my question is a bit more philosophical than scientific. In the macroscopic world entropy means that things become more chaotic and less orderly as they decay. It seems to me somewhat paradoxical that in the quantum world lower generation particles "decay" into the first generation...
  49. S

    Refuting the idea of entropy equalling "disorder"

    Hi. I have heard this, that entropy is often called "disorder" but _isn't really so_. And I am even more puzzled by the connection and difference between entropy from "information theory" pov and from "thermodynamic" pov. I see stuff like this...
  50. V

    I What is the relationship between entanglement and entropy in quantum systems?

    This is an observation I'm making that seems like it is wrong but I can't figure out why it would be. Entanglement links two states together. For example the spin angular momentum of particles. An entangled state of two particles could be where you know if one particle is measured spin up the...
Back
Top