{"id":1731,"date":"2022-04-29T23:30:00","date_gmt":"2022-04-30T03:30:00","guid":{"rendered":"http:\/\/underthehood.blogwyrm.com\/?p=1731"},"modified":"2022-07-28T06:28:23","modified_gmt":"2022-07-28T10:28:23","slug":"entropy-and-irreversibility","status":"publish","type":"post","link":"https:\/\/underthehood.blogwyrm.com\/?p=1731","title":{"rendered":"Entropy and The Second Law"},"content":{"rendered":"\n<p>The last post derived the Clausius inequality<\/p>\n\n\n\n<p>\\[ \\oint \\frac{{\\tilde d} Q}{T} \\leq 0 \\; , \\]<\/p>\n\n\n\n<p>using a rather subtle and clever technique (presented by Fermi in his book <em>Thermodynamics<\/em> without further attribution, although it is certain that the argument dates back probably more than fifty years earlier) in which a complex cyclical process was augmented with a set of Carnot cycles that interacted with the original reservoirs and an external heat reservoir called the base.&nbsp; By encapsulating the original cycle and these auxiliary Carnot cycles as a single, black box engine and then invoking Kelvin\u2019s postulate on their total interaction with the base, we were able to arrive at the expression above, with the equality holding only in the limiting case that the original cycle was reversible.&nbsp;<\/p>\n\n\n\n<p>Since <a href=\"http:\/\/underthehood.blogwyrm.com\/?p=1626\">an earlier post<\/a> demonstrated that Kelvin\u2019s and Clausius\u2019s postulates (both of which essentially say that perpetual motion is impossible) were different facets of the second law and Kelvin\u2019s postulate is used to derive the Clausius inequality, it is clear the inequality is yet another expression of the second law.&nbsp; The advantage of this third way of expressing the second law is that, as a mathematical expression, it motivated the definition of entropy, which has dominated the conversation ever after. &nbsp;The quantitative nature of the definition of entropy allows for two useful innovations: 1) the numerical determination for whether a process is allowed or disallowed to proceed spontaneously and 2) and rewriting of the first law in terms of $S$ since it is a state variable.&nbsp; Let\u2019s deal with each in turn.<\/p>\n\n\n\n<p>By definition, spontaneous processes occur naturally in a single direction; heat flows from a warmer body to a colder one; some chemical reactions run only in one direction, eggs that fall on the ground break never to reassemble themselves; and so on.&nbsp; Running movies of these processes backwards looks unnatural even though movies of billiard ball collisions and the motion of celestial objects do.&nbsp; None of these spontaneous processes are forbidden by energy conservation, they simply don\u2019t happen.&nbsp; As Carter points out in his book <em>Classical and Statistical Thermodynamics<\/em>, the first law is general, useful, and simple but is ultimately unsatisfactory since it doesn\u2019t distinguish between allowed and disallowed processes.&nbsp;<\/p>\n\n\n\n<p>Obviously, spontaneous process are irreversible even if the precise logical connection between these two terms is not completely established.&nbsp; For example, if the converse is true then we can also conclude that all irreversible processes are spontaneous.&nbsp; This kind of question is more subtle that it might seem at first glance.&nbsp; We will have to content ourselves with looking at irreversible processes since irreversibility takes mathematical expression within the Clausius inequality.&nbsp;<\/p>\n\n\n\n<p>To determine if a process is irreversible, one simply calculates the entropy change $\\Delta S$ between the before and after states.&nbsp; If the change in entropy is positive, the process is irreversible and we conclude it will happen spontaneously in nature.&nbsp; Note that the specific path by which the final state is reached from the initial state is irrelevant since entropy is a state variable.&nbsp; Heat need not flow from a hotter to colder body in exactly the same way every time the same experiment is run for us to conclude that the process will operate irreversibly.&nbsp; This is the power of defining entropy as an exact differential (i.e., state variable) and using the change as the indicator.<\/p>\n\n\n\n<p>To understand this further, we follow the example from Section 6.5 of Carter (which itself follows Fermi\u2019s presentation in Sec. 13) where we imagine an irreversible process that transitions a system between two thermodynamic states $a \\rightarrow b$ and a reversible process that carries the system back.&nbsp;<\/p>\n\n\n\n<div class=\"wp-block-image\"><figure class=\"aligncenter size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"761\" height=\"634\" src=\"http:\/\/underthehood.blogwyrm.com\/wp-content\/uploads\/2022\/04\/irreversible_reversible_sides.png\" alt=\"\" class=\"wp-image-1730\" srcset=\"https:\/\/underthehood.blogwyrm.com\/wp-content\/uploads\/2022\/04\/irreversible_reversible_sides.png 761w, https:\/\/underthehood.blogwyrm.com\/wp-content\/uploads\/2022\/04\/irreversible_reversible_sides-300x250.png 300w\" sizes=\"auto, (max-width: 761px) 100vw, 761px\" \/><\/figure><\/div>\n\n\n\n<p>By the Clausius inequality<\/p>\n\n\n\n<p>\\[ \\int_a^b \\frac{ {\\tilde d} Q}{T} + \\int_b^a \\frac{dQ_r}{T} \\leq 0 \\; . \\]<\/p>\n\n\n\n<p>Reversing the limits of the second integral (the reversible process) and rewriting the inequality gives<\/p>\n\n\n\n<p>\\[ \\int_a^b \\frac{{\\tilde d} Q}{T} \\leq \\int_a^b \\frac{dQ_r}{T} &nbsp;\\; . \\]<\/p>\n\n\n\n<p>The reversible integral can be immediately written as the difference between the entropy values at the two states giving a final relation<\/p>\n\n\n\n<p>\\[ \\Delta S = S_b &#8211; S_a \\geq \\int_a^b \\frac{{\\tilde d} Q}{T} \\; \\]<\/p>\n\n\n\n<p>Now if the system is isolated, then $d\\tilde Q = 0$, and we have that $\\Delta S \\geq 0$.&nbsp; This observation is the origin of the law that the entropy of the universe must always be increasing.<\/p>\n\n\n\n<p>On a more modest scale, a nice simple example of the power of this method comes from <em>General Chemistry, The Essential Concepts<\/em> by Chang and Overby.&nbsp; In Example 18.2, they ask the student, using standard entropy values, to calculate the entropy change in two chemical reactions at $25 C$.<\/p>\n\n\n\n<p>In the first chemical reaction<\/p>\n\n\n\n<p>\\[ CaCO_3(s) \\rightarrow CaO(s) + CO_2(g) \\; \\]<\/p>\n\n\n\n<p>has an entropy change of<\/p>\n\n\n\n<p>\\[ \\Delta S^{\\circ} = S^{\\circ}(CaO) + S^{\\circ}(CO_2) &#8211; S^{\\circ}(CaCO_3)\\\\ = (39.8 + 213.6 \u2013 92.9) J\/(K \\cdot mol) = 160.5 J\/(K mol) \\; , \\]<\/p>\n\n\n\n<p>while in the second chemical reaction<\/p>\n\n\n\n<p>\\[ N_2(g) + 3H_2(g) \\rightarrow 2NH_3(g) \\; \\]<\/p>\n\n\n\n<p>has an entropy change of<\/p>\n\n\n\n<p>\\[ \\Delta S^{\\circ} = 2 S^{\\circ}(NH_3) &#8211; S^{\\circ}(N_2) \u2013 3 S^{\\circ}(H_2)\\\\= (2 \\cdot 193 &#8211; 192 \u2013 3 \\cdot 131) J\/(K \\cdot mol) = -199.0 &nbsp;J\/(K mol) \\; . \\]<\/p>\n\n\n\n<p>From these values, we would expect the first chemical reaction to occur spontaneously while the second would not.&nbsp;<\/p>\n\n\n\n<p>The second innovation that entropy as an exact differential (i.e., state variable) provides is an incredibly useful rewrite of the first law of thermodynamics.&nbsp; The initial expression for the change in internal energy $U$ was expressed in terms of vague \u2018inexact\u2019 differentials as<\/p>\n\n\n\n<p>\\[ dU = {\\tilde d} Q &#8211; \\tilde{d}W \\; ,\\]<\/p>\n\n\n\n<p>where, ${\\tilde d} Q$ is the heat (positive if it flows into the system) and $\\tilde{d}W$ is the work (positive if the system performs is).\u00a0 We needed to specifically account for heat flow and work performed at each and every step in the process, a nearly impossible task for reversible processes and almost certainly an impossible one for irreversible processes.<\/p>\n\n\n\n<p>The introduction of the entropy provides the far more useful expression<\/p>\n\n\n\n<p>\\[ dU = TdS &#8211; PdV \\; ,\\]<\/p>\n\n\n\n<p>where every term on the right-hand side is a state variable.&nbsp; This change is more than cosmetic as having only state variables frees us from having to pay attention to how a system evolves and allows us to focus only on the before and after conditions which is a far easier task.<\/p>\n\n\n\n<p>To appreciate how this rewrite is possible, we follow the argument in Carter\u2019s Section 6.8.&nbsp; Carter starts by noting that the Clausius inequality allows us to conclude that<\/p>\n\n\n\n<p>\\[ dS \\geq \\frac{ {\\tilde d} Q}{T} \\; . \\]<\/p>\n\n\n\n<p>The inequality can be removed by accounting for reversible and irreversible pieces separately so that<\/p>\n\n\n\n<p>\\[ TdS \\equiv dQ_r = {\\tilde d} Q + \\epsilon \\; , \\]<\/p>\n\n\n\n<p>where $\\epsilon$ is some positive quantity and the $r$ subscript on $dQ_r$ reminds us that that is the quantity of heat into\/out of the system during the reversible process.&nbsp; Substituting this into the first law gives<\/p>\n\n\n\n<p>\\[ dU = TdS &#8211; \\epsilon &#8211; {\\tilde d} W = T dS &#8211; ({\\tilde d} W + \\epsilon) \\; .\\]<\/p>\n\n\n\n<p>The quantity in the parentheses is the amount of useful work done by the system plus the \u2018tax\u2019 associated with the system having to overcome dissipative forces.&nbsp; It is precisely the pressure work $PdV$ done by the system and so we arrive at<\/p>\n\n\n\n<p>\\[ dU = TdS &#8211; PdV \\; .\\]<\/p>\n\n\n\n<p>without any loss of generality.&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>The last post derived the Clausius inequality \\[ \\oint \\frac{{\\tilde d} Q}{T} \\leq 0 \\; , \\] using a rather subtle and clever technique (presented by Fermi in his book&#8230; <a class=\"read-more-button\" href=\"https:\/\/underthehood.blogwyrm.com\/?p=1731\">Read more &gt;<\/a><\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-1731","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"_links":{"self":[{"href":"https:\/\/underthehood.blogwyrm.com\/index.php?rest_route=\/wp\/v2\/posts\/1731","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/underthehood.blogwyrm.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/underthehood.blogwyrm.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/underthehood.blogwyrm.com\/index.php?rest_route=\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/underthehood.blogwyrm.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=1731"}],"version-history":[{"count":12,"href":"https:\/\/underthehood.blogwyrm.com\/index.php?rest_route=\/wp\/v2\/posts\/1731\/revisions"}],"predecessor-version":[{"id":1776,"href":"https:\/\/underthehood.blogwyrm.com\/index.php?rest_route=\/wp\/v2\/posts\/1731\/revisions\/1776"}],"wp:attachment":[{"href":"https:\/\/underthehood.blogwyrm.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=1731"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/underthehood.blogwyrm.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=1731"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/underthehood.blogwyrm.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=1731"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}