{"id":549,"date":"2015-06-19T22:22:41","date_gmt":"2015-06-19T22:22:41","guid":{"rendered":"http:\/\/underthehood.blogwyrm.com\/?p=549"},"modified":"2022-07-28T06:26:01","modified_gmt":"2022-07-28T10:26:01","slug":"lie-series-basics","status":"publish","type":"post","link":"https:\/\/underthehood.blogwyrm.com\/?p=549","title":{"rendered":"Lie Series Basics"},"content":{"rendered":"<p>This column, which is a relatively short one as I am still grappling with the details, is the introductory piece for what I intend to be a through exploration of the use of Lie Series as a method for solving differential equations. This particular entry is heavily influenced by the NASA Technical Note TN D-4460 entitled &#8216;On the Application of Lie-Series to the Problems of Celestial Mechanics&#8217; by Karl Stumpff, dated June 1968.<\/p>\n<p>Stumpff starts his note with the following interesting passage:<\/p>\n<div class = \"myQuoteDiv\">Recently, a new method has been proposed by Wolfgang Grobner. He uses the &#8220;Lie-Series&#8221; in solving a restricted call of differential equation. It is not clear that this new method is better than others; it has not been sufficiently used.<\/p>\n<div class = \"myAttrib\">&#8211; Karl Stumpff<\/div>\n<\/div>\n<p>That passage is interesting mostly due what the meaning of &#8216;Recently&#8217; is. In his references, Stumpff lists only one work by Grobner, entitled &#8220;Die Lie-Reihen und ihre Anwendungen&#8221; dated 1960. Sophus Lie, from whom the Lie series derives it&#8217;s name, died in 1899 and it seems that it took 61 years for his work to really penetrate celestial mechanics.<\/p>\n<p>The central idea of the Lie series is the production of an operator that makes the solution of certain differential equations manifest and their expansion in terms of a power series &#8216;automatic&#8217;. In presenting the prescription, I follow Stumpff&#8217;s ordering closely but with modifications of the notation to suit my tastes and needs.<\/p>\n<p>Assume that there are $$n$$ functions<\/p>\n<p>\\[ F_i(z) = F_i(z_1, z_2, \\dots, z_n) \\]<\/p>\n<p>in $$n$$ complex variables $$z_i$$ that are <a href=\"https:\/\/en.wikipedia.org\/wiki\/Analytic_function\">analytic<\/a> in the neighborhood of<\/p>\n<p>\\[ \\zeta = (\\zeta_1, \\zeta_2, \\dots, \\zeta_n) \\; . \\]<\/p>\n<p>The concept of a Lie series depends on first defining the operator<\/p>\n<p>\\[ D = F_1(z) \\frac{\\partial}{\\partial z_1} + F_2(z) \\frac{\\partial}{\\partial z_2} + \\dots + F_n(z) \\frac{\\partial}{\\partial z_n} \\; .\\]<\/p>\n<p>The operator $$D$$ is a <a href=\"https:\/\/en.wikipedia.org\/wiki\/Derivation_(differential_algebra)\">derivation<\/a>. That is to say it obeys the following properties.<\/p>\n<p>It is linear<\/p>\n<p>\\[ D[f(z) + g(z) ] = D[f(z)] + D[g(z)] \\; ,\\]<\/p>\n<p>it operation on a constant results in zero<\/p>\n<p>\\[ D[ c f(z) ] = c D f(z) \\; , \\]<\/p>\n<p>and it obeys the Liebniz rule<\/p>\n<p>\\[ D[f(z) g(z) ] = f(z) \\cdot Dg(z) + Df(z) \\cdot g(z) \\; .\\]<\/p>\n<p>Repeated application of the $$D$$ operator on the product of two functions results in the usual binomial expansion<\/p>\n<p>\\[ D^n [ f(z) g(z) ] = \\sum_{\\nu = 0}^{n} \\left( \\begin{array}{c} n \\\\ \\nu \\end{array} \\right) D^{\\nu} f(z) D^{n-\\nu} g(z) \\; .\\]<\/p>\n<p>Now the Lie series operator $$L$$ is defined as<\/p>\n<p>\\[ L(z,t) f(z) = e^{t D} f(z) \\; , \\]<\/p>\n<p>where the exponential notation is short-hand for the series<\/p>\n<p>\\[ L(z,t) f(z) = \\sum_{n=0}^{\\infty} \\frac{t^n}{n!} D^n f(z) = \\left[1 + t D + \\frac{t^2}{2!} D^2 + \\dots \\right] f(z) \\; .\\]<\/p>\n<p>Note that often, the arguments $$(z,t)$$ are omitted.<\/p>\n<p>Now an interesting and useful property of the Lie series operator for the product of two functions is<\/p>\n<p>\\[ L[f(z)g(z)] = L[f(z)] \\cdot L[g(z)] \\; ,\\]<\/p>\n<p>or in words, that the Lie series of a product is the product of the Lie series. This relationship is called the interchange relation.<\/p>\n<p>Since we imagine that all the functions of interest are analytic, this simple relation &#8216;bootstraps&#8217; to the general relation<\/p>\n<p>\\[ L[ Q(z)] = Q(L[z]) \\; ,\\]<\/p>\n<p>for $$Q(z)$$ analytic.<\/p>\n<p>As an example of this bootstrap relation, consider $$D = \\frac{d}{dz}$$, and note that<\/p>\n<p>\\[ D^n[z] = 1 \\delta_{n0} \\]<\/p>\n<p>and therefore<\/p>\n<p>\\[ L[z] = e^{t D}z = (1+ tD)z = z + t \\; .\\]<\/p>\n<p>So the bootstrap relation gives first<\/p>\n<p>\\[ L[ Q(z)] = \\sum_{n=0}^{\\infty} \\frac{t^n}{n!} \\frac{d}{dz} Q(z) \\; ,\\]<\/p>\n<p>which from elementary calculus is recognized to be $$Q(z+t)$$ expanded about $$t=0$$, and second<\/p>\n<p>\\[ Q(L[z]) = Q(z+t) \\; . \\]<\/p>\n<p>Now the utility of the Lie series is not that it provides a compact way of representing a Taylor&#8217;s series (as convenient as that is) but rather in the fact that when the $$F_i$$ are not trivial functions it encodes solutions to a coupled set of differential equations. To see how this works, assume a system of differential equations given by<\/p>\n<p>\\[ \\frac{d z_i}{dt} = F_i(z) \\]<\/p>\n<p>with initial conditions<\/p>\n<p>\\[ z_i(0) = \\zeta_i \\; .\\]<\/p>\n<p>Then the solution of this system of equations is<\/p>\n<p>\\[ z_i(t) = e^{t D} \\zeta_i \\; . \\]<\/p>\n<p>To see this, take the derivative of the solution to get<\/p>\n<p>\\[ \\frac{d z_i(t)}{d t} = \\frac{d}{dt} e^{tD} \\zeta_i = D e^{t D} \\zeta_i \\; . \\]<\/p>\n<p>But, by definition, $$ e^{t D} \\zeta_i = z_i(t) $$, so<\/p>\n<p>\\[ \\frac{d z_i(t)}{d t} = D z_i = F_i \\; . \\]<\/p>\n<p>In some sense, this is our old friend the propagator or state transition matrix written in a new form. However, this new encoding works for non-linear systems as well, a point that makes it an improvement on those approaches.<\/p>\n<p>One last note. So far, the system of differential equations was assumed to be autonomous. In the event the system isn&#8217;t, a simple &#8216;trick&#8217; can be used to make it look autonomous. Define a new variable $$z_0 = t$$ and the augment the definition of $$D$$ to be<\/p>\n<p>\\[ D = \\frac{\\partial}{\\partial z_0} + \\sum_{i=0}^{n} F_i(z) \\frac{\\partial}{\\partial z_i} \\; .\\]<\/p>\n<p>This manipulation has the advantage of making an non-autonomous system look formally autonomous. The only disadvantage is that all notion of equilibrium points are lost since the right-hand side of the equations can never have well-defined critical points.<\/p>\n<p>Next time, I&#8217;ll apply the Lie series formalism to the Kepler problem<\/p>\n","protected":false},"excerpt":{"rendered":"<p>This column, which is a relatively short one as I am still grappling with the details, is the introductory piece for what I intend to be a through exploration of&#8230; <a class=\"read-more-button\" href=\"https:\/\/underthehood.blogwyrm.com\/?p=549\">Read more &gt;<\/a><\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-549","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"_links":{"self":[{"href":"https:\/\/underthehood.blogwyrm.com\/index.php?rest_route=\/wp\/v2\/posts\/549","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/underthehood.blogwyrm.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/underthehood.blogwyrm.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/underthehood.blogwyrm.com\/index.php?rest_route=\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/underthehood.blogwyrm.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=549"}],"version-history":[{"count":6,"href":"https:\/\/underthehood.blogwyrm.com\/index.php?rest_route=\/wp\/v2\/posts\/549\/revisions"}],"predecessor-version":[{"id":563,"href":"https:\/\/underthehood.blogwyrm.com\/index.php?rest_route=\/wp\/v2\/posts\/549\/revisions\/563"}],"wp:attachment":[{"href":"https:\/\/underthehood.blogwyrm.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=549"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/underthehood.blogwyrm.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=549"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/underthehood.blogwyrm.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=549"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}