<?xml version="1.0" encoding="utf-8"?><feed xmlns="http://www.w3.org/2005/Atom" xml:lang="en-US"><generator uri="https://jekyllrb.com/" version="4.4.1">Jekyll</generator><link href="https://ulysseszh.github.io/feed/tags/calculus.xml" rel="self" type="application/atom+xml" /><link href="https://ulysseszh.github.io/" rel="alternate" type="text/html" hreflang="en-US" /><updated>2026-04-19T16:48:01-07:00</updated><id>https://ulysseszh.github.io/feed/tags/calculus.xml</id><title type="html"><![CDATA[Ulysses’ trip]]></title><subtitle>Here we are at the awesome (awful) blog written by UlyssesZhan!</subtitle><author><name>UlyssesZhan</name><email>ulysseszhan@gmail.com</email></author><entry><title type="html"><![CDATA[Relationship between the Gini coefficient and the variance]]></title><link href="https://ulysseszh.github.io/economics/2023/02/06/gini-variance.html" rel="alternate" type="text/html" title="Relationship between the Gini coefficient and the variance" /><published>2023-02-06T16:38:25-08:00</published><updated>2023-02-06T16:38:25-08:00</updated><id>https://ulysseszh.github.io/economics/2023/02/06/gini-variance</id><content type="html" xml:base="https://ulysseszh.github.io/economics/2023/02/06/gini-variance.html"><![CDATA[<p>
  <em>This article is translated from a Chinese <a href="https://zhuanlan.zhihu.com/p/367530273" target="_blank" rel="external">article</a> on my Zhihu account. The original article was posted at 2021-04-25 10:06 +0800.</em>
</p>
<hr/>
<p>First, define the Lorenz curve: it is the curve that consists of all points <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mo stretchy="false">(</mo><mi>u</mi><mo separator="true">,</mo><mi>v</mi><mo stretchy="false">)</mo></mrow><annotation encoding="application/x-tex">(u,v)</annotation></semantics></math></span></span> such that the poorest <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>u</mi></mrow><annotation encoding="application/x-tex">u</annotation></semantics></math></span></span> portion of population in the country owns <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>v</mi></mrow><annotation encoding="application/x-tex">v</annotation></semantics></math></span></span> portion of the total wealth.</p>
<p>The Gini coefficient <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>G</mi><mi mathvariant="normal">/</mi><mi>μ</mi></mrow><annotation encoding="application/x-tex">G/\mu</annotation></semantics></math></span></span> is defined as the area between the Lorenz curve and the line <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>u</mi><mo>=</mo><mi>v</mi></mrow><annotation encoding="application/x-tex">u=v</annotation></semantics></math></span></span> divided by the area enclosed by the three lines <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>u</mi><mo>=</mo><mi>v</mi></mrow><annotation encoding="application/x-tex">u=v</annotation></semantics></math></span></span>, <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>v</mi><mo>=</mo><mn>0</mn></mrow><annotation encoding="application/x-tex">v=0</annotation></semantics></math></span></span>, and <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>u</mi><mo>=</mo><mn>1</mn></mrow><annotation encoding="application/x-tex">u=1</annotation></semantics></math></span></span>.</p>
<p>Now, suppose the wealth distribution in the country is <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>p</mi><mo stretchy="false">(</mo><mi>X</mi><mo stretchy="false">)</mo></mrow><annotation encoding="application/x-tex">p(X)</annotation></semantics></math></span></span>, where <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>p</mi><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mi>x</mi><mo fence="true">)</mo></mrow><mi mathvariant="normal">d</mi><mi>x</mi></mrow><annotation encoding="application/x-tex">p\!\left(x\right)\mathrm dx</annotation></semantics></math></span></span> is the portion of population that has wealth in the range <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mo stretchy="false">[</mo><mi>x</mi><mo separator="true">,</mo><mi>x</mi><mo>+</mo><mi mathvariant="normal">d</mi><mi>x</mi><mo stretchy="false">]</mo></mrow><annotation encoding="application/x-tex">[x,x+\mathrm dx]</annotation></semantics></math></span></span>.</p>
<p>Then, the Lorenz curve is the graph of the function <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>g</mi></mrow><annotation encoding="application/x-tex">g</annotation></semantics></math></span></span> defined as <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mi>g</mi><mo stretchy="false">(</mo><mi>F</mi><mo stretchy="false">(</mo><mi>x</mi><mo stretchy="false">)</mo><mo stretchy="false">)</mo><mo>=</mo><mfrac><mn>1</mn><mi>μ</mi></mfrac><msubsup><mo>∫</mo><mrow><mo>−</mo><mi mathvariant="normal">∞</mi></mrow><mi>x</mi></msubsup><mi>t</mi><mi>p</mi><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mi>t</mi><mo fence="true">)</mo></mrow><mi mathvariant="normal">d</mi><mi>t</mi><mo separator="true">,</mo></mrow><annotation encoding="application/x-tex">g(F(x))=\frac1\mu\int_{-\infty}^xtp\!\left(t\right)\mathrm dt,</annotation></semantics></math></span></span></span> where <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mi>F</mi><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mi>x</mi><mo fence="true">)</mo></mrow><mo><mi mathvariant="normal">≔</mi></mo><msubsup><mo>∫</mo><mrow><mo>−</mo><mi mathvariant="normal">∞</mi></mrow><mi>x</mi></msubsup><mi>p</mi><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mi>t</mi><mo fence="true">)</mo></mrow><mi mathvariant="normal">d</mi><mi>t</mi></mrow><annotation encoding="application/x-tex">F\!\left(x\right)\coloneqq\int_{-\infty}^xp\!\left(t\right)\mathrm dt</annotation></semantics></math></span></span></span> is the cumulative distribution function of <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>p</mi><mo stretchy="false">(</mo><mi>X</mi><mo stretchy="false">)</mo></mrow><annotation encoding="application/x-tex">p(X)</annotation></semantics></math></span></span>, and <span id="eq:eq-def-mu" data-label="(1)"><span class="katex-display-table"> <span class="katex-display-numbered"><span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mi>μ</mi><mo><mi mathvariant="normal">≔</mi></mo><msubsup><mo>∫</mo><mrow><mo>−</mo><mi mathvariant="normal">∞</mi></mrow><mrow><mo>+</mo><mi mathvariant="normal">∞</mi></mrow></msubsup><mi>t</mi><mi>p</mi><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mi>t</mi><mo fence="true">)</mo></mrow><mi mathvariant="normal">d</mi><mi>t</mi></mrow><annotation encoding="application/x-tex">\mu\coloneqq\int_{-\infty}^{+\infty}tp\!\left(t\right)\mathrm dt</annotation></semantics></math></span></span></span></span> <span class="katex-display-number"><span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mo stretchy="false">(</mo><mn>1</mn><mo stretchy="false">)</mo></mrow><annotation encoding="application/x-tex">(1)</annotation></semantics></math></span></span></span></span> </span></span> is the average wealth of the population, which is just <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi mathvariant="normal">E</mi><mo stretchy="false">[</mo><mi mathvariant="normal">X</mi><mo stretchy="false">]</mo></mrow><annotation encoding="application/x-tex">\mathrm E[\mathrm X]</annotation></semantics></math></span></span> (<span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>X</mi></mrow><annotation encoding="application/x-tex">X</annotation></semantics></math></span></span> is a random variable such that <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>X</mi><mo>∼</mo><mi>p</mi><mo stretchy="false">(</mo><mi>X</mi><mo stretchy="false">)</mo></mrow><annotation encoding="application/x-tex">X\sim p(X)</annotation></semantics></math></span></span>).</p>
<p>Then, the Lorenz curve is <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mi>v</mi><mo>=</mo><mi>g</mi><mo stretchy="false">(</mo><mi>u</mi><mo stretchy="false">)</mo><mo><mi mathvariant="normal">≔</mi></mo><mfrac><mn>1</mn><mi>μ</mi></mfrac><msubsup><mo>∫</mo><mrow><mo>−</mo><mi mathvariant="normal">∞</mi></mrow><mrow><msup><mi>F</mi><mrow><mo>−</mo><mn>1</mn></mrow></msup><mo stretchy="false">(</mo><mi>u</mi><mo stretchy="false">)</mo></mrow></msubsup><mi>t</mi><mi>p</mi><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mi>t</mi><mo fence="true">)</mo></mrow><mi mathvariant="normal">d</mi><mi>t</mi><mi mathvariant="normal">.</mi></mrow><annotation encoding="application/x-tex">v=g(u)\coloneqq\frac1\mu\int_{-\infty}^{F^{-1}(u)}tp\!\left(t\right)\mathrm dt.</annotation></semantics></math></span></span></span></p>
<p>According to the definition of the Gini coefficient, <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mtable rowspacing="0.25em" columnalign="right left" columnspacing="0em"><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mi>G</mi></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mo><mi mathvariant="normal">≔</mi></mo><mn>2</mn><mi>μ</mi><msubsup><mo>∫</mo><mn>0</mn><mn>1</mn></msubsup><mrow><mo fence="true">(</mo><mi>u</mi><mo>−</mo><mi>g</mi><mo stretchy="false">(</mo><mi>u</mi><mo stretchy="false">)</mo><mo fence="true">)</mo></mrow><mi mathvariant="normal">d</mi><mi>u</mi></mrow></mstyle></mtd></mtr><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow/></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mo>=</mo><mi>μ</mi><mo>−</mo><mn>2</mn><mi>μ</mi><msubsup><mo>∫</mo><mn>0</mn><mn>1</mn></msubsup><mi>g</mi><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mi>u</mi><mo fence="true">)</mo></mrow><mi mathvariant="normal">d</mi><mi>u</mi></mrow></mstyle></mtd></mtr><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow/></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mo>=</mo><mi>μ</mi><mo>−</mo><mn>2</mn><msubsup><mo>∫</mo><mrow><mi>u</mi><mo>=</mo><mn>0</mn></mrow><mn>1</mn></msubsup><msubsup><mo>∫</mo><mrow><mi>t</mi><mo>=</mo><mo>−</mo><mi mathvariant="normal">∞</mi></mrow><mrow><msup><mi>F</mi><mrow><mo>−</mo><mn>1</mn></mrow></msup><mo stretchy="false">(</mo><mi>u</mi><mo stretchy="false">)</mo></mrow></msubsup><mi>t</mi><mi>p</mi><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mi>t</mi><mo fence="true">)</mo></mrow><mi mathvariant="normal">d</mi><mi>t</mi><mtext> </mtext><mi mathvariant="normal">d</mi><mi>u</mi><mi mathvariant="normal">.</mi></mrow></mstyle></mtd></mtr></mtable><annotation encoding="application/x-tex">\begin{align*}
G&amp;\coloneqq2\mu\int_0^1\left(u-g(u)\right)\mathrm du\\
&amp;=\mu-2\mu\int_0^1g\!\left(u\right)\mathrm du\\
&amp;=\mu-2\int_{u=0}^1\int_{t=-\infty}^{F^{-1}(u)}tp\!\left(t\right)\mathrm dt\,\mathrm du.
\end{align*}</annotation></semantics></math></span></span></span> Interchange the order of integration, and we have
<span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mtable rowspacing="0.25em" columnalign="right left" columnspacing="0em"><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mi>G</mi></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mo>=</mo><mi>μ</mi><mo>−</mo><mn>2</mn><msubsup><mo>∫</mo><mrow><mi>t</mi><mo>=</mo><mo>−</mo><mi mathvariant="normal">∞</mi></mrow><mrow><mo>+</mo><mi mathvariant="normal">∞</mi></mrow></msubsup><msubsup><mo>∫</mo><mrow><mi>u</mi><mo>=</mo><mi>F</mi><mo stretchy="false">(</mo><mi>t</mi><mo stretchy="false">)</mo></mrow><mn>1</mn></msubsup><mi>t</mi><mi>p</mi><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mi>t</mi><mo fence="true">)</mo></mrow><mi mathvariant="normal">d</mi><mi>t</mi><mtext> </mtext><mi mathvariant="normal">d</mi><mi>u</mi></mrow></mstyle></mtd></mtr><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow/></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mo>=</mo><mi>μ</mi><mo>−</mo><mn>2</mn><msubsup><mo>∫</mo><mrow><mo>−</mo><mi mathvariant="normal">∞</mi></mrow><mrow><mo>+</mo><mi mathvariant="normal">∞</mi></mrow></msubsup><mrow><mo fence="true">(</mo><mn>1</mn><mo>−</mo><mi>F</mi><mo stretchy="false">(</mo><mi>t</mi><mo stretchy="false">)</mo><mo fence="true">)</mo></mrow><mi>t</mi><mi>p</mi><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mi>t</mi><mo fence="true">)</mo></mrow><mi mathvariant="normal">d</mi><mi>t</mi><mi mathvariant="normal">.</mi></mrow></mstyle></mtd></mtr></mtable><annotation encoding="application/x-tex">\begin{align*}
G&amp;=\mu-2\int_{t=-\infty}^{+\infty}\int_{u=F(t)}^1tp\!\left(t\right)\mathrm dt\,\mathrm du\\
&amp;=\mu-2\int_{-\infty}^{+\infty}\left(1-F(t)\right)tp\!\left(t\right)\mathrm dt.
\end{align*}</annotation></semantics></math></span></span></span> Substitute Equation <a href="#eq:eq-def-mu">1</a> into the above equation, and we have <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mtable rowspacing="0.25em" columnalign="right left" columnspacing="0em"><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mi>G</mi></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mo>=</mo><msubsup><mo>∫</mo><mrow><mo>−</mo><mi mathvariant="normal">∞</mi></mrow><mrow><mo>+</mo><mi mathvariant="normal">∞</mi></mrow></msubsup><mn>2</mn><mi>t</mi><mi>F</mi><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mi>t</mi><mo fence="true">)</mo></mrow><mi>p</mi><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mi>t</mi><mo fence="true">)</mo></mrow><mi mathvariant="normal">d</mi><mi>t</mi><mo>−</mo><mi>μ</mi></mrow></mstyle></mtd></mtr><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow/></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mo>=</mo><msubsup><mo>∫</mo><mrow><mo>−</mo><mi mathvariant="normal">∞</mi></mrow><mrow><mo>+</mo><mi mathvariant="normal">∞</mi></mrow></msubsup><mrow><mo fence="true">(</mo><mn>2</mn><mi>t</mi><mi>F</mi><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mi>t</mi><mo fence="true">)</mo></mrow><mo>−</mo><mn>1</mn><mo fence="true">)</mo></mrow><mi>t</mi><mi>p</mi><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mi>t</mi><mo fence="true">)</mo></mrow><mi mathvariant="normal">d</mi><mi>t</mi></mrow></mstyle></mtd></mtr><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow/></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mo>=</mo><msubsup><mo>∫</mo><mn>0</mn><mn>1</mn></msubsup><mrow><mo fence="true">(</mo><mn>2</mn><mi>u</mi><mo>−</mo><mn>1</mn><mo fence="true">)</mo></mrow><msup><mi>F</mi><mrow><mo>−</mo><mn>1</mn></mrow></msup><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mi>u</mi><mo fence="true">)</mo></mrow><mi mathvariant="normal">d</mi><mi>u</mi><mi mathvariant="normal">.</mi></mrow></mstyle></mtd></mtr></mtable><annotation encoding="application/x-tex">\begin{align*}
G&amp;=\int_{-\infty}^{+\infty}2tF\!\left(t\right)p\!\left(t\right)\mathrm dt-\mu\\
&amp;=\int_{-\infty}^{+\infty}\left(2tF\!\left(t\right)-1\right)tp\!\left(t\right)\mathrm dt\\
&amp;=\int_0^1\left(2u-1\right)F^{-1}\!\left(u\right)\mathrm du.
\end{align*}</annotation></semantics></math></span></span></span> Now here is the neat part. Separate it into two parts, and write them in double integrals:
<span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mtable rowspacing="0.25em" columnalign="right left" columnspacing="0em"><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mi>G</mi></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mo>=</mo><msubsup><mo>∫</mo><mn>0</mn><mn>1</mn></msubsup><mi>u</mi><msup><mi>F</mi><mrow><mo>−</mo><mn>1</mn></mrow></msup><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mi>u</mi><mo fence="true">)</mo></mrow><mi mathvariant="normal">d</mi><mi>u</mi><mo>−</mo><msubsup><mo>∫</mo><mn>0</mn><mn>1</mn></msubsup><mrow><mo fence="true">(</mo><mn>1</mn><mo>−</mo><mi>u</mi><mo fence="true">)</mo></mrow><msup><mi>F</mi><mrow><mo>−</mo><mn>1</mn></mrow></msup><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mi>u</mi><mo fence="true">)</mo></mrow><mi mathvariant="normal">d</mi><mi>u</mi></mrow></mstyle></mtd></mtr><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow/></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mo>=</mo><msubsup><mo>∫</mo><mrow><msub><mi>u</mi><mn>2</mn></msub><mo>=</mo><mn>0</mn></mrow><mn>1</mn></msubsup><msubsup><mo>∫</mo><mrow><msub><mi>u</mi><mn>1</mn></msub><mo>=</mo><mn>0</mn></mrow><msub><mi>u</mi><mn>2</mn></msub></msubsup><msup><mi>F</mi><mrow><mo>−</mo><mn>1</mn></mrow></msup><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><msub><mi>u</mi><mn>2</mn></msub><mo fence="true">)</mo></mrow><mi mathvariant="normal">d</mi><msub><mi>u</mi><mn>1</mn></msub><mtext> </mtext><mi mathvariant="normal">d</mi><msub><mi>u</mi><mn>2</mn></msub><mo>−</mo><msubsup><mo>∫</mo><mrow><msub><mi>u</mi><mn>1</mn></msub><mo>=</mo><mn>0</mn></mrow><mn>1</mn></msubsup><msubsup><mo>∫</mo><mrow><msub><mi>u</mi><mn>2</mn></msub><mo>=</mo><msub><mi>u</mi><mn>1</mn></msub></mrow><mn>1</mn></msubsup><msup><mi>F</mi><mrow><mo>−</mo><mn>1</mn></mrow></msup><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><msub><mi>u</mi><mn>1</mn></msub><mo fence="true">)</mo></mrow><mi mathvariant="normal">d</mi><msub><mi>u</mi><mn>1</mn></msub><mtext> </mtext><mi mathvariant="normal">d</mi><msub><mi>u</mi><mn>2</mn></msub><mi mathvariant="normal">.</mi></mrow></mstyle></mtd></mtr></mtable><annotation encoding="application/x-tex">\begin{align*}
G&amp;=\int_0^1uF^{-1}\!\left(u\right)\mathrm du-\int_0^1\left(1-u\right)F^{-1}\!\left(u\right)\mathrm du\\
&amp;=\int_{u_2=0}^1\int_{u_1=0}^{u_2}F^{-1}\!\left(u_2\right)\mathrm du_1\,\mathrm du_2
-\int_{u_1=0}^1\int_{u_2=u_1}^1F^{-1}\!\left(u_1\right)\mathrm du_1\,\mathrm du_2.
\end{align*}</annotation></semantics></math></span></span></span>
Interchange the order of integration of the second term, and we have <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mtable rowspacing="0.25em" columnalign="right left" columnspacing="0em"><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mi>G</mi></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mo>=</mo><msubsup><mo>∫</mo><mrow><msub><mi>u</mi><mn>2</mn></msub><mo>=</mo><mn>0</mn></mrow><mn>1</mn></msubsup><msubsup><mo>∫</mo><mrow><msub><mi>u</mi><mn>1</mn></msub><mo>=</mo><mn>0</mn></mrow><msub><mi>u</mi><mn>2</mn></msub></msubsup><mrow><mo fence="true">(</mo><msup><mi>F</mi><mrow><mo>−</mo><mn>1</mn></mrow></msup><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><msub><mi>u</mi><mn>2</mn></msub><mo fence="true">)</mo></mrow><mo>−</mo><msup><mi>F</mi><mrow><mo>−</mo><mn>1</mn></mrow></msup><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><msub><mi>u</mi><mn>1</mn></msub><mo fence="true">)</mo></mrow><mo fence="true">)</mo></mrow><mi mathvariant="normal">d</mi><msub><mi>u</mi><mn>1</mn></msub><mtext> </mtext><mi mathvariant="normal">d</mi><msub><mi>u</mi><mn>2</mn></msub></mrow></mstyle></mtd></mtr><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow/></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mo>=</mo><mfrac><mn>1</mn><mn>2</mn></mfrac><msubsup><mo>∫</mo><mrow><msub><mi>u</mi><mn>2</mn></msub><mo>=</mo><mn>0</mn></mrow><mn>1</mn></msubsup><msubsup><mo>∫</mo><mrow><msub><mi>u</mi><mn>1</mn></msub><mo>=</mo><mn>0</mn></mrow><mn>1</mn></msubsup><mrow><mo fence="true">∣</mo><msup><mi>F</mi><mrow><mo>−</mo><mn>1</mn></mrow></msup><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><msub><mi>u</mi><mn>2</mn></msub><mo fence="true">)</mo></mrow><mo>−</mo><msup><mi>F</mi><mrow><mo>−</mo><mn>1</mn></mrow></msup><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><msub><mi>u</mi><mn>1</mn></msub><mo fence="true">)</mo></mrow><mo fence="true">∣</mo></mrow><mi mathvariant="normal">d</mi><msub><mi>u</mi><mn>1</mn></msub><mtext> </mtext><mi mathvariant="normal">d</mi><msub><mi>u</mi><mn>2</mn></msub></mrow></mstyle></mtd></mtr><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow/></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mo>=</mo><mfrac><mn>1</mn><mn>2</mn></mfrac><msubsup><mo>∫</mo><mrow><mo>−</mo><mi mathvariant="normal">∞</mi></mrow><mrow><mo>+</mo><mi mathvariant="normal">∞</mi></mrow></msubsup><msubsup><mo>∫</mo><mrow><mo>−</mo><mi mathvariant="normal">∞</mi></mrow><mrow><mo>+</mo><mi mathvariant="normal">∞</mi></mrow></msubsup><mrow><mo fence="true">∣</mo><msub><mi>x</mi><mn>2</mn></msub><mo>−</mo><msub><mi>x</mi><mn>1</mn></msub><mo fence="true">∣</mo></mrow><mi>p</mi><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><msub><mi>x</mi><mn>1</mn></msub><mo fence="true">)</mo></mrow><mi>p</mi><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><msub><mi>x</mi><mn>2</mn></msub><mo fence="true">)</mo></mrow><mi mathvariant="normal">d</mi><msub><mi>x</mi><mn>1</mn></msub><mtext> </mtext><mi mathvariant="normal">d</mi><msub><mi>x</mi><mn>2</mn></msub></mrow></mstyle></mtd></mtr><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow/></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mo>=</mo><mfrac><mn>1</mn><mn>2</mn></mfrac><mi mathvariant="normal">E</mi><mtext> ⁣</mtext><mrow><mo fence="true">[</mo><mrow><mo fence="true">∣</mo><msub><mi>X</mi><mn>2</mn></msub><mo>−</mo><msub><mi>X</mi><mn>1</mn></msub><mo fence="true">∣</mo></mrow><mo fence="true">]</mo></mrow><mo separator="true">,</mo></mrow></mstyle></mtd></mtr></mtable><annotation encoding="application/x-tex">\begin{align*}
G&amp;=\int_{u_2=0}^1\int_{u_1=0}^{u_2}\left(F^{-1}\!\left(u_2\right)-F^{-1}\!\left(u_1\right)\right)\mathrm du_1\,\mathrm du_2\\
&amp;=\frac12\int_{u_2=0}^1\int_{u_1=0}^1\left|F^{-1}\!\left(u_2\right)-F^{-1}\!\left(u_1\right)\right|\mathrm du_1\,\mathrm du_2\\
&amp;=\frac12\int_{-\infty}^{+\infty}\int_{-\infty}^{+\infty}\left|x_2-x_1\right|p\!\left(x_1\right)p\!\left(x_2\right)\mathrm dx_1\,\mathrm dx_2\\
&amp;=\frac12\mathrm E\!\left[\left|X_2-X_1\right|\right],
\end{align*}</annotation></semantics></math></span></span></span>
where <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><msub><mi>X</mi><mn>1</mn></msub></mrow><annotation encoding="application/x-tex">X_1</annotation></semantics></math></span></span> and <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><msub><mi>X</mi><mn>2</mn></msub></mrow><annotation encoding="application/x-tex">X_2</annotation></semantics></math></span></span> are two independent random variables with <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>p</mi></mrow><annotation encoding="application/x-tex">p</annotation></semantics></math></span></span> being their respective distribution functions: <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mrow><mo fence="true">(</mo><msub><mi>X</mi><mn>1</mn></msub><mo separator="true">,</mo><msub><mi>X</mi><mn>2</mn></msub><mo fence="true">)</mo></mrow><mo>∼</mo><mi>p</mi><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><msub><mi>X</mi><mn>1</mn></msub><mo fence="true">)</mo></mrow><mi>p</mi><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><msub><mi>X</mi><mn>2</mn></msub><mo fence="true">)</mo></mrow></mrow><annotation encoding="application/x-tex">\left(X_1,X_2\right)\sim p\!\left(X_1\right)p\!\left(X_2\right)</annotation></semantics></math></span></span>.</p>
<p>By this result, we can easily see how the Gini coefficient represents the statistical dispersion.</p>
<p>We can apply similar tricks to the variance <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><msubsup><mi>σ</mi><mi>X</mi><mn>2</mn></msubsup></mrow><annotation encoding="application/x-tex">\sigma_X^2</annotation></semantics></math></span></span>. <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mtable rowspacing="0.25em" columnalign="right left" columnspacing="0em"><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><msubsup><mi>σ</mi><mi>X</mi><mn>2</mn></msubsup></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mo>=</mo><mi mathvariant="normal">E</mi><mtext> ⁣</mtext><mrow><mo fence="true">[</mo><msup><mi>X</mi><mn>2</mn></msup><mo fence="true">]</mo></mrow><mo>−</mo><mi mathvariant="normal">E</mi><mtext> ⁣</mtext><msup><mrow><mo fence="true">[</mo><mi>X</mi><mo fence="true">]</mo></mrow><mn>2</mn></msup></mrow></mstyle></mtd></mtr><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow/></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mo>=</mo><msubsup><mo>∫</mo><mrow><mo>−</mo><mi mathvariant="normal">∞</mi></mrow><mrow><mo>+</mo><mi mathvariant="normal">∞</mi></mrow></msubsup><msup><mi>t</mi><mn>2</mn></msup><mi>p</mi><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mi>t</mi><mo fence="true">)</mo></mrow><mi mathvariant="normal">d</mi><mi>t</mi><mo>−</mo><msup><mrow><mo fence="true">(</mo><msubsup><mo>∫</mo><mrow><mo>−</mo><mi mathvariant="normal">∞</mi></mrow><mrow><mo>+</mo><mi mathvariant="normal">∞</mi></mrow></msubsup><mi>t</mi><mi>p</mi><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mi>t</mi><mo fence="true">)</mo></mrow><mi mathvariant="normal">d</mi><mi>t</mi><mo fence="true">)</mo></mrow><mn>2</mn></msup></mrow></mstyle></mtd></mtr><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow/></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mo>=</mo><msubsup><mo>∫</mo><mn>0</mn><mn>1</mn></msubsup><msup><mi>F</mi><mrow><mo>−</mo><mn>1</mn></mrow></msup><mtext> ⁣</mtext><msup><mrow><mo fence="true">(</mo><mi>u</mi><mo fence="true">)</mo></mrow><mn>2</mn></msup><mtext> </mtext><mi mathvariant="normal">d</mi><mi>u</mi><mo>−</mo><msup><mrow><mo fence="true">(</mo><msubsup><mo>∫</mo><mn>0</mn><mn>1</mn></msubsup><msup><mi>F</mi><mrow><mo>−</mo><mn>1</mn></mrow></msup><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mi>u</mi><mo fence="true">)</mo></mrow><mi mathvariant="normal">d</mi><mi>u</mi><mo fence="true">)</mo></mrow><mn>2</mn></msup><mi mathvariant="normal">.</mi></mrow></mstyle></mtd></mtr></mtable><annotation encoding="application/x-tex">\begin{align*}
\sigma_X^2&amp;=\mathrm E\!\left[X^2\right]-\mathrm E\!\left[X\right]^2\\
&amp;=\int_{-\infty}^{+\infty}t^2p\!\left(t\right)\mathrm dt
-\left(\int_{-\infty}^{+\infty}tp\!\left(t\right)\mathrm dt\right)^2\\
&amp;=\int_0^1F^{-1}\!\left(u\right)^2\,\mathrm du
-\left(\int_0^1F^{-1}\!\left(u\right)\mathrm du\right)^2.
\end{align*}</annotation></semantics></math></span></span></span>
Separate the first into two halves, and write the altogether three terms in double integrals: <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mtable rowspacing="0.25em" columnalign="right left" columnspacing="0em"><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><msubsup><mi>σ</mi><mi>X</mi><mn>2</mn></msubsup></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mo>=</mo><mfrac><mn>1</mn><mn>2</mn></mfrac><msubsup><mo>∫</mo><mn>0</mn><mn>1</mn></msubsup><msup><mi>F</mi><mrow><mo>−</mo><mn>1</mn></mrow></msup><mtext> ⁣</mtext><msup><mrow><mo fence="true">(</mo><msub><mi>u</mi><mn>2</mn></msub><mo fence="true">)</mo></mrow><mn>2</mn></msup><mtext> </mtext><mi mathvariant="normal">d</mi><msub><mi>u</mi><mn>2</mn></msub><msubsup><mo>∫</mo><mn>0</mn><mn>1</mn></msubsup><mi mathvariant="normal">d</mi><msub><mi>u</mi><mn>1</mn></msub></mrow></mstyle></mtd></mtr><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow/></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mphantom><mo>=</mo><mtext> </mtext></mphantom><mrow/><mo>−</mo><msubsup><mo>∫</mo><mn>0</mn><mn>1</mn></msubsup><msup><mi>F</mi><mrow><mo>−</mo><mn>1</mn></mrow></msup><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><msub><mi>u</mi><mn>1</mn></msub><mo fence="true">)</mo></mrow><mi mathvariant="normal">d</mi><msub><mi>u</mi><mn>1</mn></msub><msubsup><mo>∫</mo><mn>0</mn><mn>1</mn></msubsup><msup><mi>F</mi><mrow><mo>−</mo><mn>1</mn></mrow></msup><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><msub><mi>u</mi><mn>2</mn></msub><mo fence="true">)</mo></mrow><mi mathvariant="normal">d</mi><msub><mi>u</mi><mn>2</mn></msub></mrow></mstyle></mtd></mtr><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow/></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mphantom><mo>=</mo><mtext> </mtext></mphantom><mrow/><mo>+</mo><mfrac><mn>1</mn><mn>2</mn></mfrac><msubsup><mo>∫</mo><mn>0</mn><mn>1</mn></msubsup><msup><mi>F</mi><mrow><mo>−</mo><mn>1</mn></mrow></msup><mtext> ⁣</mtext><msup><mrow><mo fence="true">(</mo><msub><mi>u</mi><mn>1</mn></msub><mo fence="true">)</mo></mrow><mn>2</mn></msup><mtext> </mtext><mi mathvariant="normal">d</mi><msub><mi>u</mi><mn>1</mn></msub><msubsup><mo>∫</mo><mn>0</mn><mn>1</mn></msubsup><mi mathvariant="normal">d</mi><msub><mi>u</mi><mn>2</mn></msub></mrow></mstyle></mtd></mtr><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow/></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mo>=</mo><mfrac><mn>1</mn><mn>2</mn></mfrac><msubsup><mo>∫</mo><mn>0</mn><mn>1</mn></msubsup><msubsup><mo>∫</mo><mn>0</mn><mn>1</mn></msubsup><mrow><mo fence="true">(</mo><msup><mi>F</mi><mrow><mo>−</mo><mn>1</mn></mrow></msup><mtext> ⁣</mtext><msup><mrow><mo fence="true">(</mo><msub><mi>u</mi><mn>2</mn></msub><mo fence="true">)</mo></mrow><mn>2</mn></msup><mo>−</mo><mn>2</mn><msup><mi>F</mi><mrow><mo>−</mo><mn>1</mn></mrow></msup><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><msub><mi>u</mi><mn>1</mn></msub><mo fence="true">)</mo></mrow><msup><mi>F</mi><mrow><mo>−</mo><mn>1</mn></mrow></msup><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><msub><mi>u</mi><mn>2</mn></msub><mo fence="true">)</mo></mrow><mo>+</mo><msup><mi>F</mi><mrow><mo>−</mo><mn>1</mn></mrow></msup><mtext> ⁣</mtext><msup><mrow><mo fence="true">(</mo><msub><mi>u</mi><mn>1</mn></msub><mo fence="true">)</mo></mrow><mn>2</mn></msup><mo fence="true">)</mo></mrow><mi mathvariant="normal">d</mi><msub><mi>u</mi><mn>1</mn></msub><mtext> </mtext><mi mathvariant="normal">d</mi><msub><mi>u</mi><mn>2</mn></msub></mrow></mstyle></mtd></mtr><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow/></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mo>=</mo><mfrac><mn>1</mn><mn>2</mn></mfrac><msubsup><mo>∫</mo><mrow><mo>−</mo><mi mathvariant="normal">∞</mi></mrow><mrow><mo>+</mo><mi mathvariant="normal">∞</mi></mrow></msubsup><msubsup><mo>∫</mo><mrow><mo>−</mo><mi mathvariant="normal">∞</mi></mrow><mrow><mo>+</mo><mi mathvariant="normal">∞</mi></mrow></msubsup><msup><mrow><mo fence="true">(</mo><msub><mi>x</mi><mn>2</mn></msub><mo>−</mo><msub><mi>x</mi><mn>1</mn></msub><mo fence="true">)</mo></mrow><mn>2</mn></msup><mi>p</mi><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><msub><mi>x</mi><mn>1</mn></msub><mo fence="true">)</mo></mrow><mi>p</mi><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><msub><mi>x</mi><mn>2</mn></msub><mo fence="true">)</mo></mrow><mi mathvariant="normal">d</mi><msub><mi>x</mi><mn>1</mn></msub><mtext> </mtext><mi mathvariant="normal">d</mi><msub><mi>x</mi><mn>2</mn></msub></mrow></mstyle></mtd></mtr><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow/></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mo>=</mo><mfrac><mn>1</mn><mn>2</mn></mfrac><mi mathvariant="normal">E</mi><mtext> ⁣</mtext><mrow><mo fence="true">[</mo><msup><mrow><mo fence="true">(</mo><msub><mi>X</mi><mn>2</mn></msub><mo>−</mo><msub><mi>X</mi><mn>1</mn></msub><mo fence="true">)</mo></mrow><mn>2</mn></msup><mo fence="true">]</mo></mrow><mi mathvariant="normal">.</mi></mrow></mstyle></mtd></mtr></mtable><annotation encoding="application/x-tex">\begin{align*}
\sigma_X^2&amp;=\frac12\int_0^1F^{-1}\!\left(u_2\right)^2\,\mathrm du_2\int_0^1\mathrm du_1\\
&amp;\phantom{=~}{}-\int_0^1F^{-1}\!\left(u_1\right)\mathrm du_1\int_0^1F^{-1}\!\left(u_2\right)\mathrm du_2\\
&amp;\phantom{=~}{}+\frac12\int_0^1F^{-1}\!\left(u_1\right)^2\,\mathrm du_1\int_0^1\mathrm du_2\\
&amp;=\frac12\int_0^1\int_0^1
\left(F^{-1}\!\left(u_2\right)^2-2F^{-1}\!\left(u_1\right)F^{-1}\!\left(u_2\right)+F^{-1}\!\left(u_1\right)^2\right)
\mathrm du_1\,\mathrm du_2\\
&amp;=\frac12\int_{-\infty}^{+\infty}\int_{-\infty}^{+\infty}
\left(x_2-x_1\right)^2p\!\left(x_1\right)p\!\left(x_2\right)\mathrm dx_1\,\mathrm dx_2\\
&amp;=\frac12\mathrm E\!\left[\left(X_2-X_1\right)^2\right].
\end{align*}</annotation></semantics></math></span></span></span>
Then we can derive the relationship between the Gini coefficient and the variance: <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mn>2</mn><msubsup><mi>σ</mi><mi>X</mi><mn>2</mn></msubsup><mo>−</mo><mn>4</mn><msup><mi>G</mi><mn>2</mn></msup><mo>=</mo><msubsup><mi>σ</mi><mrow><mo fence="true">∣</mo><msub><mi>X</mi><mn>2</mn></msub><mo>−</mo><msub><mi>X</mi><mn>2</mn></msub><mo fence="true">∣</mo></mrow><mn>2</mn></msubsup><mi mathvariant="normal">.</mi></mrow><annotation encoding="application/x-tex">2\sigma_X^2-4G^2=\sigma_{\left|X_2-X_2\right|}^2.</annotation></semantics></math></span></span></span></p>]]></content><author><name>UlyssesZhan</name><email>ulysseszhan@gmail.com</email></author><category term="economics" /><category term="from zhihu" /><category term="calculus" /><category term="probability" /><summary type="html"><![CDATA[Both the Gini coefficient and the variance are measures of statistical dispersion. We are then motivated to find the relationship between them. It turns out that there is a neat mathematical relationship between them.]]></summary><media:thumbnail xmlns:media="http://search.yahoo.com/mrss/" url="https://ulysseszh.github.io/assets/images/covers/2023-02-06-gini-variance.png" /><media:content medium="image" url="https://ulysseszh.github.io/assets/images/covers/2023-02-06-gini-variance.png" xmlns:media="http://search.yahoo.com/mrss/" /></entry><entry><title type="html"><![CDATA[Defend our earth against aliens’ bullets!]]></title><link href="https://ulysseszh.github.io/physics/2023/02/01/defend-aliens.html" rel="alternate" type="text/html" title="Defend our earth against aliens’ bullets!" /><published>2023-02-01T11:11:11-08:00</published><updated>2023-02-01T11:11:11-08:00</updated><id>https://ulysseszh.github.io/physics/2023/02/01/defend-aliens</id><content type="html" xml:base="https://ulysseszh.github.io/physics/2023/02/01/defend-aliens.html"><![CDATA[<p>
  <em>This article solves the first part of the problem proposed in a Chinese <a href="https://zhuanlan.zhihu.com/p/206771750" target="_blank" rel="external">article</a> on my Zhihu account. The original article was posted at 2020-08-30 18:27 +0800.</em>
</p>
<hr/>
<p>The aliens intiated their attack to the earth! They shoot bullets with mass <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>m</mi></mrow><annotation encoding="application/x-tex">m</annotation></semantics></math></span></span> and speed <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>v</mi></mrow><annotation encoding="application/x-tex">v</annotation></semantics></math></span></span> from a far-awar planet. To defend, humans built a field <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>U</mi><mo>=</mo><mi>α</mi><mi mathvariant="normal">/</mi><mi>r</mi></mrow><annotation encoding="application/x-tex">U=\alpha/r</annotation></semantics></math></span></span> that can repel the bullets. What regions are safe?</p>
<hr/>
<p>Every possible trajectory of the bullet is parameterized by <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>b</mi></mrow><annotation encoding="application/x-tex">b</annotation></semantics></math></span></span>, the impact parameter. The bullet has energy <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>E</mi><mo>=</mo><mfrac><mn>1</mn><mn>2</mn></mfrac><mi>m</mi><msup><mi>v</mi><mn>2</mn></msup></mrow><annotation encoding="application/x-tex">E=\frac12mv^2</annotation></semantics></math></span></span> and angular momentum <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>M</mi><mo>=</mo><mi>m</mi><mi>v</mi><mi>b</mi></mrow><annotation encoding="application/x-tex">M=mvb</annotation></semantics></math></span></span>, which are conserved. According to the well-known results of Kepler problem, the trajectory is a hyperbola <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mo>−</mo><mfrac><mi>p</mi><mi>r</mi></mfrac><mo>=</mo><mn>1</mn><mo>+</mo><mi>e</mi><mi>cos</mi><mo>⁡</mo><mi>φ</mi><mo separator="true">,</mo></mrow><annotation encoding="application/x-tex">-\frac pr=1+e\cos\varphi,</annotation></semantics></math></span></span></span> where
<span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mi>p</mi><mo><mi mathvariant="normal">≔</mi></mo><mfrac><msup><mi>M</mi><mn>2</mn></msup><mrow><mi>m</mi><mi>α</mi></mrow></mfrac><mo separator="true">,</mo><mspace width="1em"/><mi>e</mi><mo><mi mathvariant="normal">≔</mi></mo><msqrt><mrow><mn>1</mn><mo>+</mo><mfrac><mrow><mn>2</mn><mi>E</mi><msup><mi>M</mi><mn>2</mn></msup></mrow><mrow><mi>m</mi><msup><mi>α</mi><mn>2</mn></msup></mrow></mfrac></mrow></msqrt><mi mathvariant="normal">.</mi></mrow><annotation encoding="application/x-tex">p\coloneqq\frac{M^2}{m\alpha},\quad e\coloneqq\sqrt{1+\frac{2EM^2}{m\alpha^2}}.</annotation></semantics></math></span></span></span> For convenience, denote the radius of the hyperbola as <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mi>a</mi><mo><mi mathvariant="normal">≔</mi></mo><mfrac><mi>α</mi><mrow><mn>2</mn><mi>E</mi></mrow></mfrac><mo separator="true">,</mo></mrow><annotation encoding="application/x-tex">a\coloneqq\frac\alpha{2E},</annotation></semantics></math></span></span></span> then we can write the equation of the trajectory as <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mo>−</mo><mfrac><msup><mi>b</mi><mn>2</mn></msup><mrow><mi>a</mi><mi>r</mi></mrow></mfrac><mo>=</mo><mn>1</mn><mo>+</mo><msqrt><mrow><mn>1</mn><mo>+</mo><mfrac><msup><mi>b</mi><mn>2</mn></msup><msup><mi>a</mi><mn>2</mn></msup></mfrac></mrow></msqrt><mi>cos</mi><mo>⁡</mo><mi>φ</mi><mi mathvariant="normal">.</mi></mrow><annotation encoding="application/x-tex">-\frac{b^2}{ar}=1+\sqrt{1+\frac{b^2}{a^2}}\cos\varphi.</annotation></semantics></math></span></span></span> Rotate the trajectory so that the incident direction is always towards the positive <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>x</mi></mrow><annotation encoding="application/x-tex">x</annotation></semantics></math></span></span> direction: <span id="eq:eq-trajectory" data-label="(1)"><span class="katex-display-table"> <span class="katex-display-numbered"><span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mn>0</mn><mo>=</mo><mi>F</mi><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mi>r</mi><mo separator="true">,</mo><mi>φ</mi><mo separator="true">,</mo><mi>b</mi><mo fence="true">)</mo></mrow><mo><mi mathvariant="normal">≔</mi></mo><mfrac><msup><mi>b</mi><mn>2</mn></msup><mrow><mi>a</mi><mi>r</mi></mrow></mfrac><mo>+</mo><mn>1</mn><mo>+</mo><mi>cos</mi><mo>⁡</mo><mi>φ</mi><mo>+</mo><mfrac><mi>b</mi><mi>a</mi></mfrac><mi>sin</mi><mo>⁡</mo><mi>φ</mi><mi mathvariant="normal">.</mi></mrow><annotation encoding="application/x-tex">0=F\!\left(r,\varphi,b\right)\coloneqq\frac{b^2}{ar}+1+\cos\varphi+\frac ba\sin\varphi.</annotation></semantics></math></span></span></span></span> <span class="katex-display-number"><span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mo stretchy="false">(</mo><mn>1</mn><mo stretchy="false">)</mo></mrow><annotation encoding="application/x-tex">(1)</annotation></semantics></math></span></span></span></span> </span></span> To find the envelope of the family of trajectories, solve
<span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mn>0</mn><mo>=</mo><mfrac><mrow><mi mathvariant="normal">∂</mi><mi>F</mi></mrow><mrow><mi mathvariant="normal">∂</mi><mi>b</mi></mrow></mfrac><mo>=</mo><mfrac><mrow><mn>2</mn><mi>b</mi></mrow><mrow><mi>a</mi><mi>r</mi></mrow></mfrac><mo>+</mo><mi>a</mi><mi>sin</mi><mo>⁡</mo><mi>φ</mi><mo separator="true">,</mo></mrow><annotation encoding="application/x-tex">0=\frac{\partial F}{\partial b}=\frac{2b}{ar}+a\sin\varphi,</annotation></semantics></math></span></span></span> and we have <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mi>b</mi><mo>=</mo><mo>−</mo><mfrac><mn>1</mn><mn>2</mn></mfrac><mi>r</mi><mi>sin</mi><mo>⁡</mo><mi>φ</mi><mi mathvariant="normal">.</mi></mrow><annotation encoding="application/x-tex">b=-\frac12r\sin\varphi.</annotation></semantics></math></span></span></span> Substitute back into Equation <a href="#eq:eq-trajectory">1</a>, and we have finally the equation of the envelope: <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mfrac><mrow><mn>4</mn><mi>a</mi></mrow><mi>r</mi></mfrac><mo>=</mo><mn>1</mn><mo>−</mo><mi>cos</mi><mo>⁡</mo><mi>φ</mi><mo separator="true">,</mo></mrow><annotation encoding="application/x-tex">\frac{4a}r=1-\cos\varphi,</annotation></semantics></math></span></span></span> which is a parabola with the the semi-latus rectum being <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mn>4</mn><mi>a</mi></mrow><annotation encoding="application/x-tex">4a</annotation></semantics></math></span></span>. Therefore, the safe regions are the interior of a circular paraboloid.</p>]]></content><author><name>UlyssesZhan</name><email>ulysseszhan@gmail.com</email></author><category term="physics" /><category term="calculus" /><category term="classical mechanics" /><category term="kepler problem" /><category term="from zhihu" /><summary type="html"><![CDATA[The aliens intiated their attack to the earth! They shoot bullets with mass <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>m</mi></mrow><annotation encoding="application/x-tex">m</annotation></semantics></math></span></span> and speed <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>v</mi></mrow><annotation encoding="application/x-tex">v</annotation></semantics></math></span></span> from a far-awar planet. To defend, humans built a field <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>U</mi><mo>=</mo><mi>α</mi><mi mathvariant="normal">/</mi><mi>r</mi></mrow><annotation encoding="application/x-tex">U=\alpha/r</annotation></semantics></math></span></span> that can repel the bullets. What regions are safe? The answer turns out to be the interior of a circular paraboloid.]]></summary><media:thumbnail xmlns:media="http://search.yahoo.com/mrss/" url="https://ulysseszh.github.io/assets/images/covers/2023-02-01-defend-aliens.png" /><media:content medium="image" url="https://ulysseszh.github.io/assets/images/covers/2023-02-01-defend-aliens.png" xmlns:media="http://search.yahoo.com/mrss/" /></entry><entry><title type="html"><![CDATA[This is what will happen after you get a haircut]]></title><link href="https://ulysseszh.github.io/math/2023/01/18/hair-growth.html" rel="alternate" type="text/html" title="This is what will happen after you get a haircut" /><published>2023-01-18T12:11:41-08:00</published><updated>2023-01-18T12:11:41-08:00</updated><id>https://ulysseszh.github.io/math/2023/01/18/hair-growth</id><content type="html" xml:base="https://ulysseszh.github.io/math/2023/01/18/hair-growth.html"><![CDATA[<p>Denote the length distribution of one’s hair to be <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>f</mi><mo stretchy="false">(</mo><mi>l</mi><mo separator="true">,</mo><mi>t</mi><mo stretchy="false">)</mo></mrow><annotation encoding="application/x-tex">f(l,t)</annotation></semantics></math></span></span>. This means that, at time <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>t</mi></mrow><annotation encoding="application/x-tex">t</annotation></semantics></math></span></span>, the number of hairs within the length range from <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>l</mi></mrow><annotation encoding="application/x-tex">l</annotation></semantics></math></span></span> to <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>l</mi><mo>+</mo><mi mathvariant="normal">d</mi><mi>l</mi></mrow><annotation encoding="application/x-tex">l+\mathrm dl</annotation></semantics></math></span></span> is <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>N</mi><mi>f</mi><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mi>l</mi><mo separator="true">,</mo><mi>t</mi><mo fence="true">)</mo></mrow><mi mathvariant="normal">d</mi><mi>l</mi></mrow><annotation encoding="application/x-tex">Nf\!\left(l,t\right)\mathrm dl</annotation></semantics></math></span></span>, where <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>N</mi></mrow><annotation encoding="application/x-tex">N</annotation></semantics></math></span></span> is the total number of hairs.</p>
<p>Each hair grows at constant speed <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>v</mi></mrow><annotation encoding="application/x-tex">v</annotation></semantics></math></span></span>. However, they cannot grow indefinitely because there is a probability of <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>λ</mi></mrow><annotation encoding="application/x-tex">\lambda</annotation></semantics></math></span></span> per unit time for a hair to be lost naturally (this is the same assumption as the exponential decay). After a hair is lost, it restarts growing from zero length.</p>
<p>Suppose that at <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>t</mi><mo>=</mo><mn>0</mn></mrow><annotation encoding="application/x-tex">t=0</annotation></semantics></math></span></span> you have got a haircut so that the hair length distribution becomes <span id="eq:eq-initial-condition" data-label="(1)"><span class="katex-display-table"> <span class="katex-display-numbered"><span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mi>f</mi><mo stretchy="false">(</mo><mi>l</mi><mo separator="true">,</mo><mn>0</mn><mo stretchy="false">)</mo><mo>=</mo><msub><mi>f</mi><mn>0</mn></msub><mo stretchy="false">(</mo><mi>l</mi><mo stretchy="false">)</mo><mi mathvariant="normal">.</mi></mrow><annotation encoding="application/x-tex">f(l,0)=f_0(l).</annotation></semantics></math></span></span></span></span> <span class="katex-display-number"><span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mo stretchy="false">(</mo><mn>1</mn><mo stretchy="false">)</mo></mrow><annotation encoding="application/x-tex">(1)</annotation></semantics></math></span></span></span></span> </span></span> Then, how does the distribution evolve with time?</p>
<hr/>
<p>Because <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>f</mi></mrow><annotation encoding="application/x-tex">f</annotation></semantics></math></span></span> is a distribution function, There is a normalization restriction on <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>f</mi></mrow><annotation encoding="application/x-tex">f</annotation></semantics></math></span></span>: <span id="eq:eq-normalization" data-label="(2)"><span class="katex-display-table"> <span class="katex-display-numbered"><span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><msubsup><mo>∫</mo><mn>0</mn><mi mathvariant="normal">∞</mi></msubsup><mi>f</mi><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mi>l</mi><mo separator="true">,</mo><mi>t</mi><mo fence="true">)</mo></mrow><mi mathvariant="normal">d</mi><mi>l</mi><mo>=</mo><mn>1</mn><mo separator="true">,</mo><mspace width="1em"/><mi>t</mi><mo>≥</mo><mn>0.</mn></mrow><annotation encoding="application/x-tex">\int_0^\infty f\!\left(l,t\right)\mathrm dl=1,\quad t\ge0.</annotation></semantics></math></span></span></span></span> <span class="katex-display-number"><span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mo stretchy="false">(</mo><mn>2</mn><mo stretchy="false">)</mo></mrow><annotation encoding="application/x-tex">(2)</annotation></semantics></math></span></span></span></span> </span></span> This normalization condition also applies to the initial condition (<span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>t</mi><mo>=</mo><mn>0</mn></mrow><annotation encoding="application/x-tex">t=0</annotation></semantics></math></span></span>). This means that the function <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><msub><mi>f</mi><mn>0</mn></msub></mrow><annotation encoding="application/x-tex">f_0</annotation></semantics></math></span></span> also satisfies the normalization restriction (Equation <a href="#eq:eq-normalization">2</a>) <span id="eq:eq-normalization-f0" data-label="(3)"><span class="katex-display-table"> <span class="katex-display-numbered"><span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><msubsup><mo>∫</mo><mn>0</mn><mi mathvariant="normal">∞</mi></msubsup><msub><mi>f</mi><mn>0</mn></msub><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mi>l</mi><mo fence="true">)</mo></mrow><mi mathvariant="normal">d</mi><mi>l</mi><mo>=</mo><mn>1.</mn></mrow><annotation encoding="application/x-tex">\int_0^\infty f_0\!\left(l\right)\mathrm dl=1.</annotation></semantics></math></span></span></span></span> <span class="katex-display-number"><span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mo stretchy="false">(</mo><mn>3</mn><mo stretchy="false">)</mo></mrow><annotation encoding="application/x-tex">(3)</annotation></semantics></math></span></span></span></span> </span></span> Because of the natural loss of hair, only a <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mn>1</mn><mo>−</mo><mi>λ</mi><mtext> </mtext><mi mathvariant="normal">d</mi><mi>t</mi></mrow><annotation encoding="application/x-tex">1-\lambda\,\mathrm dt</annotation></semantics></math></span></span> portion of hair will survive <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi mathvariant="normal">d</mi><mi>t</mi></mrow><annotation encoding="application/x-tex">\mathrm dt</annotation></semantics></math></span></span>. According to this, we can construct the following equation: <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mi>f</mi><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mi>l</mi><mo>+</mo><mi>v</mi><mtext> </mtext><mi mathvariant="normal">d</mi><mi>t</mi><mo separator="true">,</mo><mi>t</mi><mo>+</mo><mi mathvariant="normal">d</mi><mi>t</mi><mo fence="true">)</mo></mrow><mo>=</mo><mrow><mo fence="true">(</mo><mn>1</mn><mo>−</mo><mi>λ</mi><mtext> </mtext><mi mathvariant="normal">d</mi><mi>t</mi><mo fence="true">)</mo></mrow><mi>f</mi><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mi>l</mi><mo separator="true">,</mo><mi>t</mi><mo fence="true">)</mo></mrow><mi mathvariant="normal">.</mi></mrow><annotation encoding="application/x-tex">f\!\left(l+v\,\mathrm dt,t+\mathrm dt\right)=
\left(1-\lambda\,\mathrm dt\right)f\!\left(l,t\right).</annotation></semantics></math></span></span></span> This equation can be reduced to a first-order linear PDE: <span id="eq:eq-pde" data-label="(4)"><span class="katex-display-table"> <span class="katex-display-numbered"><span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mi>v</mi><mfrac><mrow><mi mathvariant="normal">∂</mi><mi>f</mi></mrow><mrow><mi mathvariant="normal">∂</mi><mi>l</mi></mrow></mfrac><mo>+</mo><mfrac><mrow><mi mathvariant="normal">∂</mi><mi>f</mi></mrow><mrow><mi mathvariant="normal">∂</mi><mi>t</mi></mrow></mfrac><mo>+</mo><mi>λ</mi><mi>f</mi><mo>=</mo><mn>0.</mn></mrow><annotation encoding="application/x-tex">v\frac{\partial f}{\partial l}+\frac{\partial f}{\partial t}+\lambda f=0.</annotation></semantics></math></span></span></span></span> <span class="katex-display-number"><span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mo stretchy="false">(</mo><mn>4</mn><mo stretchy="false">)</mo></mrow><annotation encoding="application/x-tex">(4)</annotation></semantics></math></span></span></span></span> </span></span></p>
<p>Define <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>θ</mi><mo><mi mathvariant="normal">≔</mi></mo><mi>l</mi><mo>−</mo><mi>v</mi><mi>t</mi></mrow><annotation encoding="application/x-tex">\theta\coloneqq l-vt</annotation></semantics></math></span></span>, and define a new function <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mi>g</mi><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mi>θ</mi><mo separator="true">,</mo><mi>t</mi><mo fence="true">)</mo></mrow><mo><mi mathvariant="normal">≔</mi></mo><mi>f</mi><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mi>θ</mi><mo>+</mo><mi>v</mi><mi>t</mi><mo separator="true">,</mo><mi>t</mi><mo fence="true">)</mo></mrow><mi mathvariant="normal">.</mi></mrow><annotation encoding="application/x-tex">g\!\left(\theta,t\right)\coloneqq f\!\left(\theta+vt,t\right).</annotation></semantics></math></span></span></span> Then, <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mfrac><mrow><mi mathvariant="normal">∂</mi><mi>g</mi></mrow><mrow><mi mathvariant="normal">∂</mi><mi>t</mi></mrow></mfrac><mo>=</mo><mi>v</mi><mfrac><mrow><mi mathvariant="normal">∂</mi><mi>f</mi></mrow><mrow><mi mathvariant="normal">∂</mi><mi>l</mi></mrow></mfrac><mo>+</mo><mfrac><mrow><mi mathvariant="normal">∂</mi><mi>f</mi></mrow><mrow><mi mathvariant="normal">∂</mi><mi>t</mi></mrow></mfrac><mi mathvariant="normal">.</mi></mrow><annotation encoding="application/x-tex">\frac{\partial g}{\partial t}=v\frac{\partial f}{\partial l}+\frac{\partial f}{\partial t}.</annotation></semantics></math></span></span></span> Then, Equation <a href="#eq:eq-pde">4</a> can be reduced to
<span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mfrac><mrow><mi mathvariant="normal">∂</mi><mi>g</mi></mrow><mrow><mi mathvariant="normal">∂</mi><mi>t</mi></mrow></mfrac><mo>+</mo><mi>λ</mi><mi>g</mi><mo>=</mo><mn>0.</mn></mrow><annotation encoding="application/x-tex">\frac{\partial g}{\partial t}+\lambda g=0.</annotation></semantics></math></span></span></span> The solution is <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mi>g</mi><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mi>θ</mi><mo separator="true">,</mo><mi>t</mi><mo fence="true">)</mo></mrow><mo>=</mo><mi mathvariant="normal">Φ</mi><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mi>θ</mi><mo fence="true">)</mo></mrow><msup><mi mathvariant="normal">e</mi><mrow><mo>−</mo><mi>λ</mi><mi>t</mi></mrow></msup><mo separator="true">,</mo></mrow><annotation encoding="application/x-tex">g\!\left(\theta,t\right)=\Phi\!\left(\theta\right)\mathrm e^{-\lambda t},</annotation></semantics></math></span></span></span> where <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi mathvariant="normal">Φ</mi></mrow><annotation encoding="application/x-tex">\Phi</annotation></semantics></math></span></span> is an arbitrary function defined on <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi mathvariant="double-struck">R</mi></mrow><annotation encoding="application/x-tex">\mathbb R</annotation></semantics></math></span></span>. Therefore, the general solution to Equation <a href="#eq:eq-pde">4</a> is <span id="eq:eq-general-solution" data-label="(5)"><span class="katex-display-table"> <span class="katex-display-numbered"><span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mi>f</mi><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mi>l</mi><mo separator="true">,</mo><mi>t</mi><mo fence="true">)</mo></mrow><mo>=</mo><mi mathvariant="normal">Φ</mi><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mi>l</mi><mo>−</mo><mi>v</mi><mi>t</mi><mo fence="true">)</mo></mrow><msup><mi mathvariant="normal">e</mi><mrow><mo>−</mo><mi>λ</mi><mi>t</mi></mrow></msup><mi mathvariant="normal">.</mi></mrow><annotation encoding="application/x-tex">f\!\left(l,t\right)=\Phi\!\left(l-vt\right)\mathrm e^{-\lambda t}.</annotation></semantics></math></span></span></span></span> <span class="katex-display-number"><span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mo stretchy="false">(</mo><mn>5</mn><mo stretchy="false">)</mo></mrow><annotation encoding="application/x-tex">(5)</annotation></semantics></math></span></span></span></span> </span></span></p>
<p>By utilizing Equation <a href="#eq:eq-initial-condition">1</a>, we can find <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi mathvariant="normal">Φ</mi><mo stretchy="false">(</mo><mi>θ</mi><mo stretchy="false">)</mo></mrow><annotation encoding="application/x-tex">\Phi(\theta)</annotation></semantics></math></span></span> for <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>θ</mi><mo>&gt;</mo><mn>0</mn></mrow><annotation encoding="application/x-tex">\theta&gt;0</annotation></semantics></math></span></span>. Substitute <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>t</mi><mo>=</mo><mn>0</mn></mrow><annotation encoding="application/x-tex">t=0</annotation></semantics></math></span></span> into Equation <a href="#eq:eq-general-solution">5</a> and compare with Equation <a href="#eq:eq-initial-condition">1</a>, and we have <span id="eq:eq-Phi-theta-0" data-label="(6)"><span class="katex-display-table"> <span class="katex-display-numbered"><span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mi mathvariant="normal">Φ</mi><mo stretchy="false">(</mo><mi>θ</mi><mo>&gt;</mo><mn>0</mn><mo stretchy="false">)</mo><mo>=</mo><msub><mi>f</mi><mn>0</mn></msub><mo stretchy="false">(</mo><mi>θ</mi><mo stretchy="false">)</mo><mi mathvariant="normal">.</mi></mrow><annotation encoding="application/x-tex">\Phi(\theta&gt;0)=f_0(\theta).</annotation></semantics></math></span></span></span></span> <span class="katex-display-number"><span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mo stretchy="false">(</mo><mn>6</mn><mo stretchy="false">)</mo></mrow><annotation encoding="application/x-tex">(6)</annotation></semantics></math></span></span></span></span> </span></span> This only gives <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi mathvariant="normal">Φ</mi><mo stretchy="false">(</mo><mi>θ</mi><mo stretchy="false">)</mo></mrow><annotation encoding="application/x-tex">\Phi(\theta)</annotation></semantics></math></span></span> for <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>θ</mi><mo>&gt;</mo><mn>0</mn></mrow><annotation encoding="application/x-tex">\theta&gt;0</annotation></semantics></math></span></span> because <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><msub><mi>f</mi><mn>0</mn></msub></mrow><annotation encoding="application/x-tex">f_0</annotation></semantics></math></span></span> is not defined on negative numbers. The rest of <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi mathvariant="normal">Φ</mi></mrow><annotation encoding="application/x-tex">\Phi</annotation></semantics></math></span></span>, however, may be deduced from Equation <a href="#eq:eq-normalization">2</a>.</p>
<p>Substitute Equation <a href="#eq:eq-general-solution">5</a> into Equation <a href="#eq:eq-normalization">2</a>, and we have <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mtable rowspacing="0.25em" columnalign="right left" columnspacing="0em"><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mn>1</mn></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mo>=</mo><msubsup><mo>∫</mo><mn>0</mn><mi mathvariant="normal">∞</mi></msubsup><mi mathvariant="normal">Φ</mi><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mi>l</mi><mo>−</mo><mi>v</mi><mi>t</mi><mo fence="true">)</mo></mrow><msup><mi mathvariant="normal">e</mi><mrow><mo>−</mo><mi>λ</mi><mi>t</mi></mrow></msup><mtext> </mtext><mi mathvariant="normal">d</mi><mi>l</mi></mrow></mstyle></mtd></mtr><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow/></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mo>=</mo><msup><mi mathvariant="normal">e</mi><mrow><mo>−</mo><mi>λ</mi><mi>t</mi></mrow></msup><mrow><mo fence="true">(</mo><msubsup><mo>∫</mo><mn>0</mn><mrow><mi>v</mi><mi>t</mi></mrow></msubsup><mi mathvariant="normal">Φ</mi><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mi>l</mi><mo>−</mo><mi>v</mi><mi>t</mi><mo fence="true">)</mo></mrow><mi mathvariant="normal">d</mi><mi>l</mi><mo>+</mo><msubsup><mo>∫</mo><mrow><mi>v</mi><mi>t</mi></mrow><mi mathvariant="normal">∞</mi></msubsup><mi mathvariant="normal">Φ</mi><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mi>l</mi><mo>−</mo><mi>v</mi><mi>t</mi><mo fence="true">)</mo></mrow><mi mathvariant="normal">d</mi><mi>l</mi><mo fence="true">)</mo></mrow></mrow></mstyle></mtd></mtr><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow/></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mo>=</mo><msup><mi mathvariant="normal">e</mi><mrow><mo>−</mo><mi>λ</mi><mi>t</mi></mrow></msup><mrow><mo fence="true">(</mo><msubsup><mo>∫</mo><mrow><mo>−</mo><mi>v</mi><mi>t</mi></mrow><mn>0</mn></msubsup><mi mathvariant="normal">Φ</mi><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mi>θ</mi><mo fence="true">)</mo></mrow><mi mathvariant="normal">d</mi><mi>θ</mi><mo>+</mo><msubsup><mo>∫</mo><mn>0</mn><mi mathvariant="normal">∞</mi></msubsup><msub><mi>f</mi><mn>0</mn></msub><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mi>θ</mi><mo fence="true">)</mo></mrow><mi mathvariant="normal">d</mi><mi>θ</mi><mo fence="true">)</mo></mrow></mrow></mstyle></mtd></mtr><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow/></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mo>=</mo><msup><mi mathvariant="normal">e</mi><mrow><mo>−</mo><mi>λ</mi><mi>t</mi></mrow></msup><mrow><mo fence="true">(</mo><mn>1</mn><mo>−</mo><msubsup><mo>∫</mo><mn>0</mn><mrow><mo>−</mo><mi>v</mi><mi>t</mi></mrow></msubsup><mi mathvariant="normal">Φ</mi><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mi>θ</mi><mo fence="true">)</mo></mrow><mi mathvariant="normal">d</mi><mi>θ</mi><mo fence="true">)</mo></mrow><mi mathvariant="normal">.</mi></mrow></mstyle></mtd></mtr></mtable><annotation encoding="application/x-tex">\begin{align*}
1&amp;=\int_0^\infty\Phi\!\left(l-vt\right)\mathrm e^{-\lambda t}\,\mathrm dl\\
&amp;=\mathrm e^{-\lambda t}\left(
  \int_0^{vt}\Phi\!\left(l-vt\right)\mathrm dl
  +\int_{vt}^\infty\Phi\!\left(l-vt\right)\mathrm dl
\right)\\
&amp;=\mathrm e^{-\lambda t}\left(
  \int_{-vt}^0\Phi\!\left(\theta\right)\mathrm d\theta
  +\int_0^\infty f_0\!\left(\theta\right)\mathrm d\theta
\right)\\
&amp;=\mathrm e^{-\lambda t}\left(1-\int_0^{-vt}\Phi\!\left(\theta\right)\mathrm d\theta\right).
\end{align*}</annotation></semantics></math></span></span></span>
Therefore, we have the integral of <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi mathvariant="normal">Φ</mi></mrow><annotation encoding="application/x-tex">\Phi</annotation></semantics></math></span></span> on negative intervals: <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><msubsup><mo>∫</mo><mn>0</mn><mrow><mo>−</mo><mi>v</mi><mi>t</mi></mrow></msubsup><mi mathvariant="normal">Φ</mi><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mi>θ</mi><mo fence="true">)</mo></mrow><mi mathvariant="normal">d</mi><mi>θ</mi><mo>=</mo><mn>1</mn><mo>−</mo><msup><mi mathvariant="normal">e</mi><mrow><mi>λ</mi><mi>t</mi></mrow></msup><mi mathvariant="normal">.</mi></mrow><annotation encoding="application/x-tex">\int_0^{-vt}\Phi\!\left(\theta\right)\mathrm d\theta
=1-\mathrm e^{\lambda t}.</annotation></semantics></math></span></span></span> Find the derivative of both sides of the equation w.r.t. <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>t</mi></mrow><annotation encoding="application/x-tex">t</annotation></semantics></math></span></span>, and we have <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mo>−</mo><mi>v</mi><mi mathvariant="normal">Φ</mi><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mo>−</mo><mi>v</mi><mi>t</mi><mo fence="true">)</mo></mrow><mo>=</mo><mo>−</mo><mi>λ</mi><msup><mi mathvariant="normal">e</mi><mrow><mi>λ</mi><mi>t</mi></mrow></msup><mi mathvariant="normal">.</mi></mrow><annotation encoding="application/x-tex">-v\Phi\!\left(-vt\right)=-\lambda\mathrm e^{\lambda t}.</annotation></semantics></math></span></span></span> In other words, <span id="eq:eq-Phi-theta-lt-0" data-label="(7)"><span class="katex-display-table"> <span class="katex-display-numbered"><span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mi mathvariant="normal">Φ</mi><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mi>θ</mi><mo>&lt;</mo><mn>0</mn><mo fence="true">)</mo></mrow><mo>=</mo><mfrac><mi>λ</mi><mi>v</mi></mfrac><msup><mi mathvariant="normal">e</mi><mrow><mo>−</mo><mfrac><mi>λ</mi><mi>v</mi></mfrac><mi>θ</mi></mrow></msup><mi mathvariant="normal">.</mi></mrow><annotation encoding="application/x-tex">\Phi\!\left(\theta&lt;0\right)=\frac\lambda v\mathrm e^{-\frac\lambda v\theta}.</annotation></semantics></math></span></span></span></span> <span class="katex-display-number"><span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mo stretchy="false">(</mo><mn>7</mn><mo stretchy="false">)</mo></mrow><annotation encoding="application/x-tex">(7)</annotation></semantics></math></span></span></span></span> </span></span></p>
<p>Combining Equation <a href="#eq:eq-Phi-theta-0">6</a> and <a href="#eq:eq-Phi-theta-lt-0">7</a> and substituting back to Equation <a href="#eq:eq-general-solution">5</a>, we can find the special solution to Equation <a href="#eq:eq-pde">4</a> subject to restrictions Equation <a href="#eq:eq-normalization">2</a> and <a href="#eq:eq-initial-condition">1</a>: <span id="eq:eq-solution" data-label="(8)"><span class="katex-display-table"> <span class="katex-display-numbered"><span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mi>f</mi><mo stretchy="false">(</mo><mi>l</mi><mo separator="true">,</mo><mi>t</mi><mo stretchy="false">)</mo><mo>=</mo><mrow><mo fence="true">{</mo><mtable rowspacing="0.36em" columnalign="left left" columnspacing="1em"><mtr><mtd><mstyle scriptlevel="0" displaystyle="false"><mrow><mfrac><mi>λ</mi><mi>v</mi></mfrac><msup><mi mathvariant="normal">e</mi><mrow><mo>−</mo><mfrac><mi>λ</mi><mi>v</mi></mfrac><mi>l</mi></mrow></msup><mo separator="true">,</mo></mrow></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="false"><mrow><mn>0</mn><mo>&lt;</mo><mi>l</mi><mo>&lt;</mo><mi>v</mi><mi>t</mi><mo separator="true">,</mo></mrow></mstyle></mtd></mtr><mtr><mtd><mstyle scriptlevel="0" displaystyle="false"><mrow><msup><mi mathvariant="normal">e</mi><mrow><mo>−</mo><mi>λ</mi><mi>t</mi></mrow></msup><msub><mi>f</mi><mn>0</mn></msub><mo stretchy="false">(</mo><mi>l</mi><mo>−</mo><mi>v</mi><mi>t</mi><mo stretchy="false">)</mo><mo separator="true">,</mo></mrow></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="false"><mrow><mi>l</mi><mo>&gt;</mo><mi>v</mi><mi>t</mi><mi mathvariant="normal">.</mi></mrow></mstyle></mtd></mtr></mtable></mrow></mrow><annotation encoding="application/x-tex">f(l,t)=\begin{cases}
\frac\lambda v\mathrm e^{-\frac\lambda vl},&amp;0&lt;l&lt;vt,\\
\mathrm e^{-\lambda t}f_0(l-vt),&amp;l&gt;vt.
\end{cases}</annotation></semantics></math></span></span></span></span> <span class="katex-display-number"><span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mo stretchy="false">(</mo><mn>8</mn><mo stretchy="false">)</mo></mrow><annotation encoding="application/x-tex">(8)</annotation></semantics></math></span></span></span></span> </span></span></p>
<p>This is our final answer.</p>
<hr/>
<p>This result is interesting in that any distribution will finally evolve into an exponential distribution with the rate parameter being <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mfrac><mi>λ</mi><mi>v</mi></mfrac></mrow><annotation encoding="application/x-tex">\frac\lambda v</annotation></semantics></math></span></span> as <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>t</mi><mo>→</mo><mi mathvariant="normal">∞</mi></mrow><annotation encoding="application/x-tex">t\to\infty</annotation></semantics></math></span></span> no matter what the initial distribution is: <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mi>f</mi><mo stretchy="false">(</mo><mi>l</mi><mo separator="true">,</mo><mi mathvariant="normal">∞</mi><mo stretchy="false">)</mo><mo>=</mo><mfrac><mi>λ</mi><mi>v</mi></mfrac><msup><mi mathvariant="normal">e</mi><mrow><mo>−</mo><mfrac><mi>λ</mi><mi>v</mi></mfrac><mi>l</mi></mrow></msup><mi mathvariant="normal">.</mi></mrow><annotation encoding="application/x-tex">f(l,\infty)=\frac\lambda v\mathrm e^{-\frac\lambda vl}.</annotation></semantics></math></span></span></span> This distribution is the stationary solution to Equation <a href="#eq:eq-pde">4</a>. This is actually a normal behavior for first-order PDEs. For example, the thermal equilibrium state is the stationary solution to the heat equation, and any other solution approaches to the stationary solution over time.</p>
<p>This behavior can explain why human body hair tends to grow to only a certain length instead of being indefinitely long. You may try shaving your leg hair and wait for some weeks. You can observe that they grow to approximately the original length but not any longer. It is similar for your hair (on top of your head), but <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>λ</mi></mrow><annotation encoding="application/x-tex">\lambda</annotation></semantics></math></span></span> of hair is so small that it can hardly reach its terminal length if you get haircuts regularly.</p>
<p>Another thing to note is that this may explain a phenomenon that we may observe: the longer your hair is, the more slowly it grows, and your hair no longer seems to grow when it reaches a certain length. If the length of hair that we observe is actually the mean length of the hair, then it is <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mi>μ</mi><mo stretchy="false">(</mo><mi>t</mi><mo stretchy="false">)</mo><mo>=</mo><msubsup><mo>∫</mo><mn>0</mn><mi mathvariant="normal">∞</mi></msubsup><mi>l</mi><mi>f</mi><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mi>l</mi><mo separator="true">,</mo><mi>t</mi><mo fence="true">)</mo></mrow><mi mathvariant="normal">d</mi><mi>l</mi><mo>=</mo><mrow><mo fence="true">(</mo><msub><mi>μ</mi><mn>0</mn></msub><mo>−</mo><mfrac><mi>v</mi><mi>λ</mi></mfrac><mo fence="true">)</mo></mrow><msup><mi mathvariant="normal">e</mi><mrow><mo>−</mo><mi>λ</mi><mi>t</mi></mrow></msup><mo>+</mo><mfrac><mi>v</mi><mi>λ</mi></mfrac><mo separator="true">,</mo></mrow><annotation encoding="application/x-tex">\mu(t)=\int_0^\infty lf\!\left(l,t\right)\mathrm dl
=\left(\mu_0-\frac v\lambda\right)\mathrm e^{-\lambda t}+\frac v\lambda,</annotation></semantics></math></span></span></span> where <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><msub><mi>μ</mi><mn>0</mn></msub></mrow><annotation encoding="application/x-tex">\mu_0</annotation></semantics></math></span></span> is the mean of the distribution <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><msub><mi>f</mi><mn>0</mn></msub></mrow><annotation encoding="application/x-tex">f_0</annotation></semantics></math></span></span>. It can be seen that the growth rate of the mean length of hair varies exponentially.</p>]]></content><author><name>UlyssesZhan</name><email>ulysseszhan@gmail.com</email></author><category term="math" /><category term="calculus" /><category term="probability" /><category term="pde" /><summary type="html"><![CDATA[Denote the length distribution of one’s hair to be <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>f</mi><mo stretchy="false">(</mo><mi>l</mi><mo separator="true">,</mo><mi>t</mi><mo stretchy="false">)</mo></mrow><annotation encoding="application/x-tex">f(l,t)</annotation></semantics></math></span></span>, where <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>l</mi></mrow><annotation encoding="application/x-tex">l</annotation></semantics></math></span></span> is hair length, and <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>t</mi></mrow><annotation encoding="application/x-tex">t</annotation></semantics></math></span></span> is time. Considering that each hair may be lost naturally from time to time (there is a probability of <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>λ</mi><mtext> </mtext><mi mathvariant="normal">d</mi><mi>t</mi></mrow><annotation encoding="application/x-tex">\lambda\,\mathrm dt</annotation></semantics></math></span></span> for each hair to be lost within time range from <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>t</mi></mrow><annotation encoding="application/x-tex">t</annotation></semantics></math></span></span> to <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>t</mi><mo>+</mo><mi mathvariant="normal">d</mi><mi>t</mi></mrow><annotation encoding="application/x-tex">t+\mathrm dt</annotation></semantics></math></span></span>) and then restart growing from zero length, how will the length distribution of hair evolve with time? It turns out that we may model it with a first-order PDE.]]></summary><media:thumbnail xmlns:media="http://search.yahoo.com/mrss/" url="https://ulysseszh.github.io/assets/images/covers/2023-01-18-hair-growth.png" /><media:content medium="image" url="https://ulysseszh.github.io/assets/images/covers/2023-01-18-hair-growth.png" xmlns:media="http://search.yahoo.com/mrss/" /></entry><entry><title type="html"><![CDATA[Solving ODE by recursive integration]]></title><link href="https://ulysseszh.github.io/math/2022/11/15/ode-recursive.html" rel="alternate" type="text/html" title="Solving ODE by recursive integration" /><published>2022-11-15T15:02:30-08:00</published><updated>2022-11-15T15:02:30-08:00</updated><id>https://ulysseszh.github.io/math/2022/11/15/ode-recursive</id><content type="html" xml:base="https://ulysseszh.github.io/math/2022/11/15/ode-recursive.html"><![CDATA[<h2 data-label="0.1" id="the-method">The method</h2>
<p>Suppose we have an ODE (with initial conditions) <span id="eq:eq-ode" data-label="(1)"><span class="katex-display-table"> <span class="katex-display-numbered"><span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><msup><mi>x</mi><mo mathvariant="normal" lspace="0em" rspace="0em">′</mo></msup><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mi>t</mi><mo fence="true">)</mo></mrow><mo>=</mo><mi>f</mi><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mi>x</mi><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mi>t</mi><mo fence="true">)</mo></mrow><mo separator="true">,</mo><mi>t</mi><mo fence="true">)</mo></mrow><mo separator="true">,</mo><mspace width="1em"/><mi>x</mi><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><msub><mi>t</mi><mn>0</mn></msub><mo fence="true">)</mo></mrow><mo>=</mo><mi>C</mi><mo separator="true">,</mo></mrow><annotation encoding="application/x-tex">x'\!\left(t\right)=f\!\left(x\!\left(t\right),t\right),
\quad x\!\left(t_0\right)=C,</annotation></semantics></math></span></span></span></span> <span class="katex-display-number"><span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mo stretchy="false">(</mo><mn>1</mn><mo stretchy="false">)</mo></mrow><annotation encoding="application/x-tex">(1)</annotation></semantics></math></span></span></span></span> </span></span> where <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>x</mi></mrow><annotation encoding="application/x-tex">x</annotation></semantics></math></span></span> is the unknown function, and <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>f</mi></mrow><annotation encoding="application/x-tex">f</annotation></semantics></math></span></span> is Lipschitz continuous in its first argument and continuous in its second argument. By Picard–Lindelöf theorem, we can seek the unique solution within <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>t</mi><mo>∈</mo><mrow><mo fence="true">[</mo><msub><mi>t</mi><mn>0</mn></msub><mo>−</mo><mi>ε</mi><mo separator="true">,</mo><msub><mi>t</mi><mn>0</mn></msub><mo>+</mo><mi>ε</mi><mo fence="true">]</mo></mrow></mrow><annotation encoding="application/x-tex">t\in\left[t_0-\varepsilon,t_0+\varepsilon\right]</annotation></semantics></math></span></span>.</p>
<p>Here, I propose the following method: we can write out a sequence of functions defined by <span id="eq:eq-x0" data-label="(2)"><span class="katex-display-table"> <span class="katex-display-numbered"><span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><msub><mi>x</mi><mn>0</mn></msub><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mi>t</mi><mo fence="true">)</mo></mrow><mo><mi mathvariant="normal">≔</mi></mo><mi>C</mi><mo separator="true">,</mo></mrow><annotation encoding="application/x-tex">x_0\!\left(t\right)\coloneqq C,</annotation></semantics></math></span></span></span></span> <span class="katex-display-number"><span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mo stretchy="false">(</mo><mn>2</mn><mo stretchy="false">)</mo></mrow><annotation encoding="application/x-tex">(2)</annotation></semantics></math></span></span></span></span> </span></span> <span id="eq:eq-xn-1" data-label="(3)"><span class="katex-display-table"> <span class="katex-display-numbered"><span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><msub><mi>x</mi><mrow><mi>n</mi><mo>+</mo><mn>1</mn></mrow></msub><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mi>t</mi><mo fence="true">)</mo></mrow><mo><mi mathvariant="normal">≔</mi></mo><msubsup><mo>∫</mo><msub><mi>t</mi><mn>0</mn></msub><mi>t</mi></msubsup><mi>f</mi><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><msub><mi>x</mi><mi>n</mi></msub><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mi>s</mi><mo fence="true">)</mo></mrow><mo separator="true">,</mo><mi>s</mi><mo fence="true">)</mo></mrow><mtext> </mtext><mi mathvariant="normal">d</mi><mi>s</mi><mo>+</mo><mi>C</mi></mrow><annotation encoding="application/x-tex">x_{n+1}\!\left(t\right)\coloneqq\int_{t_0}^tf\!\left(x_n\!\left(s\right),s\right)\,\mathrm ds+C</annotation></semantics></math></span></span></span></span> <span class="katex-display-number"><span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mo stretchy="false">(</mo><mn>3</mn><mo stretchy="false">)</mo></mrow><annotation encoding="application/x-tex">(3)</annotation></semantics></math></span></span></span></span> </span></span> (the properties of <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>f</mi></mrow><annotation encoding="application/x-tex">f</annotation></semantics></math></span></span> guarantee that the integral is well-defined). Then, if the sequence
<span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mo fence="true">(</mo><msubsup><mi>x</mi><mi>n</mi><mo mathvariant="normal" lspace="0em" rspace="0em">′</mo></msubsup><mo fence="true">)</mo></mrow><annotation encoding="application/x-tex">\left(x_n'\right)</annotation></semantics></math></span></span> converges uniformly on <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mo fence="true">[</mo><mi>t</mi><mo>−</mo><mi>ε</mi><mo separator="true">,</mo><mi>t</mi><mo>+</mo><mi>ε</mi><mo fence="true">]</mo></mrow><annotation encoding="application/x-tex">\left[t-\varepsilon,t+\varepsilon\right]</annotation></semantics></math></span></span> (question: can this condition actually be proved?), then the sequence <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mo fence="true">(</mo><msub><mi>x</mi><mi>n</mi></msub><mo fence="true">)</mo></mrow><annotation encoding="application/x-tex">\left(x_n\right)</annotation></semantics></math></span></span> converges uniformly to a function <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>x</mi></mrow><annotation encoding="application/x-tex">x</annotation></semantics></math></span></span> on <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mo fence="true">[</mo><mi>t</mi><mo>−</mo><mi>ε</mi><mo separator="true">,</mo><mi>t</mi><mo>+</mo><mi>ε</mi><mo fence="true">]</mo></mrow><annotation encoding="application/x-tex">\left[t-\varepsilon,t+\varepsilon\right]</annotation></semantics></math></span></span>, which is the unique solution to Equation <a href="#eq:eq-ode">1</a>.</p>
<h2 data-label="0.2" id="proof">Proof</h2>
<p>The proof is easy. Note from Equation <a href="#eq:eq-xn-1">3</a> that <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><msubsup><mi>x</mi><mrow><mi>n</mi><mo>+</mo><mn>1</mn></mrow><mo mathvariant="normal" lspace="0em" rspace="0em">′</mo></msubsup><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mi>t</mi><mo fence="true">)</mo></mrow><mo>=</mo><mi>f</mi><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><msub><mi>x</mi><mi>n</mi></msub><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mi>t</mi><mo fence="true">)</mo></mrow><mo separator="true">,</mo><mi>t</mi><mo fence="true">)</mo></mrow><mi mathvariant="normal">.</mi></mrow><annotation encoding="application/x-tex">x_{n+1}'\!\left(t\right)=f\!\left(x_n\!\left(t\right),t\right).</annotation></semantics></math></span></span></span> Then, take the limit <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>n</mi><mo>→</mo><mi mathvariant="normal">∞</mi></mrow><annotation encoding="application/x-tex">n\to\infty</annotation></semantics></math></span></span>. By the uniform convergence, we recovers Equation <a href="#eq:eq-ode">1</a>.</p>
<h2 data-label="0.3" id="an-example">An example</h2>
<p>Suppose <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>f</mi><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mi>x</mi><mo separator="true">,</mo><mi>t</mi><mo fence="true">)</mo></mrow><mo><mi mathvariant="normal">≔</mi></mo><mi>x</mi></mrow><annotation encoding="application/x-tex">f\!\left(x,t\right)\coloneqq x</annotation></semantics></math></span></span> and <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><msub><mi>t</mi><mn>0</mn></msub><mo><mi mathvariant="normal">≔</mi></mo><mn>0</mn></mrow><annotation encoding="application/x-tex">t_0\coloneqq0</annotation></semantics></math></span></span>, then <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><msub><mi>x</mi><mi>n</mi></msub><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mi>t</mi><mo fence="true">)</mo></mrow><mo>=</mo><mi>C</mi><munderover><mo>∑</mo><mrow><mi>j</mi><mo>=</mo><mn>0</mn></mrow><mrow><mi>n</mi><mo>−</mo><mn>1</mn></mrow></munderover><mfrac><msup><mi>t</mi><mi>j</mi></msup><mrow><mi>j</mi><mo stretchy="false">!</mo></mrow></mfrac><mi mathvariant="normal">.</mi></mrow><annotation encoding="application/x-tex">x_n\!\left(t\right)=C\sum_{j=0}^{n-1}\frac{t^j}{j!}.</annotation></semantics></math></span></span></span> This is because
<span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><msubsup><mo>∫</mo><mn>0</mn><mi>t</mi></msubsup><msub><mi>x</mi><mi>n</mi></msub><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mi>s</mi><mo fence="true">)</mo></mrow><mtext> </mtext><mi mathvariant="normal">d</mi><mi>s</mi><mo>+</mo><mi>C</mi><mo>=</mo><mi>C</mi><munderover><mo>∑</mo><mrow><mi>j</mi><mo>=</mo><mn>0</mn></mrow><mrow><mi>n</mi><mo>−</mo><mn>1</mn></mrow></munderover><mfrac><msup><mi>t</mi><mrow><mi>j</mi><mo>+</mo><mn>1</mn></mrow></msup><mrow><mi>j</mi><mo stretchy="false">!</mo><mrow><mo fence="true">(</mo><mi>j</mi><mo>+</mo><mn>1</mn><mo fence="true">)</mo></mrow></mrow></mfrac><mo>+</mo><mi>C</mi><mo>=</mo><msub><mi>x</mi><mrow><mi>n</mi><mo>+</mo><mn>1</mn></mrow></msub><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mi>t</mi><mo fence="true">)</mo></mrow><mi mathvariant="normal">.</mi></mrow><annotation encoding="application/x-tex">\int_0^tx_n\!\left(s\right)\,\mathrm ds+C=C\sum_{j=0}^{n-1}\frac{t^{j+1}}{j!\left(j+1\right)}+C=x_{n+1}\!\left(t\right).</annotation></semantics></math></span></span></span> By taking the limit <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>n</mi><mo>→</mo><mi mathvariant="normal">∞</mi></mrow><annotation encoding="application/x-tex">n\to\infty</annotation></semantics></math></span></span>, we get
<span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>x</mi><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mi>t</mi><mo fence="true">)</mo></mrow><mo>=</mo><mi>C</mi><msup><mi mathvariant="normal">e</mi><mi>t</mi></msup></mrow><annotation encoding="application/x-tex">x\!\left(t\right)=C\mathrm e^t</annotation></semantics></math></span></span>, which means that the unique solution to <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><msup><mi>x</mi><mo mathvariant="normal" lspace="0em" rspace="0em">′</mo></msup><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mi>t</mi><mo fence="true">)</mo></mrow><mo>=</mo><mi>x</mi><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mi>t</mi><mo fence="true">)</mo></mrow></mrow><annotation encoding="application/x-tex">x'\!\left(t\right)=x\!\left(t\right)</annotation></semantics></math></span></span> with initial condition <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>x</mi><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mn>0</mn><mo fence="true">)</mo></mrow><mo>=</mo><mi>C</mi></mrow><annotation encoding="application/x-tex">x\!\left(0\right)=C</annotation></semantics></math></span></span> is <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>x</mi><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mi>t</mi><mo fence="true">)</mo></mrow><mo>=</mo><mi>C</mi><msup><mi mathvariant="normal">e</mi><mi>t</mi></msup></mrow><annotation encoding="application/x-tex">x\!\left(t\right)=C\mathrm e^t</annotation></semantics></math></span></span>, expectedly.</p>
<h2 data-label="0.4" id="approximation">Approximation</h2>
<p>This method is good because integration is sometimes much easier than solving ODE. We can use integration to get functions that are close to the exact solution. A natural question to ask is how close <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><msub><mi>x</mi><mi>n</mi></msub></mrow><annotation encoding="application/x-tex">x_n</annotation></semantics></math></span></span> is to the exact solution <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>x</mi></mrow><annotation encoding="application/x-tex">x</annotation></semantics></math></span></span>.</p>
<p>If Equation <a href="#eq:eq-ode">1</a> is defined on <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><msup><mi mathvariant="double-struck">R</mi><mi>n</mi></msup></mrow><annotation encoding="application/x-tex">\mathbb R^n</annotation></semantics></math></span></span> (where we may define differences and infinitesimals), it is clear that <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><msub><mi>x</mi><mi>n</mi></msub><mo>−</mo><mi>x</mi></mrow><annotation encoding="application/x-tex">x_n-x</annotation></semantics></math></span></span> is an infinitesimal of higher order than <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><msup><mrow><mo fence="true">(</mo><mi>t</mi><mo>−</mo><msub><mi>t</mi><mn>0</mn></msub><mo fence="true">)</mo></mrow><mi>n</mi></msup></mrow><annotation encoding="application/x-tex">\left(t-t_0\right)^n</annotation></semantics></math></span></span>.</p>]]></content><author><name>UlyssesZhan</name><email>ulysseszhan@gmail.com</email></author><category term="math" /><category term="ode" /><category term="calculus" /><summary type="html"><![CDATA[By recursively integrating according to <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><msub><mi>x</mi><mrow><mi>n</mi><mo>+</mo><mn>1</mn></mrow></msub><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mi>t</mi><mo fence="true">)</mo></mrow><mo><mi mathvariant="normal">≔</mi></mo><msubsup><mo>∫</mo><msub><mi>t</mi><mn>0</mn></msub><mi>t</mi></msubsup><mi>f</mi><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><msub><mi>x</mi><mi>n</mi></msub><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mi>s</mi><mo fence="true">)</mo></mrow><mo separator="true">,</mo><mi>s</mi><mo fence="true">)</mo></mrow><mtext> </mtext><mi mathvariant="normal">d</mi><mi>s</mi><mo>+</mo><mi>C</mi></mrow><annotation encoding="application/x-tex">x_{n+1}\!\left(t\right)\coloneqq\int_{t_0}^tf\!\left(x_n\!\left(s\right),s\right)\,\mathrm ds+C</annotation></semantics></math></span></span> from <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><msub><mi>x</mi><mn>0</mn></msub><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><msub><mi>t</mi><mn>0</mn></msub><mo fence="true">)</mo></mrow><mo><mi mathvariant="normal">≔</mi></mo><mi>C</mi></mrow><annotation encoding="application/x-tex">x_0\!\left(t_0\right)\coloneqq C</annotation></semantics></math></span></span>, we can get the solution of the ODE
<span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><msup><mi>x</mi><mo mathvariant="normal" lspace="0em" rspace="0em">′</mo></msup><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mi>t</mi><mo fence="true">)</mo></mrow><mo>=</mo><mi>f</mi><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mi>x</mi><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mi>t</mi><mo fence="true">)</mo></mrow><mo separator="true">,</mo><mi>t</mi><mo fence="true">)</mo></mrow></mrow><annotation encoding="application/x-tex">x'\!\left(t\right)=f\!\left(x\!\left(t\right),t\right)</annotation></semantics></math></span></span> with initial conditions <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>x</mi><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><msub><mi>t</mi><mn>0</mn></msub><mo fence="true">)</mo></mrow><mo>=</mo><mi>C</mi></mrow><annotation encoding="application/x-tex">x\!\left(t_0\right)=C</annotation></semantics></math></span></span> as the limit of the sequence of functions.]]></summary><media:thumbnail xmlns:media="http://search.yahoo.com/mrss/" url="https://ulysseszh.github.io/assets/images/covers/2022-11-15-ode-recursive.png" /><media:content medium="image" url="https://ulysseszh.github.io/assets/images/covers/2022-11-15-ode-recursive.png" xmlns:media="http://search.yahoo.com/mrss/" /></entry><entry><title type="html"><![CDATA[Hölder means inequality]]></title><link href="https://ulysseszh.github.io/math/2022/11/11/holder-inequality.html" rel="alternate" type="text/html" title="Hölder means inequality" /><published>2022-11-11T16:42:37-08:00</published><updated>2022-11-11T16:42:37-08:00</updated><id>https://ulysseszh.github.io/math/2022/11/11/holder-inequality</id><content type="html" xml:base="https://ulysseszh.github.io/math/2022/11/11/holder-inequality.html"><![CDATA[<p>
  <em>This article is translated from a Chinese <a href="https://zhuanlan.zhihu.com/p/85968527" target="_blank" rel="external">article</a> on my Zhihu account. The original article was posted at 2019-10-12 18:56 +0800.</em>
</p>
<hr/>
<p>Some stipulations:</p>
<ul>
<li>Without special statements, all vectors appearing in this article are <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>n</mi></mrow><annotation encoding="application/x-tex">n</annotation></semantics></math></span></span>-dimensional vectors, <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>n</mi><mo>∈</mo><mi mathvariant="double-struck">N</mi></mrow><annotation encoding="application/x-tex">n\in\mathbb N</annotation></semantics></math></span></span>;</li>
<li>Iteration variable <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>k</mi></mrow><annotation encoding="application/x-tex">k</annotation></semantics></math></span></span> always iterates over <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mrow><mo fence="true">[</mo><mn>0</mn><mo separator="true">,</mo><mi>n</mi><mo fence="true">)</mo></mrow><mo>∪</mo><mi mathvariant="double-struck">Z</mi></mrow><annotation encoding="application/x-tex">\left[0,n\right)\cup\mathbb Z</annotation></semantics></math></span></span>;</li>
<li><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi mathvariant="normal">sum</mi><mo>⁡</mo><mover accent="true"><mi>ξ</mi><mo>⃗</mo></mover><mo><mi mathvariant="normal">≔</mi></mo><msub><mo>∑</mo><mi>k</mi></msub><msub><mi>ξ</mi><mi>k</mi></msub></mrow><annotation encoding="application/x-tex">\operatorname{sum}\vec\xi\coloneqq\sum_k\xi_k</annotation></semantics></math></span></span>;</li>
<li><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi mathvariant="normal">prod</mi><mo>⁡</mo><mover accent="true"><mi>ξ</mi><mo>⃗</mo></mover><mo><mi mathvariant="normal">≔</mi></mo><msub><mo>∏</mo><mi>k</mi></msub><msub><mi>ξ</mi><mi>k</mi></msub></mrow><annotation encoding="application/x-tex">\operatorname{prod}\vec\xi\coloneqq\prod_k\xi_k</annotation></semantics></math></span></span>;</li>
<li>If the independent and dependent variables of function <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>f</mi></mrow><annotation encoding="application/x-tex">f</annotation></semantics></math></span></span> are both scalars, then define <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>f</mi><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mover accent="true"><mi>ξ</mi><mo>⃗</mo></mover><mo fence="true">)</mo></mrow><mo><mi mathvariant="normal">≔</mi></mo><mrow><mo fence="true">(</mo><mi>f</mi><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><msub><mi>ξ</mi><mn>0</mn></msub><mo fence="true">)</mo></mrow><mo separator="true">,</mo><mi>f</mi><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><msub><mi>ξ</mi><mn>1</mn></msub><mo fence="true">)</mo></mrow><mo separator="true">,</mo><mo>…</mo><mo separator="true">,</mo><mi>f</mi><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><msub><mi>ξ</mi><mi>n</mi></msub><mo fence="true">)</mo></mrow><mo fence="true">)</mo></mrow></mrow><annotation encoding="application/x-tex">f\!\left(\vec\xi\right)\coloneqq\left(f\!\left(\xi_0\right),f\!\left(\xi_1\right),\ldots,f\!\left(\xi_n\right)\right)</annotation></semantics></math></span></span>;</li>
<li><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><msup><mover accent="true"><mi>ξ</mi><mo>⃗</mo></mover><mover accent="true"><mi>η</mi><mo>⃗</mo></mover></msup><mo><mi mathvariant="normal">≔</mi></mo><msub><mo>∏</mo><mi>k</mi></msub><msubsup><mi>ξ</mi><mi>k</mi><msub><mi>η</mi><mi>k</mi></msub></msubsup></mrow><annotation encoding="application/x-tex">\vec\xi^{\vec\eta}\coloneqq\prod_k\xi_k^{\eta_k}</annotation></semantics></math></span></span>;</li>
<li><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>min</mi><mo>⁡</mo><mover accent="true"><mi>ξ</mi><mo>⃗</mo></mover><mo><mi mathvariant="normal">≔</mi></mo><msub><mrow><mi>min</mi><mo>⁡</mo></mrow><mi>k</mi></msub><msub><mi>ξ</mi><mi>k</mi></msub></mrow><annotation encoding="application/x-tex">\min\vec\xi\coloneqq\min_k\xi_k</annotation></semantics></math></span></span>;</li>
<li><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>max</mi><mo>⁡</mo><mover accent="true"><mi>ξ</mi><mo>⃗</mo></mover><mo><mi mathvariant="normal">≔</mi></mo><msub><mrow><mi>max</mi><mo>⁡</mo></mrow><mi>k</mi></msub><msub><mi>ξ</mi><mi>k</mi></msub></mrow><annotation encoding="application/x-tex">\max\vec\xi\coloneqq\max_k\xi_k</annotation></semantics></math></span></span>;</li>
<li><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><msub><mi>δ</mi><mrow><mi>ξ</mi><mo separator="true">,</mo><mi>η</mi></mrow></msub><mo><mi mathvariant="normal">≔</mi></mo><mrow><mo fence="true">{</mo><mtable rowspacing="0.36em" columnalign="left left" columnspacing="1em"><mtr><mtd><mstyle scriptlevel="0" displaystyle="false"><mrow><mn>1</mn><mo separator="true">,</mo></mrow></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="false"><mrow/></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="false"><mrow><mi>ξ</mi><mo>=</mo><mi>η</mi><mo separator="true">,</mo></mrow></mstyle></mtd></mtr><mtr><mtd><mstyle scriptlevel="0" displaystyle="false"><mrow><mn>0</mn><mo separator="true">,</mo></mrow></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="false"><mrow/></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="false"><mrow><mi>ξ</mi><mo mathvariant="normal">≠</mo><mi>η</mi><mo separator="true">;</mo></mrow></mstyle></mtd></mtr></mtable></mrow></mrow><annotation encoding="application/x-tex">\delta_{\xi,\eta}\coloneqq\begin{cases}1,&amp;&amp;\xi=\eta,\\0,&amp;&amp;\xi\ne\eta;\end{cases}</annotation></semantics></math></span></span></li>
<li>By saying <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mover accent="true"><mi>ξ</mi><mo>⃗</mo></mover></mrow><annotation encoding="application/x-tex">\vec\xi</annotation></semantics></math></span></span> is congruent, all components of <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mover accent="true"><mi>ξ</mi><mo>⃗</mo></mover></mrow><annotation encoding="application/x-tex">\vec\xi</annotation></semantics></math></span></span> are equal to each other.</li>
</ul>
<p class="no-indent">
<strong>Definition 1</strong>. Suppose we have samples <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mover accent="true"><mi>x</mi><mo>⃗</mo></mover><mo>∈</mo><msup><mrow><mo fence="true">(</mo><msup><mi mathvariant="double-struck">R</mi><mo>+</mo></msup><mo fence="true">)</mo></mrow><mi>n</mi></msup></mrow><annotation encoding="application/x-tex">\vec x\in\left(\mathbb R^+\right)^n</annotation></semantics></math></span></span>, weights <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mover accent="true"><mi>w</mi><mo>⃗</mo></mover><mo>∈</mo><mrow><mo fence="true">{</mo><mover accent="true"><mi>ξ</mi><mo>⃗</mo></mover><mo>∈</mo><msup><mrow><mo fence="true">(</mo><msup><mi mathvariant="double-struck">R</mi><mo>+</mo></msup><mo fence="true">)</mo></mrow><mi>n</mi></msup><mtext> </mtext><mo fence="true" lspace="0.05em" rspace="0.05em">|</mo><mtext> </mtext><mi mathvariant="normal">sum</mi><mo>⁡</mo><mover accent="true"><mi>ξ</mi><mo>⃗</mo></mover><mo>=</mo><mn>1</mn><mo fence="true">}</mo></mrow></mrow><annotation encoding="application/x-tex">\vec w\in\left\{\vec\xi\in\left(\mathbb R^+\right)^n\,\middle|\,\operatorname{sum}\vec\xi=1\right\}</annotation></semantics></math></span></span>, and parameter <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>p</mi><mo>∈</mo><mrow><mo fence="true">[</mo><mo>−</mo><mi mathvariant="normal">∞</mi><mo separator="true">,</mo><mo>+</mo><mi mathvariant="normal">∞</mi><mo fence="true">]</mo></mrow></mrow><annotation encoding="application/x-tex">p\in\left[-\infty,+\infty\right]</annotation></semantics></math></span></span>. Define the Hölder mean by <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><msub><mi>M</mi><mrow><mi>p</mi><mo separator="true">,</mo><mover accent="true"><mi>w</mi><mo>⃗</mo></mover></mrow></msub><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mover accent="true"><mi>x</mi><mo>⃗</mo></mover><mo fence="true">)</mo></mrow><mo><mi mathvariant="normal">≔</mi></mo><msup><mrow><mo fence="true">(</mo><mover accent="true"><mi>w</mi><mo>⃗</mo></mover><mo>⋅</mo><msup><mover accent="true"><mi>x</mi><mo>⃗</mo></mover><mi>p</mi></msup><mo fence="true">)</mo></mrow><mfrac><mn>1</mn><mi>p</mi></mfrac></msup><mi mathvariant="normal">.</mi></mrow><annotation encoding="application/x-tex">M_{p,\vec w}\!\left(\vec x\right)\coloneqq\left(\vec w\cdot\vec x^p\right)^{\frac 1p}.</annotation></semantics></math></span></span></span>
</p>
<p><em>Note.</em> The function is indefinite when <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>p</mi><mo>∈</mo><mrow><mo fence="true">{</mo><mo>−</mo><mi mathvariant="normal">∞</mi><mo separator="true">,</mo><mn>0</mn><mo separator="true">,</mo><mo>+</mo><mi mathvariant="normal">∞</mi><mo fence="true">}</mo></mrow></mrow><annotation encoding="application/x-tex">p\in\left\{-\infty,0,+\infty\right\}</annotation></semantics></math></span></span>, but actually there exist limits <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><munder><mrow><mi>lim</mi><mo>⁡</mo></mrow><mrow><mi>p</mi><mo>→</mo><mn>0</mn></mrow></munder><msub><mi>M</mi><mrow><mi>p</mi><mo separator="true">,</mo><mover accent="true"><mi>w</mi><mo>⃗</mo></mover></mrow></msub><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mover accent="true"><mi>x</mi><mo>⃗</mo></mover><mo fence="true">)</mo></mrow><mo>=</mo><msup><mover accent="true"><mi>x</mi><mo>⃗</mo></mover><mover accent="true"><mi>w</mi><mo>⃗</mo></mover></msup><mo separator="true">,</mo></mrow><annotation encoding="application/x-tex">\lim_{p\to0}M_{p,\vec w}\!\left(\vec x\right)=\vec x^{\vec w},</annotation></semantics></math></span></span></span> <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><munder><mrow><mi>lim</mi><mo>⁡</mo></mrow><mrow><mi>p</mi><mo>→</mo><mo>−</mo><mi mathvariant="normal">∞</mi></mrow></munder><msub><mi>M</mi><mrow><mi>p</mi><mo separator="true">,</mo><mover accent="true"><mi>w</mi><mo>⃗</mo></mover></mrow></msub><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mover accent="true"><mi>x</mi><mo>⃗</mo></mover><mo fence="true">)</mo></mrow><mo>=</mo><mi>min</mi><mo>⁡</mo><mover accent="true"><mi>x</mi><mo>⃗</mo></mover><mo separator="true">,</mo></mrow><annotation encoding="application/x-tex">\lim_{p\to-\infty}M_{p,\vec w}\!\left(\vec x\right)=\min\vec x,</annotation></semantics></math></span></span></span> <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><munder><mrow><mi>lim</mi><mo>⁡</mo></mrow><mrow><mi>p</mi><mo>→</mo><mo>+</mo><mi mathvariant="normal">∞</mi></mrow></munder><msub><mi>M</mi><mrow><mi>p</mi><mo separator="true">,</mo><mover accent="true"><mi>w</mi><mo>⃗</mo></mover></mrow></msub><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mover accent="true"><mi>x</mi><mo>⃗</mo></mover><mo fence="true">)</mo></mrow><mo>=</mo><mi>max</mi><mo>⁡</mo><mover accent="true"><mi>x</mi><mo>⃗</mo></mover><mi mathvariant="normal">.</mi></mrow><annotation encoding="application/x-tex">\lim_{p\to+\infty}M_{p,\vec w}\!\left(\vec x\right)=\max\vec x.</annotation></semantics></math></span></span></span> The limits are to be proved as theorems later. We can use them to define the Hölder mean for <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>p</mi><mo>∈</mo><mrow><mo fence="true">{</mo><mo>−</mo><mi mathvariant="normal">∞</mi><mo separator="true">,</mo><mn>0</mn><mo separator="true">,</mo><mo>+</mo><mi mathvariant="normal">∞</mi><mo fence="true">}</mo></mrow></mrow><annotation encoding="application/x-tex">p\in\left\{-\infty,0,+\infty\right\}</annotation></semantics></math></span></span>.</p>
<p class="no-indent">
<strong>Theorem 1</strong>. <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><munder><mrow><mi>lim</mi><mo>⁡</mo></mrow><mrow><mi>p</mi><mo>→</mo><mn>0</mn></mrow></munder><msub><mi>M</mi><mrow><mi>p</mi><mo separator="true">,</mo><mover accent="true"><mi>w</mi><mo>⃗</mo></mover></mrow></msub><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mover accent="true"><mi>x</mi><mo>⃗</mo></mover><mo fence="true">)</mo></mrow><mo>=</mo><msup><mover accent="true"><mi>x</mi><mo>⃗</mo></mover><mover accent="true"><mi>w</mi><mo>⃗</mo></mover></msup><mi mathvariant="normal">.</mi></mrow><annotation encoding="application/x-tex">\lim_{p\to0}M_{p,\vec w}\!\left(\vec x\right)=\vec x^{\vec w}.</annotation></semantics></math></span></span></span>
</p>
<p class="no-indent">
<em>Proof.</em> <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mtable rowspacing="0.25em" columnalign="right left right" columnspacing="0em 1em"><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><munder><mrow><mi>lim</mi><mo>⁡</mo></mrow><mrow><mi>p</mi><mo>→</mo><mn>0</mn></mrow></munder><msub><mi>M</mi><mrow><mi>p</mi><mo separator="true">,</mo><mover accent="true"><mi>w</mi><mo>⃗</mo></mover></mrow></msub><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mover accent="true"><mi>x</mi><mo>⃗</mo></mover><mo fence="true">)</mo></mrow></mrow></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mo>=</mo><munder><mrow><mi>lim</mi><mo>⁡</mo></mrow><mrow><mi>p</mi><mo>→</mo><mn>0</mn></mrow></munder><msup><mrow><mo fence="true">(</mo><mover accent="true"><mi>w</mi><mo>⃗</mo></mover><mo>⋅</mo><msup><mover accent="true"><mi>x</mi><mo>⃗</mo></mover><mi>p</mi></msup><mo fence="true">)</mo></mrow><mfrac><mn>1</mn><mi>p</mi></mfrac></msup></mrow></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mtext>(Definition 1)</mtext></mstyle></mtd></mtr><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow/></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mo>=</mo><munder><mrow><mi>lim</mi><mo>⁡</mo></mrow><mrow><mi>p</mi><mo>→</mo><mn>0</mn></mrow></munder><mi>exp</mi><mo>⁡</mo><mfrac><mrow><mi>ln</mi><mo>⁡</mo><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mover accent="true"><mi>w</mi><mo>⃗</mo></mover><mo>⋅</mo><msup><mover accent="true"><mi>x</mi><mo>⃗</mo></mover><mi>p</mi></msup><mo fence="true">)</mo></mrow></mrow><mi>p</mi></mfrac></mrow></mstyle></mtd></mtr><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow/></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mo>=</mo><mi>exp</mi><mo>⁡</mo><munder><mrow><mi>lim</mi><mo>⁡</mo></mrow><mrow><mi>p</mi><mo>→</mo><mn>0</mn></mrow></munder><mfrac><mrow><mi>ln</mi><mo>⁡</mo><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mover accent="true"><mi>w</mi><mo>⃗</mo></mover><mo>⋅</mo><msup><mover accent="true"><mi>x</mi><mo>⃗</mo></mover><mi>p</mi></msup><mo fence="true">)</mo></mrow></mrow><mi>p</mi></mfrac></mrow></mstyle></mtd></mtr><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow/></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mo>=</mo><mi>exp</mi><mo>⁡</mo><munder><mrow><mi>lim</mi><mo>⁡</mo></mrow><mrow><mi>p</mi><mo>→</mo><mn>0</mn></mrow></munder><mfrac><mrow><mover accent="true"><mi>w</mi><mo>⃗</mo></mover><mo>⋅</mo><mrow><mo fence="true">(</mo><msup><mover accent="true"><mi>x</mi><mo>⃗</mo></mover><mi>p</mi></msup><mi>ln</mi><mo>⁡</mo><mover accent="true"><mi>x</mi><mo>⃗</mo></mover><mo fence="true">)</mo></mrow></mrow><mrow><mover accent="true"><mi>w</mi><mo>⃗</mo></mover><mo>⋅</mo><msup><mover accent="true"><mi>x</mi><mo>⃗</mo></mover><mi>p</mi></msup></mrow></mfrac></mrow></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mtext>(L’H</mtext><mover accent="true"><mtext>o</mtext><mo>ˆ</mo></mover><mtext>pital’s rule)</mtext></mrow></mstyle></mtd></mtr><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow/></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mo>=</mo><mi>exp</mi><mo>⁡</mo><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mover accent="true"><mi>w</mi><mo>⃗</mo></mover><mo>⋅</mo><mi>ln</mi><mo>⁡</mo><mover accent="true"><mi>x</mi><mo>⃗</mo></mover><mo fence="true">)</mo></mrow></mrow></mstyle></mtd></mtr><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow/></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mo>=</mo><msup><mover accent="true"><mi>x</mi><mo>⃗</mo></mover><mover accent="true"><mi>w</mi><mo>⃗</mo></mover></msup><mi mathvariant="normal">.</mi></mrow></mstyle></mtd></mtr></mtable><annotation encoding="application/x-tex">\begin{aligned}
\lim_{p\to0}M_{p,\vec w}\!\left(\vec x\right)
&amp;=\lim_{p\to0}\left(\vec w\cdot\vec x^p\right)^{\frac 1p}
&amp;\text{(Definition 1)}\\
&amp;=\lim_{p\to0}\exp\frac{\ln\!\left(\vec w\cdot\vec x^p\right)}p\\
&amp;=\exp\lim_{p\to0}\frac{\ln\!\left(\vec w\cdot\vec x^p\right)}p\\
&amp;=\exp\lim_{p\to0}\frac{\vec w\cdot\left(\vec x^p\ln\vec x\right)}{\vec w\cdot\vec x^p}
&amp;\text{(L'H\^opital's rule)}\\
&amp;=\exp\!\left(\vec w\cdot\ln\vec x\right)\\
&amp;=\vec x^{\vec w}.
\end{aligned}</annotation></semantics></math></span></span></span> <span class="qed-wrapper qed-last"><span class="qed qed-last"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi mathvariant="normal">□</mi></mrow><annotation encoding="application/x-tex">\square</annotation></semantics></math></span></span></span></span>
</p>
<p class="no-indent">
<strong>Theorem 2</strong>. <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><msub><mi>M</mi><mrow><mi>p</mi><mo separator="true">,</mo><mover accent="true"><mi>w</mi><mo>⃗</mo></mover></mrow></msub><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mover accent="true"><mi>x</mi><mo>⃗</mo></mover><mo fence="true">)</mo></mrow><mo>=</mo><msub><mi>M</mi><mrow><mo>−</mo><mi>p</mi><mo separator="true">,</mo><mover accent="true"><mi>w</mi><mo>⃗</mo></mover></mrow></msub><mtext> ⁣</mtext><msup><mrow><mo fence="true">(</mo><msup><mover accent="true"><mi>x</mi><mo>⃗</mo></mover><mrow><mo>−</mo><mn>1</mn></mrow></msup><mo fence="true">)</mo></mrow><mrow><mo>−</mo><mn>1</mn></mrow></msup><mi mathvariant="normal">.</mi></mrow><annotation encoding="application/x-tex">M_{p,\vec w}\!\left(\vec x\right)=M_{-p,\vec w}\!\left(\vec x^{-1}\right)^{-1}.</annotation></semantics></math></span></span></span>
</p>
<p class="no-indent">
<em>Proof.</em> <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mtable rowspacing="0.25em" columnalign="right left right" columnspacing="0em 1em"><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><msub><mi>M</mi><mrow><mi>p</mi><mo separator="true">,</mo><mover accent="true"><mi>w</mi><mo>⃗</mo></mover></mrow></msub><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mover accent="true"><mi>x</mi><mo>⃗</mo></mover><mo fence="true">)</mo></mrow></mrow></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mo>=</mo><msup><mrow><mo fence="true">(</mo><mover accent="true"><mi>w</mi><mo>⃗</mo></mover><mo>⋅</mo><msup><mover accent="true"><mi>x</mi><mo>⃗</mo></mover><mi>p</mi></msup><mo fence="true">)</mo></mrow><mfrac><mn>1</mn><mi>p</mi></mfrac></msup></mrow></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mtext>(Definition 1)</mtext></mstyle></mtd></mtr><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow/></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mo>=</mo><msup><mrow><mo fence="true">(</mo><msup><mrow><mo fence="true">(</mo><mover accent="true"><mi>w</mi><mo>⃗</mo></mover><mo>⋅</mo><msup><mrow><mo fence="true">(</mo><msup><mover accent="true"><mi>x</mi><mo>⃗</mo></mover><mrow><mo>−</mo><mn>1</mn></mrow></msup><mo fence="true">)</mo></mrow><mrow><mo>−</mo><mi>p</mi></mrow></msup><mo fence="true">)</mo></mrow><mrow><mo>−</mo><mfrac><mn>1</mn><mi>p</mi></mfrac></mrow></msup><mo fence="true">)</mo></mrow><mrow><mo>−</mo><mn>1</mn></mrow></msup></mrow></mstyle></mtd></mtr><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow/></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mo>=</mo><msub><mi>M</mi><mrow><mo>−</mo><mi>p</mi><mo separator="true">,</mo><mover accent="true"><mi>w</mi><mo>⃗</mo></mover></mrow></msub><mtext> ⁣</mtext><msup><mrow><mo fence="true">(</mo><msup><mover accent="true"><mi>x</mi><mo>⃗</mo></mover><mrow><mo>−</mo><mn>1</mn></mrow></msup><mo fence="true">)</mo></mrow><mrow><mo>−</mo><mn>1</mn></mrow></msup></mrow></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mtext>(Definition 1)</mtext></mstyle></mtd></mtr></mtable><annotation encoding="application/x-tex">\begin{aligned}
M_{p,\vec w}\!\left(\vec x\right)
&amp;=\left(\vec w\cdot\vec x^p\right)^{\frac 1p}
&amp;\text{(Definition 1)}\\
&amp;=\left(\left(\vec w \cdot\left(\vec x^{-1}\right)^{-p}\right)^{-\frac1p}\right)^{-1}\\
&amp;=M_{-p,\vec w}\!\left(\vec x^{-1}\right)^{-1}
&amp;\text{(Definition 1)}
\end{aligned}</annotation></semantics></math></span></span></span> <span class="qed-wrapper qed-span"><span class="qed qed-span"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi mathvariant="normal">□</mi></mrow><annotation encoding="application/x-tex">\square</annotation></semantics></math></span></span></span></span>
</p>
<p class="no-indent">
<strong>Theorem 3</strong>. <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><munder><mrow><mi>lim</mi><mo>⁡</mo></mrow><mrow><mi>p</mi><mo>→</mo><mo>+</mo><mi mathvariant="normal">∞</mi></mrow></munder><msub><mi>M</mi><mrow><mi>p</mi><mo separator="true">,</mo><mover accent="true"><mi>w</mi><mo>⃗</mo></mover></mrow></msub><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mover accent="true"><mi>x</mi><mo>⃗</mo></mover><mo fence="true">)</mo></mrow><mo>=</mo><mi>max</mi><mo>⁡</mo><mover accent="true"><mi>x</mi><mo>⃗</mo></mover><mi mathvariant="normal">.</mi></mrow><annotation encoding="application/x-tex">\lim_{p\to+\infty}M_{p,\vec w}\!\left(\vec x\right)=\max\vec x.</annotation></semantics></math></span></span></span>
</p>
<p class="no-indent">
<em>Proof.</em> Because <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi mathvariant="normal">∀</mi><mi>k</mi><mo>:</mo><mfrac><msub><mi>x</mi><mi>k</mi></msub><mrow><mi>max</mi><mo>⁡</mo><mover accent="true"><mi>x</mi><mo>⃗</mo></mover></mrow></mfrac><mo>≤</mo><mn>1</mn></mrow><annotation encoding="application/x-tex">\forall k:\frac{x_k}{\max\vec x}\le1</annotation></semantics></math></span></span>, then <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><msub><mrow><mi>lim</mi><mo>⁡</mo></mrow><mrow><mi>p</mi><mo>→</mo><mo>+</mo><mi mathvariant="normal">∞</mi></mrow></msub><msup><mrow><mo fence="true">(</mo><mfrac><mover accent="true"><mi>x</mi><mo>⃗</mo></mover><mrow><mi>max</mi><mo>⁡</mo><mover accent="true"><mi>x</mi><mo>⃗</mo></mover></mrow></mfrac><mo fence="true">)</mo></mrow><mi>p</mi></msup><mo>=</mo><msub><mi>δ</mi><mrow><mi>max</mi><mo>⁡</mo><mover accent="true"><mi>x</mi><mo>⃗</mo></mover></mrow></msub><mo separator="true">,</mo><mover accent="true"><mi>x</mi><mo>⃗</mo></mover></mrow><annotation encoding="application/x-tex">\lim_{p\to+\infty}\left(\frac{\vec x}{\max\vec x}\right)^p=\delta_{\max\vec x},\vec x</annotation></semantics></math></span></span>. <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mtable rowspacing="0.25em" columnalign="right left right" columnspacing="0em 1em"><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><munder><mrow><mi>lim</mi><mo>⁡</mo></mrow><mrow><mi>p</mi><mo>→</mo><mo>+</mo><mi mathvariant="normal">∞</mi></mrow></munder><msub><mi>M</mi><mrow><mi>p</mi><mo separator="true">,</mo><mover accent="true"><mi>w</mi><mo>⃗</mo></mover></mrow></msub><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mover accent="true"><mi>x</mi><mo>⃗</mo></mover><mo fence="true">)</mo></mrow></mrow></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mo>=</mo><munder><mrow><mi>lim</mi><mo>⁡</mo></mrow><mrow><mi>p</mi><mo>→</mo><mo>+</mo><mi mathvariant="normal">∞</mi></mrow></munder><msup><mrow><mo fence="true">(</mo><mover accent="true"><mi>w</mi><mo>⃗</mo></mover><mo>⋅</mo><msup><mover accent="true"><mi>x</mi><mo>⃗</mo></mover><mi>p</mi></msup><mo fence="true">)</mo></mrow><mfrac><mn>1</mn><mi>p</mi></mfrac></msup></mrow></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mtext>(Definition 1)</mtext></mstyle></mtd></mtr><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow/></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mo>=</mo><mrow><mo fence="true">(</mo><mi>max</mi><mo>⁡</mo><mover accent="true"><mi>x</mi><mo>⃗</mo></mover><mo fence="true">)</mo></mrow><munder><mrow><mi>lim</mi><mo>⁡</mo></mrow><mrow><mi>p</mi><mo>→</mo><mo>+</mo><mi mathvariant="normal">∞</mi></mrow></munder><msup><mrow><mo fence="true">(</mo><mover accent="true"><mi>w</mi><mo>⃗</mo></mover><mo>⋅</mo><msup><mrow><mo fence="true">(</mo><mfrac><mover accent="true"><mi>x</mi><mo>⃗</mo></mover><mrow><mi>max</mi><mo>⁡</mo><mover accent="true"><mi>x</mi><mo>⃗</mo></mover></mrow></mfrac><mo fence="true">)</mo></mrow><mi>p</mi></msup><mo fence="true">)</mo></mrow><mfrac><mn>1</mn><mi>p</mi></mfrac></msup></mrow></mstyle></mtd></mtr><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow/></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mo>=</mo><mi>max</mi><mo>⁡</mo><mover accent="true"><mi>x</mi><mo>⃗</mo></mover><msup><mrow><mo fence="true">(</mo><mover accent="true"><mi>w</mi><mo>⃗</mo></mover><mo>⋅</mo><munder><mrow><mi>lim</mi><mo>⁡</mo></mrow><mrow><mi>p</mi><mo>→</mo><mo>+</mo><mi mathvariant="normal">∞</mi></mrow></munder><msup><mrow><mo fence="true">(</mo><mfrac><mi>x</mi><mrow><mi>max</mi><mo>⁡</mo><mover accent="true"><mi>x</mi><mo>⃗</mo></mover></mrow></mfrac><mo fence="true">)</mo></mrow><mi>p</mi></msup><mo fence="true">)</mo></mrow><mrow><munder><mrow><mi>lim</mi><mo>⁡</mo></mrow><mrow><mi>p</mi><mo>→</mo><mo>+</mo><mi mathvariant="normal">∞</mi></mrow></munder><mfrac><mn>1</mn><mi>p</mi></mfrac></mrow></msup></mrow></mstyle></mtd></mtr><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow/></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mo>=</mo><mrow><mo fence="true">(</mo><mi>max</mi><mo>⁡</mo><mover accent="true"><mi>x</mi><mo>⃗</mo></mover><mo fence="true">)</mo></mrow><msup><mrow><mo fence="true">(</mo><mover accent="true"><mi>w</mi><mo>⃗</mo></mover><mo>⋅</mo><msub><mi>δ</mi><mrow><mrow><mo fence="true">(</mo><mi>max</mi><mo>⁡</mo><mover accent="true"><mi>x</mi><mo>⃗</mo></mover><mo fence="true">)</mo></mrow><mo separator="true">,</mo><mover accent="true"><mi>x</mi><mo>⃗</mo></mover></mrow></msub><mo fence="true">)</mo></mrow><mn>0</mn></msup></mrow></mstyle></mtd></mtr><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow/></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mo>=</mo><mi>max</mi><mo>⁡</mo><mover accent="true"><mi>x</mi><mo>⃗</mo></mover><mi mathvariant="normal">.</mi></mrow></mstyle></mtd></mtr></mtable><annotation encoding="application/x-tex">\begin{aligned}
\lim_{p\to+\infty}M_{p,\vec w}\!\left(\vec x\right)
&amp;=\lim_{p\to+\infty}\left(\vec w\cdot\vec x^p\right)^{\frac 1p}
&amp;\text{(Definition 1)}\\
&amp;=\left(\max\vec x\right)\lim_{p\to+\infty}\left(\vec w\cdot\left(\frac{\vec x}{\max\vec x}\right)^p\right)^{\frac 1p}\\
&amp;=\max\vec x\left(\vec w\cdot\lim_{p\to+\infty}\left(\frac x{\max\vec x}\right)^p\right)^{\lim_{p\to+\infty}\frac 1p}\\
&amp;=\left(\max\vec x\right)\left(\vec w\cdot\delta_{\left(\max\vec x\right),\vec x}\right)^0\\
&amp;=\max\vec x.
\end{aligned}</annotation></semantics></math></span></span></span> <span class="qed-wrapper qed-last"><span class="qed qed-last"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi mathvariant="normal">□</mi></mrow><annotation encoding="application/x-tex">\square</annotation></semantics></math></span></span></span></span>
</p>
<p class="no-indent">
<strong>Theorem 4</strong>. <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><munder><mrow><mi>lim</mi><mo>⁡</mo></mrow><mrow><mi>p</mi><mo>→</mo><mo>−</mo><mi mathvariant="normal">∞</mi></mrow></munder><msub><mi>M</mi><mrow><mi>p</mi><mo separator="true">,</mo><mover accent="true"><mi>w</mi><mo>⃗</mo></mover></mrow></msub><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mover accent="true"><mi>x</mi><mo>⃗</mo></mover><mo fence="true">)</mo></mrow><mo>=</mo><mi>min</mi><mo>⁡</mo><mover accent="true"><mi>x</mi><mo>⃗</mo></mover><mi mathvariant="normal">.</mi></mrow><annotation encoding="application/x-tex">\lim_{p\to-\infty}M_{p,\vec w}\!\left(\vec x\right)=\min\vec x.</annotation></semantics></math></span></span></span>
</p>
<p class="no-indent">
<em>Proof.</em> <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mtable rowspacing="0.25em" columnalign="right left right" columnspacing="0em 1em"><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><munder><mrow><mi>lim</mi><mo>⁡</mo></mrow><mrow><mi>p</mi><mo>→</mo><mo>−</mo><mi mathvariant="normal">∞</mi></mrow></munder><msub><mi>M</mi><mrow><mi>p</mi><mo separator="true">,</mo><mover accent="true"><mi>w</mi><mo>⃗</mo></mover></mrow></msub><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mover accent="true"><mi>x</mi><mo>⃗</mo></mover><mo fence="true">)</mo></mrow></mrow></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mo>=</mo><munder><mrow><mi>lim</mi><mo>⁡</mo></mrow><mrow><mi>p</mi><mo>→</mo><mo>−</mo><mi mathvariant="normal">∞</mi></mrow></munder><msub><mi>M</mi><mrow><mo>−</mo><mi>p</mi><mo separator="true">,</mo><mover accent="true"><mi>w</mi><mo>⃗</mo></mover></mrow></msub><mtext> ⁣</mtext><msup><mrow><mo fence="true">(</mo><msup><mover accent="true"><mi>x</mi><mo>⃗</mo></mover><mrow><mo>−</mo><mn>1</mn></mrow></msup><mo fence="true">)</mo></mrow><mrow><mo>−</mo><mn>1</mn></mrow></msup></mrow></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mtext>(Theorem 2)</mtext></mstyle></mtd></mtr><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow/></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mo>=</mo><munder><mrow><mi>lim</mi><mo>⁡</mo></mrow><mrow><mi>p</mi><mo>→</mo><mo>+</mo><mi mathvariant="normal">∞</mi></mrow></munder><msub><mi>M</mi><mrow><mi>p</mi><mo separator="true">,</mo><mover accent="true"><mi>w</mi><mo>⃗</mo></mover></mrow></msub><mtext> ⁣</mtext><msup><mrow><mo fence="true">(</mo><msup><mover accent="true"><mi>x</mi><mo>⃗</mo></mover><mrow><mo>−</mo><mn>1</mn></mrow></msup><mo fence="true">)</mo></mrow><mrow><mo>−</mo><mn>1</mn></mrow></msup></mrow></mstyle></mtd></mtr><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow/></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mo>=</mo><mi>max</mi><mo>⁡</mo><msup><mrow><mo fence="true">(</mo><msup><mover accent="true"><mi>x</mi><mo>⃗</mo></mover><mrow><mo>−</mo><mn>1</mn></mrow></msup><mo fence="true">)</mo></mrow><mrow><mo>−</mo><mn>1</mn></mrow></msup></mrow></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mtext>(Theorem 3)</mtext></mstyle></mtd></mtr><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow/></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mo>=</mo><mi>min</mi><mo>⁡</mo><mover accent="true"><mi>x</mi><mo>⃗</mo></mover><mi mathvariant="normal">.</mi></mrow></mstyle></mtd></mtr></mtable><annotation encoding="application/x-tex">\begin{aligned}
\lim_{p\to-\infty}M_{p,\vec w}\!\left(\vec x\right)
&amp;=\lim_{p\to-\infty}M_{-p,\vec w}\!\left(\vec x^{-1}\right)^{-1}
&amp;\text{(Theorem 2)}\\
&amp;=\lim_{p\to+\infty}M_{p,\vec w}\!\left(\vec x^{-1}\right)^{-1}\\
&amp;=\max\left(\vec x^{-1}\right)^{-1}
&amp;\text{(Theorem 3)}\\
&amp;=\min\vec x.
\end{aligned}</annotation></semantics></math></span></span></span> <span class="qed-wrapper qed-last"><span class="qed qed-last"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi mathvariant="normal">□</mi></mrow><annotation encoding="application/x-tex">\square</annotation></semantics></math></span></span></span></span>
</p>
<p class="no-indent">
<strong>Theorem 5</strong>. If <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>p</mi><mo>&gt;</mo><mi>q</mi></mrow><annotation encoding="application/x-tex">p&gt;q</annotation></semantics></math></span></span>, then <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><msub><mi>M</mi><mrow><mi>p</mi><mo separator="true">,</mo><mover accent="true"><mi>w</mi><mo>⃗</mo></mover></mrow></msub><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mover accent="true"><mi>x</mi><mo>⃗</mo></mover><mo fence="true">)</mo></mrow><mo>≥</mo><msub><mi>M</mi><mrow><mi>q</mi><mo separator="true">,</mo><mover accent="true"><mi>w</mi><mo>⃗</mo></mover></mrow></msub><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mover accent="true"><mi>x</mi><mo>⃗</mo></mover><mo fence="true">)</mo></mrow><mo separator="true">,</mo></mrow><annotation encoding="application/x-tex">M_{p,\vec w}\!\left(\vec x\right)\ge M_{q,\vec w}\!\left(\vec x\right),</annotation></semantics></math></span></span></span> where the equality holds iff <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mover accent="true"><mi>x</mi><mo>⃗</mo></mover></mrow><annotation encoding="application/x-tex">\vec x</annotation></semantics></math></span></span> is congruent.
</p>
<p class="no-indent">
<em>Proof.</em> Case 1: <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>p</mi><mo>&gt;</mo><mi>q</mi><mo>&gt;</mo><mn>0</mn></mrow><annotation encoding="application/x-tex">p&gt;q&gt;0</annotation></semantics></math></span></span>.
</p>
<p>Let <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>f</mi><mo>:</mo><msup><mi mathvariant="double-struck">R</mi><mo>+</mo></msup><mo>→</mo><msup><mi mathvariant="double-struck">R</mi><mo>+</mo></msup><mo>:</mo><mi>ξ</mi><mo>↦</mo><msup><mi>ξ</mi><mfrac><mi>p</mi><mi>q</mi></mfrac></msup></mrow><annotation encoding="application/x-tex">f:\mathbb R^+\to\mathbb R^+:\xi\mapsto\xi^{\frac pq}</annotation></semantics></math></span></span>, then it has second derivative
<span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mfrac><mrow><msup><mi mathvariant="normal">d</mi><mn>2</mn></msup><mi>f</mi><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mi>ξ</mi><mo fence="true">)</mo></mrow></mrow><mrow><mi mathvariant="normal">d</mi><msup><mi>ξ</mi><mn>2</mn></msup></mrow></mfrac><mo>=</mo><mfrac><mi>p</mi><mi>q</mi></mfrac><mrow><mo fence="true">(</mo><mfrac><mi>p</mi><mi>q</mi></mfrac><mo>−</mo><mn>1</mn><mo fence="true">)</mo></mrow><msup><mi>ξ</mi><mrow><mfrac><mi>p</mi><mi>q</mi></mfrac><mo>−</mo><mn>2</mn></mrow></msup><mi mathvariant="normal">.</mi></mrow><annotation encoding="application/x-tex">\frac{\mathrm d^2f\!\left(\xi\right)}{\mathrm d\xi^2}=\frac pq\left(\frac pq-1\right)\xi^{\frac pq-2}.</annotation></semantics></math></span></span></span> Because <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>p</mi><mo>&gt;</mo><mi>q</mi><mo>&gt;</mo><mn>0</mn></mrow><annotation encoding="application/x-tex">p&gt;q&gt;0</annotation></semantics></math></span></span>, then
<span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mfrac><mi>p</mi><mi>q</mi></mfrac><mrow><mo fence="true">(</mo><mfrac><mi>p</mi><mi>q</mi></mfrac><mo>−</mo><mn>1</mn><mo fence="true">)</mo></mrow><mo>&gt;</mo><mn>0</mn></mrow><annotation encoding="application/x-tex">\frac pq\left(\frac pq-1\right)&gt;0</annotation></semantics></math></span></span>, and then <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mfrac><mrow><msup><mi mathvariant="normal">d</mi><mn>2</mn></msup><mi>f</mi></mrow><mrow><mi mathvariant="normal">d</mi><msup><mi>ξ</mi><mn>2</mn></msup></mrow></mfrac><mo>&gt;</mo><mn>0</mn></mrow><annotation encoding="application/x-tex">\frac{\mathrm d^2f}{\mathrm d\xi^2}&gt;0</annotation></semantics></math></span></span>, i.e. <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>f</mi></mrow><annotation encoding="application/x-tex">f</annotation></semantics></math></span></span> is convex. Therefore, according to Jensen’s inequality, <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mover accent="true"><mi>w</mi><mo>⃗</mo></mover><mo>⋅</mo><mi>f</mi><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><msup><mover accent="true"><mi>x</mi><mo>⃗</mo></mover><mi>q</mi></msup><mo fence="true">)</mo></mrow><mo>≥</mo><mi>f</mi><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mover accent="true"><mi>w</mi><mo>⃗</mo></mover><mo>⋅</mo><msup><mover accent="true"><mi>x</mi><mo>⃗</mo></mover><mi>q</mi></msup><mo fence="true">)</mo></mrow><mo separator="true">,</mo></mrow><annotation encoding="application/x-tex">\vec w\cdot f\!\left(\vec x^q\right)\ge f\!\left(\vec w\cdot\vec x^q\right),</annotation></semantics></math></span></span></span> i.e. <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mover accent="true"><mi>w</mi><mo>⃗</mo></mover><mo>⋅</mo><msup><mover accent="true"><mi>x</mi><mo>⃗</mo></mover><mi>p</mi></msup><mo>≥</mo><msup><mrow><mo fence="true">(</mo><mover accent="true"><mi>w</mi><mo>⃗</mo></mover><mo>⋅</mo><msup><mover accent="true"><mi>x</mi><mo>⃗</mo></mover><mi>q</mi></msup><mo fence="true">)</mo></mrow><mfrac><mi>p</mi><mi>q</mi></mfrac></msup><mi mathvariant="normal">.</mi></mrow><annotation encoding="application/x-tex">\vec w\cdot\vec x^p\ge\left(\vec w\cdot\vec x^q\right)^{\frac pq}.</annotation></semantics></math></span></span></span> Take <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mfrac><mn>1</mn><mi>p</mi></mfrac></mrow><annotation encoding="application/x-tex">\frac1p</annotation></semantics></math></span></span>th power to both sides of the equation. Without changing the direction of the inequality sign, we have <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mover accent="true"><mi>w</mi><mo>⃗</mo></mover><mo>⋅</mo><msup><mover accent="true"><mi>x</mi><mo>⃗</mo></mover><mi>p</mi></msup><mo>≥</mo><mover accent="true"><mi>w</mi><mo>⃗</mo></mover><mo>⋅</mo><msup><mover accent="true"><mi>x</mi><mo>⃗</mo></mover><mi>q</mi></msup><mo separator="true">,</mo></mrow><annotation encoding="application/x-tex">\vec w\cdot\vec x^p\ge\vec w\cdot\vec x^q,</annotation></semantics></math></span></span></span> i.e. (according to Definition 1) <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><msub><mi>M</mi><mrow><mi>p</mi><mo separator="true">,</mo><mover accent="true"><mi>w</mi><mo>⃗</mo></mover></mrow></msub><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mover accent="true"><mi>x</mi><mo>⃗</mo></mover><mo fence="true">)</mo></mrow><mo>≥</mo><msub><mi>M</mi><mrow><mi>q</mi><mo separator="true">,</mo><mover accent="true"><mi>w</mi><mo>⃗</mo></mover></mrow></msub><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mover accent="true"><mi>x</mi><mo>⃗</mo></mover><mo fence="true">)</mo></mrow><mi mathvariant="normal">.</mi></mrow><annotation encoding="application/x-tex">M_{p,\vec w}\!\left(\vec x\right)\ge M_{q,\vec w}\!\left(\vec x\right).</annotation></semantics></math></span></span></span> According to the condition for the equality to hold in Jensen’s inequality, the equality holds iff <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mover accent="true"><mi>x</mi><mo>⃗</mo></mover></mrow><annotation encoding="application/x-tex">\vec x</annotation></semantics></math></span></span> is congruent.</p>
<p>Case 2: <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>p</mi><mo>&gt;</mo><mi>q</mi><mo>=</mo><mn>0</mn></mrow><annotation encoding="application/x-tex">p&gt;q=0</annotation></semantics></math></span></span>.</p>
<p>Because the logarithm function is concave, according to Jensen’s inequality, <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mi>ln</mi><mo>⁡</mo><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mover accent="true"><mi>w</mi><mo>⃗</mo></mover><mo>⋅</mo><msup><mover accent="true"><mi>x</mi><mo>⃗</mo></mover><mi>p</mi></msup><mo fence="true">)</mo></mrow><mo>≥</mo><mover accent="true"><mi>w</mi><mo>⃗</mo></mover><mo>⋅</mo><mi>ln</mi><mo>⁡</mo><msup><mover accent="true"><mi>x</mi><mo>⃗</mo></mover><mi>p</mi></msup><mi mathvariant="normal">.</mi></mrow><annotation encoding="application/x-tex">\ln\!\left(\vec w\cdot\vec x^p\right)\ge\vec w\cdot\ln\vec x^p.</annotation></semantics></math></span></span></span> Take exponential on both sides of the equation, and we have <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mover accent="true"><mi>w</mi><mo>⃗</mo></mover><mo>⋅</mo><msup><mover accent="true"><mi>x</mi><mo>⃗</mo></mover><mi>p</mi></msup><mo>≥</mo><msup><mover accent="true"><mi>x</mi><mo>⃗</mo></mover><mrow><mi>p</mi><mover accent="true"><mi>w</mi><mo>⃗</mo></mover></mrow></msup><mi mathvariant="normal">.</mi></mrow><annotation encoding="application/x-tex">\vec w\cdot\vec x^p\ge\vec x^{p\vec w}.</annotation></semantics></math></span></span></span> Take <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mfrac><mn>1</mn><mi>p</mi></mfrac></mrow><annotation encoding="application/x-tex">\frac1p</annotation></semantics></math></span></span>th power to both sides of the equation. Without changing the direction of the inequality sign, we have <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><msup><mrow><mo fence="true">(</mo><mover accent="true"><mi>w</mi><mo>⃗</mo></mover><mo>⋅</mo><msup><mover accent="true"><mi>x</mi><mo>⃗</mo></mover><mi>p</mi></msup><mo fence="true">)</mo></mrow><mfrac><mn>1</mn><mi>p</mi></mfrac></msup><mo>≥</mo><msup><mover accent="true"><mi>x</mi><mo>⃗</mo></mover><mover accent="true"><mi>w</mi><mo>⃗</mo></mover></msup><mo separator="true">,</mo></mrow><annotation encoding="application/x-tex">\left(\vec w\cdot\vec x^p\right)^{\frac1p}\ge\vec x^{\vec w},</annotation></semantics></math></span></span></span> i.e. (according to Definition 1) <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><msub><mi>M</mi><mrow><mi>p</mi><mo separator="true">,</mo><mover accent="true"><mi>w</mi><mo>⃗</mo></mover></mrow></msub><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mover accent="true"><mi>x</mi><mo>⃗</mo></mover><mo fence="true">)</mo></mrow><mo>≥</mo><msub><mi>M</mi><mrow><mi>q</mi><mo separator="true">,</mo><mover accent="true"><mi>w</mi><mo>⃗</mo></mover></mrow></msub><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mover accent="true"><mi>x</mi><mo>⃗</mo></mover><mo fence="true">)</mo></mrow><mi mathvariant="normal">.</mi></mrow><annotation encoding="application/x-tex">M_{p,\vec w}\!\left(\vec x\right)\ge M_{q,\vec w}\!\left(\vec x\right).</annotation></semantics></math></span></span></span> According to the condition for the equality to hold in Jensen’s inequality, the equality holds iff <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mover accent="true"><mi>x</mi><mo>⃗</mo></mover></mrow><annotation encoding="application/x-tex">\vec x</annotation></semantics></math></span></span> is congruent.</p>
<p>Case 3: <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>p</mi><mo>=</mo><mn>0</mn><mo>&gt;</mo><mi>q</mi></mrow><annotation encoding="application/x-tex">p=0&gt;q</annotation></semantics></math></span></span>.</p>
<p><span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mtable rowspacing="0.25em" columnalign="right left right" columnspacing="0em 1em"><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><msub><mi>M</mi><mrow><mi>q</mi><mo separator="true">,</mo><mover accent="true"><mi>w</mi><mo>⃗</mo></mover></mrow></msub><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mover accent="true"><mi>x</mi><mo>⃗</mo></mover><mo fence="true">)</mo></mrow></mrow></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mo>=</mo><msub><mi>M</mi><mrow><mo>−</mo><mi>q</mi><mo separator="true">,</mo><mover accent="true"><mi>w</mi><mo>⃗</mo></mover></mrow></msub><mtext> ⁣</mtext><msup><mrow><mo fence="true">(</mo><msup><mover accent="true"><mi>x</mi><mo>⃗</mo></mover><mrow><mo>−</mo><mn>1</mn></mrow></msup><mo fence="true">)</mo></mrow><mrow><mo>−</mo><mn>1</mn></mrow></msup></mrow></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mtext>(Theorem 2)</mtext></mstyle></mtd></mtr><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow/></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mo>≤</mo><msub><mi>M</mi><mrow><mn>0</mn><mo separator="true">,</mo><mover accent="true"><mi>w</mi><mo>⃗</mo></mover></mrow></msub><mtext> ⁣</mtext><msup><mrow><mo fence="true">(</mo><msup><mover accent="true"><mi>x</mi><mo>⃗</mo></mover><mrow><mo>−</mo><mn>1</mn></mrow></msup><mo fence="true">)</mo></mrow><mrow><mo>−</mo><mn>1</mn></mrow></msup></mrow></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mtext>(Case 2)</mtext></mstyle></mtd></mtr><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow/></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mo>=</mo><msub><mi>M</mi><mrow><mn>0</mn><mo separator="true">,</mo><mover accent="true"><mi>w</mi><mo>⃗</mo></mover></mrow></msub><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mover accent="true"><mi>x</mi><mo>⃗</mo></mover><mo fence="true">)</mo></mrow><mi mathvariant="normal">.</mi></mrow></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mtext>(Theorem 2)</mtext></mstyle></mtd></mtr></mtable><annotation encoding="application/x-tex">\begin{align*}
M_{q,\vec w}\!\left(\vec x\right)
&amp;=M_{-q,\vec w}\!\left(\vec x^{-1}\right)^{-1}
&amp;\text{(Theorem 2)}\\
&amp;\le M_{0,\vec w}\!\left(\vec x^{-1}\right)^{-1}
&amp;\text{(Case 2)}\\
&amp;=M_{0,\vec w}\!\left(\vec x\right).
&amp;\text{(Theorem 2)}
\end{align*}</annotation></semantics></math></span></span></span> The equality holds iff <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mover accent="true"><mi>x</mi><mo>⃗</mo></mover></mrow><annotation encoding="application/x-tex">\vec x</annotation></semantics></math></span></span> is congruent (Case 2).</p>
<p>Case 4: <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mn>0</mn><mo>&gt;</mo><mi>p</mi><mo>&gt;</mo><mi>q</mi></mrow><annotation encoding="application/x-tex">0&gt;p&gt;q</annotation></semantics></math></span></span>.</p>
<p>Because <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mo>−</mo><mi>q</mi><mo>&gt;</mo><mo>−</mo><mi>p</mi><mo>&gt;</mo><mn>0</mn></mrow><annotation encoding="application/x-tex">-q&gt;-p&gt;0</annotation></semantics></math></span></span>, we have <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mtable rowspacing="0.25em" columnalign="right left right" columnspacing="0em 1em"><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><msub><mi>M</mi><mrow><mi>q</mi><mo separator="true">,</mo><mover accent="true"><mi>w</mi><mo>⃗</mo></mover></mrow></msub><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mover accent="true"><mi>x</mi><mo>⃗</mo></mover><mo fence="true">)</mo></mrow></mrow></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mo>=</mo><msub><mi>M</mi><mrow><mo>−</mo><mi>q</mi><mo separator="true">,</mo><mover accent="true"><mi>w</mi><mo>⃗</mo></mover></mrow></msub><mtext> ⁣</mtext><msup><mrow><mo fence="true">(</mo><msup><mover accent="true"><mi>x</mi><mo>⃗</mo></mover><mrow><mo>−</mo><mn>1</mn></mrow></msup><mo fence="true">)</mo></mrow><mrow><mo>−</mo><mn>1</mn></mrow></msup></mrow></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mtext>(Theorem 2)</mtext></mstyle></mtd></mtr><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow/></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mo>≤</mo><msub><mi>M</mi><mrow><mo>−</mo><mi>p</mi><mo separator="true">,</mo><mover accent="true"><mi>w</mi><mo>⃗</mo></mover></mrow></msub><mtext> ⁣</mtext><msup><mrow><mo fence="true">(</mo><msup><mover accent="true"><mi>x</mi><mo>⃗</mo></mover><mrow><mo>−</mo><mn>1</mn></mrow></msup><mo fence="true">)</mo></mrow><mrow><mo>−</mo><mn>1</mn></mrow></msup></mrow></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mtext>(Case 1)</mtext></mstyle></mtd></mtr><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow/></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mo>=</mo><msub><mi>M</mi><mrow><mi>p</mi><mo separator="true">,</mo><mover accent="true"><mi>w</mi><mo>⃗</mo></mover></mrow></msub><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mover accent="true"><mi>x</mi><mo>⃗</mo></mover><mo fence="true">)</mo></mrow><mi mathvariant="normal">.</mi></mrow></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mtext>(Theorem 2)</mtext></mstyle></mtd></mtr></mtable><annotation encoding="application/x-tex">\begin{align*}
M_{q,\vec w}\!\left(\vec x\right)
&amp;=M_{-q,\vec w}\!\left(\vec x^{-1}\right)^{-1}
&amp;\text{(Theorem 2)}\\
&amp;\le M_{-p,\vec w}\!\left(\vec x^{-1}\right)^{-1}
&amp;\text{(Case 1)}\\
&amp;=M_{p,\vec w}\!\left(\vec x\right).
&amp;\text{(Theorem 2)}
\end{align*}</annotation></semantics></math></span></span></span> The equality holds iff <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mover accent="true"><mi>x</mi><mo>⃗</mo></mover></mrow><annotation encoding="application/x-tex">\vec x</annotation></semantics></math></span></span> is congruent (Case 1).</p>
<p>By all 4 cases, the original proposition is proved. <span class="qed-wrapper qed-normal"><span class="qed qed-normal"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi mathvariant="normal">□</mi></mrow><annotation encoding="application/x-tex">\square</annotation></semantics></math></span></span></span></span></p>
<p class="no-indent">
<strong>Corollary</strong> (HM-GM-AM-QM inequalities)<strong>.</strong> <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mi>min</mi><mo>⁡</mo><mover accent="true"><mi>x</mi><mo>⃗</mo></mover><mo>≤</mo><mi>n</mi><msup><mrow><mo fence="true">(</mo><mo>∑</mo><msup><mover accent="true"><mi>x</mi><mo>⃗</mo></mover><mrow><mo>−</mo><mn>1</mn></mrow></msup><mo fence="true">)</mo></mrow><mrow><mo>−</mo><mn>1</mn></mrow></msup><mo>≤</mo><msup><mrow><mo fence="true">(</mo><mo>∏</mo><mover accent="true"><mi>x</mi><mo>⃗</mo></mover><mo fence="true">)</mo></mrow><mfrac><mn>1</mn><mi>n</mi></mfrac></msup><mo>≤</mo><mfrac><mrow><mo>∑</mo><mover accent="true"><mi>x</mi><mo>⃗</mo></mover></mrow><mi>n</mi></mfrac><mo>≤</mo><msqrt><mfrac><mrow><mo>∑</mo><msup><mover accent="true"><mi>x</mi><mo>⃗</mo></mover><mn>2</mn></msup></mrow><mi>n</mi></mfrac></msqrt><mo>≤</mo><mi>max</mi><mo>⁡</mo><mover accent="true"><mi>x</mi><mo>⃗</mo></mover><mo separator="true">,</mo></mrow><annotation encoding="application/x-tex">\min\vec x\le n\left(\sum\vec x^{-1}\right)^{-1}
\le\left(\prod\vec x\right)^\frac1n
\le\frac{\sum\vec x}n
\le\sqrt{\frac{\sum\vec x^2}{n}}
\le\max\vec x,</annotation></semantics></math></span></span></span> where the equality holds iff <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mover accent="true"><mi>x</mi><mo>⃗</mo></mover></mrow><annotation encoding="application/x-tex">\vec x</annotation></semantics></math></span></span> is congruent.
</p>
<p class="no-indent">
<em>Proof.</em> Let <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mover accent="true"><mi>w</mi><mo>⃗</mo></mover><mo>=</mo><mrow><mo fence="true">(</mo><mfrac><mn>1</mn><mi>n</mi></mfrac><mo separator="true">,</mo><mo>…</mo><mo separator="true">,</mo><mfrac><mn>1</mn><mi>n</mi></mfrac><mo fence="true">)</mo></mrow></mrow><annotation encoding="application/x-tex">\vec w=\left(\frac1n,\dots,\frac1n\right)</annotation></semantics></math></span></span>. Then according to Theorem 5, <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><msub><mi>M</mi><mrow><mo>−</mo><mi mathvariant="normal">∞</mi><mo separator="true">,</mo><mover accent="true"><mi>w</mi><mo>⃗</mo></mover></mrow></msub><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mover accent="true"><mi>x</mi><mo>⃗</mo></mover><mo fence="true">)</mo></mrow><mo>≤</mo><msub><mi>M</mi><mrow><mo>−</mo><mn>1</mn><mo separator="true">,</mo><mover accent="true"><mi>w</mi><mo>⃗</mo></mover></mrow></msub><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mover accent="true"><mi>x</mi><mo>⃗</mo></mover><mo fence="true">)</mo></mrow><mo>≤</mo><msub><mi>M</mi><mrow><mn>0</mn><mo separator="true">,</mo><mover accent="true"><mi>w</mi><mo>⃗</mo></mover></mrow></msub><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mover accent="true"><mi>x</mi><mo>⃗</mo></mover><mo fence="true">)</mo></mrow><mo>≤</mo><msub><mi>M</mi><mrow><mn>1</mn><mo separator="true">,</mo><mover accent="true"><mi>w</mi><mo>⃗</mo></mover></mrow></msub><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mover accent="true"><mi>x</mi><mo>⃗</mo></mover><mo fence="true">)</mo></mrow><mo>≤</mo><msub><mi>M</mi><mrow><mn>2</mn><mo separator="true">,</mo><mover accent="true"><mi>w</mi><mo>⃗</mo></mover></mrow></msub><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mover accent="true"><mi>x</mi><mo>⃗</mo></mover><mo fence="true">)</mo></mrow><mo>≤</mo><msub><mi>M</mi><mrow><mo>+</mo><mi mathvariant="normal">∞</mi><mo separator="true">,</mo><mover accent="true"><mi>w</mi><mo>⃗</mo></mover></mrow></msub><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mover accent="true"><mi>x</mi><mo>⃗</mo></mover><mo fence="true">)</mo></mrow><mo separator="true">,</mo></mrow><annotation encoding="application/x-tex">M_{-\infty,\vec w}\!\left(\vec x\right)
\le M_{-1,\vec w}\!\left(\vec x\right)
\le M_{0,\vec w}\!\left(\vec x\right)
\le M_{1,\vec w}\!\left(\vec x\right)
\le M_{2,\vec w}\!\left(\vec x\right)
\le M_{+\infty,\vec w}\!\left(\vec x\right),</annotation></semantics></math></span></span></span> i.e. (according to Definition 1) <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mi>min</mi><mo>⁡</mo><mover accent="true"><mi>x</mi><mo>⃗</mo></mover><mo>≤</mo><mi>n</mi><msup><mrow><mo fence="true">(</mo><mo>∑</mo><msup><mover accent="true"><mi>x</mi><mo>⃗</mo></mover><mrow><mo>−</mo><mn>1</mn></mrow></msup><mo fence="true">)</mo></mrow><mrow><mo>−</mo><mn>1</mn></mrow></msup><mo>≤</mo><msup><mrow><mo fence="true">(</mo><mo>∏</mo><mover accent="true"><mi>x</mi><mo>⃗</mo></mover><mo fence="true">)</mo></mrow><mfrac><mn>1</mn><mi>n</mi></mfrac></msup><mo>≤</mo><mfrac><mrow><mo>∑</mo><mover accent="true"><mi>x</mi><mo>⃗</mo></mover></mrow><mi>n</mi></mfrac><mo>≤</mo><msqrt><mfrac><mrow><mo>∑</mo><msup><mover accent="true"><mi>x</mi><mo>⃗</mo></mover><mn>2</mn></msup></mrow><mi>n</mi></mfrac></msqrt><mo>≤</mo><mi>max</mi><mo>⁡</mo><mover accent="true"><mi>x</mi><mo>⃗</mo></mover><mo separator="true">,</mo></mrow><annotation encoding="application/x-tex">\min\vec x\le n\left(\sum\vec x^{-1}\right)^{-1}
\le\left(\prod\vec x\right)^\frac1n
\le\frac{\sum\vec x}n
\le\sqrt{\frac{\sum\vec x^2}{n}}
\le\max\vec x,</annotation></semantics></math></span></span></span> where the equality holds iff <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mover accent="true"><mi>x</mi><mo>⃗</mo></mover></mrow><annotation encoding="application/x-tex">\vec x</annotation></semantics></math></span></span> is congruent (Theorem 5). <span class="qed-wrapper qed-normal"><span class="qed qed-normal"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi mathvariant="normal">□</mi></mrow><annotation encoding="application/x-tex">\square</annotation></semantics></math></span></span></span></span>
</p>]]></content><author><name>UlyssesZhan</name><email>ulysseszhan@gmail.com</email></author><category term="math" /><category term="calculus" /><category term="from zhihu" /><summary type="html"><![CDATA[The Hölder mean of <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mover accent="true"><mi>x</mi><mo>⃗</mo></mover></mrow><annotation encoding="application/x-tex">\vec x</annotation></semantics></math></span></span> with weights <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mover accent="true"><mi>w</mi><mo>⃗</mo></mover></mrow><annotation encoding="application/x-tex">\vec w</annotation></semantics></math></span></span> and a parameter <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>p</mi></mrow><annotation encoding="application/x-tex">p</annotation></semantics></math></span></span> is defined as <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><msub><mi>M</mi><mrow><mi>p</mi><mo separator="true">,</mo><mover accent="true"><mi>w</mi><mo>⃗</mo></mover></mrow></msub><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mover accent="true"><mi>x</mi><mo>⃗</mo></mover><mo fence="true">)</mo></mrow><mo><mi mathvariant="normal">≔</mi></mo><msup><mrow><mo fence="true">(</mo><mover accent="true"><mi>w</mi><mo>⃗</mo></mover><mo>⋅</mo><msup><mover accent="true"><mi>x</mi><mo>⃗</mo></mover><mi>p</mi></msup><mo fence="true">)</mo></mrow><mfrac><mn>1</mn><mi>p</mi></mfrac></msup></mrow><annotation encoding="application/x-tex">M_{p,\vec w}\!\left(\vec x\right)\coloneqq\left(\vec w\cdot\vec x^p\right)^{\frac 1p}</annotation></semantics></math></span></span>, and the value at <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>p</mi><mo>=</mo><mo>−</mo><mi mathvariant="normal">∞</mi><mo separator="true">,</mo><mn>0</mn><mo separator="true">,</mo><mo>+</mo><mi mathvariant="normal">∞</mi></mrow><annotation encoding="application/x-tex">p=-\infty,0,+\infty</annotation></semantics></math></span></span> are defined by the limits. We can prove using Jensen’s inquality that the Hölder mean increases as <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>p</mi></mrow><annotation encoding="application/x-tex">p</annotation></semantics></math></span></span> increases. This property can be used to prove HM-GM-AM-QM inequalities.]]></summary><media:thumbnail xmlns:media="http://search.yahoo.com/mrss/" url="https://ulysseszh.github.io/assets/images/covers/2022-11-11-holder-inequality.png" /><media:content medium="image" url="https://ulysseszh.github.io/assets/images/covers/2022-11-11-holder-inequality.png" xmlns:media="http://search.yahoo.com/mrss/" /></entry><entry><title type="html"><![CDATA[Solving linear homogeneous ODE with constant coefficients]]></title><link href="https://ulysseszh.github.io/math/2022/11/06/linear-ode-solution.html" rel="alternate" type="text/html" title="Solving linear homogeneous ODE with constant coefficients" /><published>2022-11-06T16:42:48-08:00</published><updated>2022-11-06T16:42:48-08:00</updated><id>https://ulysseszh.github.io/math/2022/11/06/linear-ode-solution</id><content type="html" xml:base="https://ulysseszh.github.io/math/2022/11/06/linear-ode-solution.html"><![CDATA[<p>
  <em>This article is translated from a Chinese <a href="https://zhuanlan.zhihu.com/p/60752992" target="_blank" rel="external">article</a> on my Zhihu account. The original article was posted at 2019-04-06 13:46 +0800.</em>
</p>
<p><em>Notice</em>: Because this article was written very early, there are many mistakes and inappropriate notations.</p>
<hr/>
<p>(I’m going to challenge writing articles without sum symbols!)</p>
<p>In this article, functions all refer to unary functions; both independent and dependent variables are scalars; and differentials refer to ordinary differentials.</p>
<p class="no-indent">
<strong>Definition 1</strong> (linear differential operator)<strong>.</strong> Let <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>L</mi><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mi mathvariant="normal">D</mi><mo separator="true">,</mo><mi>x</mi><mo fence="true">)</mo></mrow></mrow><annotation encoding="application/x-tex">L\!\left(\mathrm D,x\right)</annotation></semantics></math></span></span> be a differential operator. If for any two functions <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><msub><mi>F</mi><mn>1</mn></msub><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mi>x</mi><mo fence="true">)</mo></mrow><mo separator="true">,</mo><msub><mi>F</mi><mn>2</mn></msub><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mi>x</mi><mo fence="true">)</mo></mrow></mrow><annotation encoding="application/x-tex">F_1\!\left(x\right),F_2\!\left(x\right)</annotation></semantics></math></span></span> and constants <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><msub><mi>C</mi><mn>1</mn></msub><mo separator="true">,</mo><msub><mi>C</mi><mn>2</mn></msub></mrow><annotation encoding="application/x-tex">C_1,C_2</annotation></semantics></math></span></span>, the operator satisfies
<span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mi>L</mi><mrow><mo fence="true">(</mo><msub><mi>C</mi><mn>1</mn></msub><msub><mi>F</mi><mn>2</mn></msub><mo>+</mo><msub><mi>C</mi><mn>2</mn></msub><msub><mi>F</mi><mn>2</mn></msub><mo fence="true">)</mo></mrow><mo>=</mo><msub><mi>C</mi><mn>1</mn></msub><mi>L</mi><msub><mi>F</mi><mn>1</mn></msub><mo>+</mo><msub><mi>C</mi><mn>2</mn></msub><mi>L</mi><msub><mi>F</mi><mn>2</mn></msub><mo separator="true">,</mo></mrow><annotation encoding="application/x-tex">L\left(C_1F_2+C_2F_2\right)=C_1LF_1+C_2LF_2,</annotation></semantics></math></span></span></span> then <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>L</mi></mrow><annotation encoding="application/x-tex">L</annotation></semantics></math></span></span> is a linear differential operator.
</p>
<p class="no-indent">
<strong>Lemma 1.</strong> The sufficient and necessary condition for <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>L</mi></mrow><annotation encoding="application/x-tex">L</annotation></semantics></math></span></span> to be a linear differential operator is that for any tuple of functions <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mover accent="true"><mi>F</mi><mo>⃗</mo></mover><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mi>x</mi><mo fence="true">)</mo></mrow></mrow><annotation encoding="application/x-tex">\vec F\!\left(x\right)</annotation></semantics></math></span></span> and any tuple of constants <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mover accent="true"><mi>C</mi><mo>⃗</mo></mover></mrow><annotation encoding="application/x-tex">\vec C</annotation></semantics></math></span></span> (the dimensions of the two vectors are the same), the operator satisfies <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mi>L</mi><mrow><mo fence="true">(</mo><mover accent="true"><mi>C</mi><mo>⃗</mo></mover><mo>⋅</mo><mover accent="true"><mi>F</mi><mo>⃗</mo></mover><mo fence="true">)</mo></mrow><mo>=</mo><mover accent="true"><mi>C</mi><mo>⃗</mo></mover><mo>⋅</mo><mi>L</mi><mover accent="true"><mi>F</mi><mo>⃗</mo></mover><mi mathvariant="normal">.</mi></mrow><annotation encoding="application/x-tex">L\left(\vec C\cdot\vec F\right)=\vec C\cdot L\vec F.</annotation></semantics></math></span></span></span>
</p>
<p class="no-indent">
<em>Brief proof.</em> Directly letting <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mover accent="true"><mi>C</mi><mo>⃗</mo></mover></mrow><annotation encoding="application/x-tex">\vec C</annotation></semantics></math></span></span> and <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mover accent="true"><mi>F</mi><mo>⃗</mo></mover></mrow><annotation encoding="application/x-tex">\vec F</annotation></semantics></math></span></span> be 2-dimensional vectors and using Definition 1, the sufficiency can be proved; by using mathematical induction on the dimension of <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mover accent="true"><mi>C</mi><mo>⃗</mo></mover></mrow><annotation encoding="application/x-tex">\vec C</annotation></semantics></math></span></span> and <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mover accent="true"><mi>F</mi><mo>⃗</mo></mover></mrow><annotation encoding="application/x-tex">\vec F</annotation></semantics></math></span></span>, the necessity can be proved. <span class="qed-wrapper qed-normal"><span class="qed qed-normal"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi mathvariant="normal">□</mi></mrow><annotation encoding="application/x-tex">\square</annotation></semantics></math></span></span></span></span>
</p>
<p class="no-indent">
<strong>Definition 2.</strong> <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><msubsup><mover accent="true"><msub><mi>a</mi><mi>n</mi></msub><mo stretchy="true">→</mo></mover><mrow><mi>n</mi><mo>=</mo><mn>0</mn></mrow><mi>m</mi></msubsup><mo><mi mathvariant="normal">≔</mi></mo><mrow><mo fence="true">(</mo><msub><mi>a</mi><mn>0</mn></msub><mo separator="true">,</mo><msub><mi>a</mi><mn>1</mn></msub><mo separator="true">,</mo><mo>…</mo><mo separator="true">,</mo><msub><mi>a</mi><mi>m</mi></msub><mo fence="true">)</mo></mrow></mrow><annotation encoding="application/x-tex">\overrightarrow{a_n}_{n=0}^m\coloneqq\left(a_0,a_1,\ldots,a_m\right)</annotation></semantics></math></span></span>.
</p>
<p class="no-indent">
<strong>Lemma 2.</strong> Suppose the <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mo fence="true">(</mo><mi>m</mi><mo>+</mo><mn>1</mn><mo fence="true">)</mo></mrow><annotation encoding="application/x-tex">\left(m+1\right)</annotation></semantics></math></span></span>-dimensional vector <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mover accent="true"><mi>a</mi><mo>⃗</mo></mover></mrow><annotation encoding="application/x-tex">\vec a</annotation></semantics></math></span></span> is independent to <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>x</mi></mrow><annotation encoding="application/x-tex">x</annotation></semantics></math></span></span>, and <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><msubsup><mrow><mo fence="true">{</mo><msub><mi>f</mi><mi>n</mi></msub><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mi>x</mi><mo fence="true">)</mo></mrow><mo fence="true">}</mo></mrow><mrow><mi>n</mi><mo>=</mo><mn>0</mn></mrow><mi>s</mi></msubsup></mrow><annotation encoding="application/x-tex">\left\{f_n\!\left(x\right)\right\}_{n=0}^s</annotation></semantics></math></span></span> is a sequence of functions, then <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><msup><mi mathvariant="normal">D</mi><mi>k</mi></msup><mrow><mo fence="true">(</mo><mover accent="true"><mi>a</mi><mo>⃗</mo></mover><mo>⋅</mo><msubsup><mover accent="true"><mrow><msub><mi>f</mi><mi>n</mi></msub><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mi>x</mi><mo fence="true">)</mo></mrow></mrow><mo stretchy="true">→</mo></mover><mrow><mi>n</mi><mo>=</mo><mn>0</mn></mrow><mi>s</mi></msubsup><mo fence="true">)</mo></mrow><mo>=</mo><mover accent="true"><mi>a</mi><mo>⃗</mo></mover><mo>⋅</mo><msubsup><mover accent="true"><mrow><msup><mi mathvariant="normal">D</mi><mi>k</mi></msup><msub><mi>f</mi><mi>n</mi></msub><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mi>x</mi><mo fence="true">)</mo></mrow></mrow><mo stretchy="true">→</mo></mover><mrow><mi>n</mi><mo>=</mo><mn>0</mn></mrow><mi>s</mi></msubsup><mi mathvariant="normal">.</mi></mrow><annotation encoding="application/x-tex">\mathrm D^k\left(\vec a\cdot\overrightarrow{f_n\!\left(x\right)}_{n=0}^s\right)
=\vec a\cdot\overrightarrow{\mathrm D^kf_n\!\left(x\right)}_{n=0}^s.</annotation></semantics></math></span></span></span>
</p>
<p class="no-indent">
<em>Brief proof.</em> By mathematical induction. <span class="qed-wrapper qed-normal"><span class="qed qed-normal"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi mathvariant="normal">□</mi></mrow><annotation encoding="application/x-tex">\square</annotation></semantics></math></span></span></span></span>
</p>
<p class="no-indent">
<strong>Lemma 3.</strong> Suppose <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mover accent="true"><mi>P</mi><mo>⃗</mo></mover></mrow><annotation encoding="application/x-tex">\vec P</annotation></semantics></math></span></span> is a tuple of functions w.r.t. <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>x</mi></mrow><annotation encoding="application/x-tex">x</annotation></semantics></math></span></span>, and the dimension of <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mover accent="true"><mi>P</mi><mo>⃗</mo></mover></mrow><annotation encoding="application/x-tex">\vec P</annotation></semantics></math></span></span> is <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>m</mi><mo>+</mo><mn>1</mn></mrow><annotation encoding="application/x-tex">m+1</annotation></semantics></math></span></span>, then the differential operator <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mi>L</mi><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mi mathvariant="normal">D</mi><mo separator="true">,</mo><mi>x</mi><mo fence="true">)</mo></mrow><mo><mi mathvariant="normal">≔</mi></mo><mover accent="true"><mi>P</mi><mo>⃗</mo></mover><mo>⋅</mo><msubsup><mover accent="true"><msup><mi mathvariant="normal">D</mi><mi>k</mi></msup><mo stretchy="true">→</mo></mover><mrow><mi>k</mi><mo>=</mo><mn>0</mn></mrow><mi>m</mi></msubsup></mrow><annotation encoding="application/x-tex">L\!\left(\mathrm D,x\right)\coloneqq\vec P\cdot\overrightarrow{\mathrm D^k}^m_{k=0}</annotation></semantics></math></span></span></span> is a linear differential operator.
</p>
<p class="no-indent">
<em>Brief proof.</em> By Definition 1. <span class="qed-wrapper qed-normal"><span class="qed qed-normal"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi mathvariant="normal">□</mi></mrow><annotation encoding="application/x-tex">\square</annotation></semantics></math></span></span></span></span>
</p>
<p class="no-indent">
<strong>Corollary of Lemma 3.</strong> Suppose <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mover accent="true"><mi>p</mi><mo>⃗</mo></mover></mrow><annotation encoding="application/x-tex">\vec p</annotation></semantics></math></span></span> is a constant <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mo fence="true">(</mo><mi>m</mi><mo>+</mo><mn>1</mn><mo fence="true">)</mo></mrow><annotation encoding="application/x-tex">\left(m+1\right)</annotation></semantics></math></span></span>-dimensional vector, then the differential operator <span id="eq:lin-diff-op-w-const-coef" data-label="(1)"><span class="katex-display-table"> <span class="katex-display-numbered"><span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mi>L</mi><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mi mathvariant="normal">D</mi><mo fence="true">)</mo></mrow><mo><mi mathvariant="normal">≔</mi></mo><mover accent="true"><mi>p</mi><mo>⃗</mo></mover><mo>⋅</mo><msubsup><mover accent="true"><msup><mi mathvariant="normal">D</mi><mi>k</mi></msup><mo stretchy="true">→</mo></mover><mrow><mi>k</mi><mo>=</mo><mn>0</mn></mrow><mi>m</mi></msubsup></mrow><annotation encoding="application/x-tex">L\!\left(\mathrm D\right)\coloneqq\vec p\cdot\overrightarrow{\mathrm D^k}^m_{k=0}</annotation></semantics></math></span></span></span></span> <span class="katex-display-number"><span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mo stretchy="false">(</mo><mn>1</mn><mo stretchy="false">)</mo></mrow><annotation encoding="application/x-tex">(1)</annotation></semantics></math></span></span></span></span> </span></span> is a linear differential operator.
</p>
<p class="no-indent">
<strong>Lemma 4</strong> (associativity)<strong>.</strong> <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><msubsup><mover accent="true"><mrow><msub><mi>a</mi><mi>k</mi></msub><msub><mi>b</mi><mi>k</mi></msub></mrow><mo stretchy="true">→</mo></mover><mrow><mi>k</mi><mo>=</mo><mn>0</mn></mrow><mi>m</mi></msubsup><mo>⋅</mo><msubsup><mover accent="true"><msub><mi>c</mi><mi>k</mi></msub><mo stretchy="true">→</mo></mover><mrow><mi>k</mi><mo>=</mo><mn>0</mn></mrow><mi>m</mi></msubsup><mo>=</mo><msubsup><mover accent="true"><msub><mi>a</mi><mi>k</mi></msub><mo stretchy="true">→</mo></mover><mrow><mi>k</mi><mo>=</mo><mn>0</mn></mrow><mi>m</mi></msubsup><mo>⋅</mo><msubsup><mover accent="true"><mrow><msub><mi>b</mi><mi>k</mi></msub><msub><mi>c</mi><mi>k</mi></msub></mrow><mo stretchy="true">→</mo></mover><mrow><mi>k</mi><mo>=</mo><mn>0</mn></mrow><mi>m</mi></msubsup><mi mathvariant="normal">.</mi></mrow><annotation encoding="application/x-tex">\overrightarrow{a_kb_k}_{k=0}^m\cdot\overrightarrow{c_k}_{k=0}^m
=\overrightarrow{a_k}_{k=0}^m\cdot\overrightarrow{b_kc_k}_{k=0}^m.</annotation></semantics></math></span></span></span>
</p>
<p>Proof is omitted.</p>
<p class="no-indent">
<strong>Definition 3</strong> (linear differential operator with constant coefficients)<strong>.</strong> Linear differential operators with form as Equation <a href="#eq:lin-diff-op-w-const-coef">1</a> are called linear differential operators with constant coefficients.
</p>
<p class="no-indent">
<strong>Definition 4</strong> (linear ODE)<strong>.</strong> Suppose <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>L</mi></mrow><annotation encoding="application/x-tex">L</annotation></semantics></math></span></span> is a linear differential operator. Then the ODE w.r.t. the function <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>y</mi><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mi>x</mi><mo fence="true">)</mo></mrow></mrow><annotation encoding="application/x-tex">y\!\left(x\right)</annotation></semantics></math></span></span> <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mi>L</mi><mi>y</mi><mo>=</mo><mi>f</mi></mrow><annotation encoding="application/x-tex">Ly=f</annotation></semantics></math></span></span></span> is called a linear ODE, where <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>f</mi><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mi>x</mi><mo fence="true">)</mo></mrow></mrow><annotation encoding="application/x-tex">f\!\left(x\right)</annotation></semantics></math></span></span> is a function.
</p>
<p>Specially, if <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>f</mi><mo>=</mo><mn>0</mn></mrow><annotation encoding="application/x-tex">f=0</annotation></semantics></math></span></span>, the ODE is called a homogeneous linear ODE. If <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>L</mi></mrow><annotation encoding="application/x-tex">L</annotation></semantics></math></span></span> is a linear differential operator with constant coefficients, then the ODE is called a linear ODE with constant coefficients.</p>
<p class="no-indent">
<strong>Definition 5</strong> (generating function)<strong>.</strong> For a sequence <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><msubsup><mrow><mo fence="true">{</mo><msub><mi>a</mi><mi>n</mi></msub><mo fence="true">}</mo></mrow><mrow><mi>n</mi><mo>=</mo><mn>0</mn></mrow><mi mathvariant="normal">∞</mi></msubsup></mrow><annotation encoding="application/x-tex">\left\{a_n\right\}_{n=0}^\infty</annotation></semantics></math></span></span>, the function <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mi>G</mi><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mi>x</mi><mo fence="true">)</mo></mrow><mo><mi mathvariant="normal">≔</mi></mo><msubsup><mover accent="true"><msub><mi>a</mi><mi>n</mi></msub><mo stretchy="true">→</mo></mover><mrow><mi>n</mi><mo>=</mo><mn>0</mn></mrow><mi mathvariant="normal">∞</mi></msubsup><mo>⋅</mo><msubsup><mover accent="true"><msup><mi>x</mi><mi>n</mi></msup><mo stretchy="true">→</mo></mover><mrow><mi>n</mi><mo>=</mo><mn>0</mn></mrow><mi mathvariant="normal">∞</mi></msubsup></mrow><annotation encoding="application/x-tex">G\!\left(x\right)\coloneqq\overrightarrow{a_n}_{n=0}^\infty\cdot\overrightarrow{x^n}_{n=0}^\infty</annotation></semantics></math></span></span></span> is called the (ordinary) generating function (OGF) of the sequence.
</p>
<p><em>Note.</em> here we do not introduce vectors with infinite dimensions. Actually,</p>
<p>
  <span class="katex-display">
    <span class="katex">
      <span class="katex-mathml">
        <math xmlns="http://www.w3.org/1998/Math/MathML" display="block">
          <semantics>
            <mrow>
              <mi>G</mi>
              <mtext> ⁣</mtext>
              <mrow>
                <mo fence="true">(</mo>
                <mi>x</mi>
                <mo fence="true">)</mo>
              </mrow>
              <mo>
                <mi mathvariant="normal">≔</mi>
              </mo>
              <munder>
                <mrow>
                  <mi>lim</mi>
                  <mo>⁡</mo>
                </mrow>
                <mrow>
                  <mi>s</mi>
                  <mo>→</mo>
                  <mi mathvariant="normal">∞</mi>
                </mrow>
              </munder>
              <msubsup>
                <mover accent="true">
                  <msub>
                    <mi>a</mi>
                    <mi>n</mi>
                  </msub>
                  <mo stretchy="true">→</mo>
                </mover>
                <mrow>
                  <mi>n</mi>
                  <mo>=</mo>
                  <mn>0</mn>
                </mrow>
                <mi>s</mi>
              </msubsup>
              <mo>⋅</mo>
              <msubsup>
                <mover accent="true">
                  <msup>
                    <mi>x</mi>
                    <mi>n</mi>
                  </msup>
                  <mo stretchy="true">→</mo>
                </mover>
                <mrow>
                  <mi>n</mi>
                  <mo>=</mo>
                  <mn>0</mn>
                </mrow>
                <mi>s</mi>
              </msubsup>
              <mi mathvariant="normal">.</mi>
            </mrow>
            <annotation encoding="application/x-tex">G\!\left(x\right)\coloneqq\lim_{s\to\infty}\overrightarrow{a_n}_{n=0}^s\cdot\overrightarrow{x^n}_{n=0}^s.</annotation>
          </semantics>
        </math>
      </span>
    </span>
  </span>
</p>
<p class="no-indent">
<strong>Definition 6</strong> (exponential generating function)<strong>.</strong> For a sequence <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><msubsup><mrow><mo fence="true">{</mo><msub><mi>a</mi><mi>n</mi></msub><mo fence="true">}</mo></mrow><mrow><mi>n</mi><mo>=</mo><mn>0</mn></mrow><mi mathvariant="normal">∞</mi></msubsup></mrow><annotation encoding="application/x-tex">\left\{a_n\right\}_{n=0}^\infty</annotation></semantics></math></span></span>, the OGF of the sequence <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><msubsup><mrow><mo fence="true">{</mo><mfrac><msub><mi>a</mi><mi>n</mi></msub><mrow><mi>n</mi><mo stretchy="false">!</mo></mrow></mfrac><mo fence="true">}</mo></mrow><mrow><mi>n</mi><mo>=</mo><mn>0</mn></mrow><mi mathvariant="normal">∞</mi></msubsup></mrow><annotation encoding="application/x-tex">\left\{\frac{a_n}{n!}\right\}_{n=0}^\infty</annotation></semantics></math></span></span> is called the exponential generating function (EGF) of the sequence <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><msubsup><mrow><mo fence="true">{</mo><msub><mi>a</mi><mi>n</mi></msub><mo fence="true">}</mo></mrow><mrow><mi>n</mi><mo>=</mo><mn>0</mn></mrow><mi mathvariant="normal">∞</mi></msubsup></mrow><annotation encoding="application/x-tex">\left\{a_n\right\}_{n=0}^\infty</annotation></semantics></math></span></span>. In other words,
<span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mi>G</mi><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mi>x</mi><mo fence="true">)</mo></mrow><mo><mi mathvariant="normal">≔</mi></mo><msubsup><mover accent="true"><mfrac><msub><mi>a</mi><mi>n</mi></msub><mrow><mi>n</mi><mo stretchy="false">!</mo></mrow></mfrac><mo stretchy="true">→</mo></mover><mrow><mi>n</mi><mo>=</mo><mn>0</mn></mrow><mi mathvariant="normal">∞</mi></msubsup><mo>⋅</mo><msubsup><mover accent="true"><msup><mi>x</mi><mi>n</mi></msup><mo stretchy="true">→</mo></mover><mrow><mi>n</mi><mo>=</mo><mn>0</mn></mrow><mi mathvariant="normal">∞</mi></msubsup><mi mathvariant="normal">.</mi></mrow><annotation encoding="application/x-tex">G\!\left(x\right)\coloneqq\overrightarrow{\frac{a_n}{n!}}_{n=0}^\infty\cdot\overrightarrow{x^n}_{n=0}^\infty.</annotation></semantics></math></span></span></span>
</p>
<p class="no-indent">
<strong>Lemma 5</strong> (differential of power functions)<strong>.</strong> Suppose <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>n</mi><mo separator="true">,</mo><mi>k</mi><mo>∈</mo><mi mathvariant="double-struck">N</mi></mrow><annotation encoding="application/x-tex">n,k\in\mathbb N</annotation></semantics></math></span></span>, then <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><msup><mi mathvariant="normal">D</mi><mi>k</mi></msup><mrow><mo fence="true">(</mo><msup><mi>x</mi><mi>n</mi></msup><mo fence="true">)</mo></mrow><mo>=</mo><mfrac><mrow><mi>n</mi><mo stretchy="false">!</mo></mrow><mrow><mrow><mo fence="true">(</mo><mi>n</mi><mo>−</mo><mi>k</mi><mo fence="true">)</mo></mrow><mo stretchy="false">!</mo></mrow></mfrac><msup><mi>x</mi><mrow><mi>n</mi><mo>−</mo><mi>k</mi></mrow></msup><mi mathvariant="normal">.</mi></mrow><annotation encoding="application/x-tex">\mathrm D^k\left(x^n\right)=\frac{n!}{\left(n-k\right)!}x^{n-k}.</annotation></semantics></math></span></span></span>
</p>
<p><em>Note.</em> it is stipulated that factorials of negative integers are infinity, so <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><msup><mi mathvariant="normal">D</mi><mi>k</mi></msup><mrow><mo fence="true">(</mo><msup><mi>x</mi><mi>n</mi></msup><mo fence="true">)</mo></mrow><mo>=</mo><mn>0</mn></mrow><annotation encoding="application/x-tex">\mathrm D^k\left(x^n\right)=0</annotation></semantics></math></span></span> when <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>n</mi><mo>&lt;</mo><mi>k</mi></mrow><annotation encoding="application/x-tex">n&lt;k</annotation></semantics></math></span></span>.</p>
<p class="no-indent">
<em>Brief proof.</em> By mathematical induction. <span class="qed-wrapper qed-normal"><span class="qed qed-normal"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi mathvariant="normal">□</mi></mrow><annotation encoding="application/x-tex">\square</annotation></semantics></math></span></span></span></span>
</p>
<p class="no-indent">
<strong>Lemma 6</strong> (differential of EGF)<strong>.</strong> If <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>G</mi><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mi>x</mi><mo fence="true">)</mo></mrow></mrow><annotation encoding="application/x-tex">G\!\left(x\right)</annotation></semantics></math></span></span> is the EGF of a sequence <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><msubsup><mrow><mo fence="true">{</mo><msub><mi>a</mi><mi>n</mi></msub><mo fence="true">}</mo></mrow><mrow><mi>n</mi><mo>=</mo><mn>0</mn></mrow><mi mathvariant="normal">∞</mi></msubsup></mrow><annotation encoding="application/x-tex">\left\{a_n\right\}_{n=0}^\infty</annotation></semantics></math></span></span>, then <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><msup><mi mathvariant="normal">D</mi><mi>k</mi></msup><mi>G</mi></mrow><annotation encoding="application/x-tex">\mathrm D^kG</annotation></semantics></math></span></span> is the EGF of <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><msubsup><mrow><mo fence="true">{</mo><msub><mi>a</mi><mrow><mi>n</mi><mo>+</mo><mi>k</mi></mrow></msub><mo fence="true">}</mo></mrow><mrow><mi>n</mi><mo>=</mo><mn>0</mn></mrow><mi mathvariant="normal">∞</mi></msubsup></mrow><annotation encoding="application/x-tex">\left\{a_{n+k}\right\}_{n=0}^\infty</annotation></semantics></math></span></span>.
</p>
<p class="no-indent">
<em>Proof.</em> <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mtable rowspacing="0.25em" columnalign="right left right" columnspacing="0em 1em"><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><msup><mi mathvariant="normal">D</mi><mi>k</mi></msup><mi>G</mi></mrow></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mo>=</mo><msup><mi mathvariant="normal">D</mi><mi>k</mi></msup><mrow><mo fence="true">(</mo><msubsup><mover accent="true"><mfrac><msub><mi>a</mi><mi>n</mi></msub><mrow><mi>n</mi><mo stretchy="false">!</mo></mrow></mfrac><mo stretchy="true">→</mo></mover><mrow><mi>n</mi><mo>=</mo><mn>0</mn></mrow><mi mathvariant="normal">∞</mi></msubsup><mo>⋅</mo><msubsup><mover accent="true"><msup><mi>x</mi><mi>n</mi></msup><mo stretchy="true">→</mo></mover><mrow><mi>n</mi><mo>=</mo><mn>0</mn></mrow><mi mathvariant="normal">∞</mi></msubsup><mo fence="true">)</mo></mrow></mrow></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mtext>(Definition 6)</mtext></mstyle></mtd></mtr><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow/></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mo>=</mo><msubsup><mover accent="true"><mfrac><msub><mi>a</mi><mi>n</mi></msub><mrow><mi>n</mi><mo stretchy="false">!</mo></mrow></mfrac><mo stretchy="true">→</mo></mover><mrow><mi>n</mi><mo>=</mo><mn>0</mn></mrow><mi mathvariant="normal">∞</mi></msubsup><mo>⋅</mo><msubsup><mover accent="true"><mrow><msup><mi mathvariant="normal">D</mi><mi>k</mi></msup><mrow><mo fence="true">(</mo><msup><mi>x</mi><mi>n</mi></msup><mo fence="true">)</mo></mrow></mrow><mo stretchy="true">→</mo></mover><mrow><mi>n</mi><mo>=</mo><mn>0</mn></mrow><mi mathvariant="normal">∞</mi></msubsup></mrow></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mtext>(Lemma 2)</mtext></mstyle></mtd></mtr><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow/></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mo>=</mo><msubsup><mover accent="true"><mfrac><msub><mi>a</mi><mi>n</mi></msub><mrow><mi>n</mi><mo stretchy="false">!</mo></mrow></mfrac><mo stretchy="true">→</mo></mover><mrow><mi>n</mi><mo>=</mo><mn>0</mn></mrow><mi mathvariant="normal">∞</mi></msubsup><mo>⋅</mo><msubsup><mover accent="true"><mrow><mfrac><mrow><mi>n</mi><mo stretchy="false">!</mo></mrow><mrow><mrow><mo fence="true">(</mo><mi>n</mi><mo>−</mo><mi>k</mi><mo fence="true">)</mo></mrow><mo stretchy="false">!</mo></mrow></mfrac><msup><mi>x</mi><mrow><mi>n</mi><mo>−</mo><mi>k</mi></mrow></msup></mrow><mo stretchy="true">→</mo></mover><mrow><mi>n</mi><mo>=</mo><mn>0</mn></mrow><mi mathvariant="normal">∞</mi></msubsup></mrow></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mtext>(Lemma 5)</mtext></mstyle></mtd></mtr><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow/></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mo>=</mo><msubsup><mover accent="true"><mfrac><msub><mi>a</mi><mi>n</mi></msub><mrow><mrow><mo fence="true">(</mo><mi>n</mi><mo>−</mo><mi>k</mi><mo fence="true">)</mo></mrow><mo stretchy="false">!</mo></mrow></mfrac><mo stretchy="true">→</mo></mover><mrow><mi>n</mi><mo>=</mo><mn>0</mn></mrow><mi mathvariant="normal">∞</mi></msubsup><mo>⋅</mo><msubsup><mover accent="true"><msup><mi>x</mi><mrow><mi>n</mi><mo>−</mo><mi>k</mi></mrow></msup><mo stretchy="true">→</mo></mover><mrow><mi>n</mi><mo>=</mo><mn>0</mn></mrow><mi mathvariant="normal">∞</mi></msubsup></mrow></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mtext>(Lemma 4)</mtext></mstyle></mtd></mtr><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow/></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mo>=</mo><msubsup><mover accent="true"><mfrac><msub><mi>a</mi><mrow><mi>n</mi><mo>+</mo><mi>k</mi></mrow></msub><mrow><mi>n</mi><mo stretchy="false">!</mo></mrow></mfrac><mo stretchy="true">→</mo></mover><mrow><mi>n</mi><mo>=</mo><mn>0</mn></mrow><mi mathvariant="normal">∞</mi></msubsup><mo>⋅</mo><msubsup><mover accent="true"><msup><mi>x</mi><mi>n</mi></msup><mo stretchy="true">→</mo></mover><mrow><mi>n</mi><mo>=</mo><mn>0</mn></mrow><mi mathvariant="normal">∞</mi></msubsup><mi mathvariant="normal">.</mi></mrow></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mtext>(note in Lemma 5)</mtext></mstyle></mtd></mtr></mtable><annotation encoding="application/x-tex">\begin{align*}
\mathrm D^kG&amp;=\mathrm D^k\left(\overrightarrow{\frac{a_n}{n!}}_{n=0}^\infty\cdot\overrightarrow{x^n}_{n=0}^\infty\right)
&amp;\text{(Definition 6)}\\
&amp;=\overrightarrow{\frac{a_n}{n!}}_{n=0}^\infty\cdot\overrightarrow{\mathrm D^k\left(x^n\right)}_{n=0}^\infty&amp;
\text{(Lemma 2)}\\
&amp;=\overrightarrow{\frac{a_n}{n!}}_{n=0}^\infty\cdot\overrightarrow{\frac{n!}{\left(n-k\right)!}x^{n-k}}_{n=0}^\infty&amp;
\text{(Lemma 5)}\\
&amp;=\overrightarrow{\frac{a_n}{\left(n-k\right)!}}_{n=0}^\infty\cdot\overrightarrow{x^{n-k}}_{n=0}^\infty&amp;
\text{(Lemma 4)}\\
&amp;=\overrightarrow{\frac{a_{n+k}}{n!}}_{n=0}^\infty\cdot\overrightarrow{x^n}_{n=0}^\infty.&amp;
\text{(note in Lemma 5)}
\end{align*}</annotation></semantics></math></span></span></span> Then the result can be proved by Definition 6. <span class="qed-wrapper qed-normal"><span class="qed qed-normal"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi mathvariant="normal">□</mi></mrow><annotation encoding="application/x-tex">\square</annotation></semantics></math></span></span></span></span>
</p>
<p class="no-indent">
<strong>Corollary to Lemma 6.</strong> <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><msubsup><mover accent="true"><msup><mi mathvariant="normal">D</mi><mi>k</mi></msup><mo stretchy="true">→</mo></mover><mrow><mi>k</mi><mo>=</mo><mn>0</mn></mrow><mi>m</mi></msubsup><mrow><mo fence="true">(</mo><msubsup><mover accent="true"><mfrac><msub><mi>a</mi><mi>n</mi></msub><mrow><mi>n</mi><mo stretchy="false">!</mo></mrow></mfrac><mo stretchy="true">→</mo></mover><mrow><mi>n</mi><mo>=</mo><mn>0</mn></mrow><mi mathvariant="normal">∞</mi></msubsup><mo>⋅</mo><msubsup><mover accent="true"><msup><mi>x</mi><mi>n</mi></msup><mo stretchy="true">→</mo></mover><mrow><mi>n</mi><mo>=</mo><mn>0</mn></mrow><mi mathvariant="normal">∞</mi></msubsup><mo fence="true">)</mo></mrow><mo>=</mo><msubsup><mover accent="true"><mrow><msubsup><mover accent="true"><mfrac><msub><mi>a</mi><mrow><mi>n</mi><mo>+</mo><mi>k</mi></mrow></msub><mrow><mi>n</mi><mo stretchy="false">!</mo></mrow></mfrac><mo stretchy="true">→</mo></mover><mrow><mi>n</mi><mo>=</mo><mn>0</mn></mrow><mi mathvariant="normal">∞</mi></msubsup><mo>⋅</mo><msubsup><mover accent="true"><msup><mi>x</mi><mi>n</mi></msup><mo stretchy="true">→</mo></mover><mrow><mi>n</mi><mo>=</mo><mn>0</mn></mrow><mi mathvariant="normal">∞</mi></msubsup></mrow><mo stretchy="true">→</mo></mover><mrow><mi>k</mi><mo>=</mo><mn>0</mn></mrow><mi mathvariant="normal">∞</mi></msubsup><mi mathvariant="normal">.</mi></mrow><annotation encoding="application/x-tex">\overrightarrow{\mathrm D^k}_{k=0}^m\left(\overrightarrow{\frac{a_n}{n!}}_{n=0}^\infty\cdot\overrightarrow{x^n}_{n=0}^\infty\right)
=\overrightarrow{\overrightarrow{\frac{a_{n+k}}{n!}}_{n=0}^\infty\cdot\overrightarrow{x^n}_{n=0}^\infty}_{k=0}^\infty.</annotation></semantics></math></span></span></span>
</p>
<p class="no-indent">
<strong>Lemma 7</strong> (associativity)<strong>.</strong> <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><msubsup><mover accent="true"><mrow><mover accent="true"><mi>a</mi><mo>⃗</mo></mover><mo>⋅</mo><msubsup><mover accent="true"><msub><mi>b</mi><mrow><mi>n</mi><mo separator="true">,</mo><mi>k</mi></mrow></msub><mo stretchy="true">→</mo></mover><mrow><mi>k</mi><mo>=</mo><mn>0</mn></mrow><mi>m</mi></msubsup></mrow><mo stretchy="true">→</mo></mover><mrow><mi>n</mi><mo>=</mo><mn>0</mn></mrow><mi>s</mi></msubsup><mo>⋅</mo><mover accent="true"><mi>c</mi><mo>⃗</mo></mover><mo>=</mo><mover accent="true"><mi>a</mi><mo>⃗</mo></mover><mo>⋅</mo><msubsup><mover accent="true"><mrow><msubsup><mover accent="true"><msub><mi>b</mi><mrow><mi>n</mi><mo separator="true">,</mo><mi>k</mi></mrow></msub><mo stretchy="true">→</mo></mover><mrow><mi>n</mi><mo>=</mo><mn>0</mn></mrow><mi>s</mi></msubsup><mo>⋅</mo><mover accent="true"><mi>c</mi><mo>⃗</mo></mover></mrow><mo stretchy="true">→</mo></mover><mrow><mi>k</mi><mo>=</mo><mn>0</mn></mrow><mi>m</mi></msubsup><mi mathvariant="normal">.</mi></mrow><annotation encoding="application/x-tex">\overrightarrow{\vec a\cdot\overrightarrow{b_{n,k}}_{k=0}^m}_{n=0}^s\cdot\vec c
=\vec a\cdot\overrightarrow{\overrightarrow{b_{n,k}}_{n=0}^s\cdot\vec c}_{k=0}^m.</annotation></semantics></math></span></span></span>
</p>
<p>Proof is omitted.</p>
<p class="no-indent">
<strong>Definition 7</strong> (zero function)<strong>.</strong> The function whose value is always zero whatever the value of the independent variable is is called the zero function.
</p>
<p class="no-indent">
<strong>Lemma 8.</strong> The sufficient and necessary condition for the OGF/EGF of a sequence <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><msubsup><mrow><mo fence="true">{</mo><msub><mi>a</mi><mi>n</mi></msub><mo fence="true">}</mo></mrow><mrow><mi>n</mi><mo>=</mo><mn>0</mn></mrow><mi mathvariant="normal">∞</mi></msubsup></mrow><annotation encoding="application/x-tex">\left\{a_n\right\}_{n=0}^\infty</annotation></semantics></math></span></span> to be zero function is that <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><msub><mi>a</mi><mi>n</mi></msub><mo>=</mo><mn>0</mn></mrow><annotation encoding="application/x-tex">a_n=0</annotation></semantics></math></span></span> for any <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>n</mi></mrow><annotation encoding="application/x-tex">n</annotation></semantics></math></span></span>.
</p>
<p class="no-indent">
<em>Brief proof.</em> The sufficiency can be proved by Definition 6 and Definition 7; the necessity can be proved by Taylor expansion of the zero function. <span class="qed-wrapper qed-normal"><span class="qed qed-normal"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi mathvariant="normal">□</mi></mrow><annotation encoding="application/x-tex">\square</annotation></semantics></math></span></span></span></span>
</p>
<p class="no-indent">
<strong>Definition 8.</strong> <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><msubsup><mover accent="true"><msubsup><mover accent="true"><msub><mi>a</mi><mrow><mi>n</mi><mo separator="true">,</mo><mi>k</mi></mrow></msub><mo stretchy="true">→</mo></mover><mrow><mi>n</mi><mo>=</mo><mn>0</mn></mrow><mi>s</mi></msubsup><mo stretchy="true">→</mo></mover><mrow><mi>k</mi><mo>=</mo><mn>0</mn></mrow><mi>m</mi></msubsup><mo><mi mathvariant="normal">≔</mi></mo><mrow><mo fence="true">(</mo><mtable rowspacing="0.16em" columnalign="center center center center" columnspacing="1em"><mtr><mtd><mstyle scriptlevel="0" displaystyle="false"><msub><mi>a</mi><mrow><mn>0</mn><mo separator="true">,</mo><mn>0</mn></mrow></msub></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="false"><msub><mi>a</mi><mrow><mn>0</mn><mo separator="true">,</mo><mn>1</mn></mrow></msub></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="false"><mo lspace="0em" rspace="0em">⋯</mo></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="false"><msub><mi>a</mi><mrow><mn>0</mn><mo separator="true">,</mo><mi>m</mi></mrow></msub></mstyle></mtd></mtr><mtr><mtd><mstyle scriptlevel="0" displaystyle="false"><msub><mi>a</mi><mrow><mn>1</mn><mo separator="true">,</mo><mn>0</mn></mrow></msub></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="false"><msub><mi>a</mi><mrow><mn>1</mn><mo separator="true">,</mo><mn>1</mn></mrow></msub></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="false"><mo lspace="0em" rspace="0em">⋯</mo></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="false"><msub><mi>a</mi><mrow><mn>1</mn><mo separator="true">,</mo><mi>m</mi></mrow></msub></mstyle></mtd></mtr><mtr><mtd><mstyle scriptlevel="0" displaystyle="false"><mi><mi mathvariant="normal">⋮</mi><mpadded height="0em" voffset="0em"><mspace mathbackground="black" width="0em" height="1.5em"/></mpadded></mi></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="false"><mi><mi mathvariant="normal">⋮</mi><mpadded height="0em" voffset="0em"><mspace mathbackground="black" width="0em" height="1.5em"/></mpadded></mi></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="false"><mo lspace="0em" rspace="0em">⋱</mo></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="false"><mi><mi mathvariant="normal">⋮</mi><mpadded height="0em" voffset="0em"><mspace mathbackground="black" width="0em" height="1.5em"/></mpadded></mi></mstyle></mtd></mtr><mtr><mtd><mstyle scriptlevel="0" displaystyle="false"><msub><mi>a</mi><mrow><mi>s</mi><mo separator="true">,</mo><mn>0</mn></mrow></msub></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="false"><msub><mi>a</mi><mrow><mi>s</mi><mo separator="true">,</mo><mn>1</mn></mrow></msub></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="false"><mo lspace="0em" rspace="0em">⋯</mo></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="false"><msub><mi>a</mi><mrow><mi>s</mi><mo separator="true">,</mo><mi>m</mi></mrow></msub></mstyle></mtd></mtr></mtable><mo fence="true">)</mo></mrow><mi mathvariant="normal">.</mi></mrow><annotation encoding="application/x-tex">\overrightarrow{\overrightarrow{a_{n,k}}_{n=0}^s}_{k=0}^m\coloneqq
\left(\begin{matrix}
a_{0,0}&amp;a_{0,1}&amp;\cdots&amp;a_{0,m}\\
a_{1,0}&amp;a_{1,1}&amp;\cdots&amp;a_{1,m}\\
\vdots&amp;\vdots&amp;\ddots&amp;\vdots\\
a_{s,0}&amp;a_{s,1}&amp;\cdots&amp;a_{s,m}
\end{matrix}\right).</annotation></semantics></math></span></span></span>
</p>
<p class="no-indent">
<strong>Lemma 9</strong> (distributivity)<strong>.</strong> <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><msubsup><mover accent="true"><mrow><mover accent="true"><mi>p</mi><mo>⃗</mo></mover><mo>⋅</mo><msubsup><mover accent="true"><msub><mi>a</mi><mrow><mi>n</mi><mo separator="true">,</mo><mi>k</mi></mrow></msub><mo stretchy="true">→</mo></mover><mrow><mi>k</mi><mo>=</mo><mn>0</mn></mrow><mi>m</mi></msubsup></mrow><mo stretchy="true">→</mo></mover><mrow><mi>n</mi><mo>=</mo><mn>0</mn></mrow><mi>s</mi></msubsup><mo>=</mo><msubsup><mover accent="true"><msubsup><mover accent="true"><msub><mi>a</mi><mrow><mi>n</mi><mo separator="true">,</mo><mi>k</mi></mrow></msub><mo stretchy="true">→</mo></mover><mrow><mi>n</mi><mo>=</mo><mn>0</mn></mrow><mi>s</mi></msubsup><mo stretchy="true">→</mo></mover><mrow><mi>k</mi><mo>=</mo><mn>0</mn></mrow><mi>m</mi></msubsup><mover accent="true"><mi>p</mi><mo>⃗</mo></mover><mi mathvariant="normal">.</mi></mrow><annotation encoding="application/x-tex">\overrightarrow{\vec p\cdot\overrightarrow{a_{n,k}}_{k=0}^m}_{n=0}^s=
\overrightarrow{\overrightarrow{a_{n,k}}_{n=0}^s}_{k=0}^m\vec p.</annotation></semantics></math></span></span></span>
</p>
<p>Proof is omitted.</p>
<p class="no-indent">
<strong>Definition 9</strong> (sequence equation)<strong>.</strong> Let <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><msubsup><mrow><mo fence="true">{</mo><msub><mi>a</mi><mi>n</mi></msub><mo fence="true">}</mo></mrow><mrow><mi>n</mi><mo>=</mo><mn>0</mn></mrow><mi mathvariant="normal">∞</mi></msubsup></mrow><annotation encoding="application/x-tex">\left\{a_n\right\}_{n=0}^\infty</annotation></semantics></math></span></span> be an unknown sequence. If the function <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>F</mi><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mi>n</mi><mo fence="true">)</mo></mrow></mrow><annotation encoding="application/x-tex">F\!\left(n\right)</annotation></semantics></math></span></span> explicitly depends on terms in the sequence, then the function <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mi>F</mi><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mi>n</mi><mo fence="true">)</mo></mrow><mo>=</mo><mn>0</mn></mrow><annotation encoding="application/x-tex">F\!\left(n\right)=0</annotation></semantics></math></span></span></span> is called a sequence equation w.r.t. the sequence <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><msubsup><mrow><mo fence="true">{</mo><msub><mi>a</mi><mi>n</mi></msub><mo fence="true">}</mo></mrow><mrow><mi>n</mi><mo>=</mo><mn>0</mn></mrow><mi mathvariant="normal">∞</mi></msubsup></mrow><annotation encoding="application/x-tex">\left\{a_n\right\}_{n=0}^\infty</annotation></semantics></math></span></span>. For a sequence, if it satisfies the equation for any <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>n</mi></mrow><annotation encoding="application/x-tex">n</annotation></semantics></math></span></span>, then it is called a special solution of the sequence equation. The set of all special solutions of the sequence equation is called the general solution of the equation.
</p>
<p class="no-indent">
<strong>Definition 10</strong> (linear dependence of sequences)<strong>.</strong> If for a set of sequences (a sequence of tuples) <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><msubsup><mrow><mo fence="true">{</mo><msub><mover accent="true"><mi>a</mi><mo>⃗</mo></mover><mi>n</mi></msub><mo fence="true">}</mo></mrow><mrow><mi>n</mi><mo>=</mo><mn>0</mn></mrow><mi mathvariant="normal">∞</mi></msubsup></mrow><annotation encoding="application/x-tex">\left\{\vec a_n\right\}_{n=0}^\infty</annotation></semantics></math></span></span> there exists a tuple of constants <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mover accent="true"><mi>C</mi><mo>⃗</mo></mover></mrow><annotation encoding="application/x-tex">\vec C</annotation></semantics></math></span></span> which are not all zero (the dimensions of <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mover accent="true"><mi>C</mi><mo>⃗</mo></mover></mrow><annotation encoding="application/x-tex">\vec C</annotation></semantics></math></span></span> and <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><msub><mover accent="true"><mi>a</mi><mo>⃗</mo></mover><mi>n</mi></msub></mrow><annotation encoding="application/x-tex">\vec a_n</annotation></semantics></math></span></span> are the same) such that <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mover accent="true"><mi>C</mi><mo>⃗</mo></mover><mo>⋅</mo><msub><mover accent="true"><mi>a</mi><mo>⃗</mo></mover><mi>n</mi></msub><mo>=</mo><mn>0</mn></mrow><annotation encoding="application/x-tex">\vec C\cdot\vec a_n=0</annotation></semantics></math></span></span></span> for any <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>n</mi></mrow><annotation encoding="application/x-tex">n</annotation></semantics></math></span></span>, then the set of sequences are called to be linearly dependent. They are otherwise called to be linearly independent.
</p>
<p class="no-indent">
<strong>Lemma 10.</strong> The sufficient and necessary condition for a set of <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>m</mi><mo>+</mo><mn>1</mn></mrow><annotation encoding="application/x-tex">m+1</annotation></semantics></math></span></span> sequences <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><msubsup><mrow><mo fence="true">{</mo><msub><mover accent="true"><mi>a</mi><mo>⃗</mo></mover><mi>n</mi></msub><mo fence="true">}</mo></mrow><mrow><mi>n</mi><mo>=</mo><mn>0</mn></mrow><mi mathvariant="normal">∞</mi></msubsup></mrow><annotation encoding="application/x-tex">\left\{\vec a_n\right\}_{n=0}^\infty</annotation></semantics></math></span></span> to be linearly dependent is that <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mi mathvariant="normal">det</mi><mo>⁡</mo><msubsup><mover accent="true"><msub><mover accent="true"><mi>a</mi><mo>⃗</mo></mover><mrow><mi>n</mi><mo>+</mo><mi>k</mi></mrow></msub><mo stretchy="true">→</mo></mover><mrow><mi>k</mi><mo>=</mo><mn>0</mn></mrow><mi>m</mi></msubsup><mo>=</mo><mn>0.</mn></mrow><annotation encoding="application/x-tex">\operatorname{det}\overrightarrow{\vec a_{n+k}}_{k=0}^m=0.</annotation></semantics></math></span></span></span>
</p>
<p class="no-indent">
<em>Proof.</em> First prove the necessity. There exists a tuple of constants <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mover accent="true"><mi>C</mi><mo>⃗</mo></mover></mrow><annotation encoding="application/x-tex">\vec C</annotation></semantics></math></span></span> which are not all zero such that <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mover accent="true"><mi>C</mi><mo>⃗</mo></mover><mo>⋅</mo><msub><mover accent="true"><mi>a</mi><mo>⃗</mo></mover><mi>n</mi></msub><mo>=</mo><mn>0</mn></mrow><annotation encoding="application/x-tex">\vec C\cdot\vec a_n=0</annotation></semantics></math></span></span></span> for any <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>n</mi></mrow><annotation encoding="application/x-tex">n</annotation></semantics></math></span></span> (Definition 10).
</p>
<p>Replace <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>n</mi></mrow><annotation encoding="application/x-tex">n</annotation></semantics></math></span></span> by <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>n</mi><mo separator="true">,</mo><mi>n</mi><mo>+</mo><mn>1</mn><mo separator="true">,</mo><mi>n</mi><mo>+</mo><mn>1</mn><mo separator="true">,</mo><mo>…</mo><mo separator="true">,</mo><mi>n</mi><mo>+</mo><mi>m</mi></mrow><annotation encoding="application/x-tex">n,n+1,n+1,\ldots,n+m</annotation></semantics></math></span></span> respectively, and we have <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><msubsup><mover accent="true"><mrow><mover accent="true"><mi>C</mi><mo>⃗</mo></mover><mo>⋅</mo><msub><mover accent="true"><mi>a</mi><mo>⃗</mo></mover><mrow><mi>n</mi><mo>+</mo><mi>k</mi></mrow></msub></mrow><mo stretchy="true">→</mo></mover><mrow><mi>k</mi><mo>=</mo><mn>0</mn></mrow><mi>m</mi></msubsup><mo>=</mo><mover accent="true"><mn>0</mn><mo>⃗</mo></mover><mi mathvariant="normal">.</mi></mrow><annotation encoding="application/x-tex">\overrightarrow{\vec C\cdot\vec a_{n+k}}_{k=0}^m=\vec 0.</annotation></semantics></math></span></span></span> Let the <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mo fence="true">(</mo><mi>l</mi><mo>+</mo><mn>1</mn><mo fence="true">)</mo></mrow><annotation encoding="application/x-tex">\left(l+1\right)</annotation></semantics></math></span></span>th component of <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><msub><mover accent="true"><mi>a</mi><mo>⃗</mo></mover><mi>n</mi></msub></mrow><annotation encoding="application/x-tex">\vec a_n</annotation></semantics></math></span></span> be <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><msubsup><mi>a</mi><mi>n</mi><mrow><mo>∗</mo><mi>l</mi></mrow></msubsup></mrow><annotation encoding="application/x-tex">a_n^{*l}</annotation></semantics></math></span></span>, i.e. <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><msub><mover accent="true"><mi>a</mi><mo>⃗</mo></mover><mi>n</mi></msub><mo>=</mo><msubsup><mover accent="true"><msubsup><mi>a</mi><mi>n</mi><mrow><mo>∗</mo><mi>l</mi></mrow></msubsup><mo stretchy="true">→</mo></mover><mrow><mi>l</mi><mo>=</mo><mn>0</mn></mrow><mi>m</mi></msubsup></mrow><annotation encoding="application/x-tex">\vec a_n=\overrightarrow{a_n^{*l}}_{l=0}^m</annotation></semantics></math></span></span>. Then we have <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><msubsup><mover accent="true"><mrow><mover accent="true"><mi>C</mi><mo>⃗</mo></mover><mo>⋅</mo><msubsup><mover accent="true"><msubsup><mi>a</mi><mi>n</mi><mrow><mo>∗</mo><mi>l</mi></mrow></msubsup><mo stretchy="true">→</mo></mover><mrow><mi>l</mi><mo>=</mo><mn>0</mn></mrow><mi>m</mi></msubsup></mrow><mo stretchy="true">→</mo></mover><mrow><mi>k</mi><mo>=</mo><mn>0</mn></mrow><mi>m</mi></msubsup><mo>=</mo><mover accent="true"><mn>0</mn><mo>⃗</mo></mover><mi mathvariant="normal">.</mi></mrow><annotation encoding="application/x-tex">\overrightarrow{\vec C\cdot\overrightarrow{a_n^{*l}}_{l=0}^m}_{k=0}^m=\vec 0.</annotation></semantics></math></span></span></span> By Lemma 9, the LHS actually equals <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><msubsup><mover accent="true"><msubsup><mover accent="true"><msubsup><mi>a</mi><mi>n</mi><mrow><mo>∗</mo><mi>l</mi></mrow></msubsup><mo stretchy="true">→</mo></mover><mrow><mi>k</mi><mo>=</mo><mn>0</mn></mrow><mi>m</mi></msubsup><mo stretchy="true">→</mo></mover><mrow><mi>l</mi><mo>=</mo><mn>0</mn></mrow><mi>m</mi></msubsup><mover accent="true"><mi>C</mi><mo>⃗</mo></mover></mrow><annotation encoding="application/x-tex">\overrightarrow{\overrightarrow{a_{n}^{*l}}_{k=0}^m}_{l=0}^m\vec C</annotation></semantics></math></span></span>.</p>
<p>Define matrix <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mi mathvariant="bold">A</mi><mo><mi mathvariant="normal">≔</mi></mo><msubsup><mover accent="true"><msubsup><mover accent="true"><msubsup><mi>a</mi><mi>n</mi><mrow><mo>∗</mo><mi>l</mi></mrow></msubsup><mo stretchy="true">→</mo></mover><mrow><mi>k</mi><mo>=</mo><mn>0</mn></mrow><mi>m</mi></msubsup><mo stretchy="true">→</mo></mover><mrow><mi>l</mi><mo>=</mo><mn>0</mn></mrow><mi>m</mi></msubsup><mo separator="true">,</mo></mrow><annotation encoding="application/x-tex">\mathbf A\coloneqq\overrightarrow{\overrightarrow{a_n^{*l}}_{k=0}^m}_{l=0}^m,</annotation></semantics></math></span></span></span> then <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi mathvariant="bold">A</mi><mover accent="true"><mi>C</mi><mo>⃗</mo></mover><mo>=</mo><mover accent="true"><mn>0</mn><mo>⃗</mo></mover></mrow><annotation encoding="application/x-tex">\mathbf A\vec C=\vec 0</annotation></semantics></math></span></span>, and <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mi mathvariant="normal">det</mi><mo>⁡</mo><mi mathvariant="bold">A</mi><mo>=</mo><mi mathvariant="normal">det</mi><mo>⁡</mo><msup><mi mathvariant="bold">A</mi><mi mathvariant="normal">T</mi></msup><mo>=</mo><mi>det</mi><mo>⁡</mo><msubsup><mover accent="true"><msub><mover accent="true"><mi>a</mi><mo>⃗</mo></mover><mrow><mi>n</mi><mo>+</mo><mi>k</mi></mrow></msub><mo stretchy="true">→</mo></mover><mrow><mi>k</mi><mo>=</mo><mn>0</mn></mrow><mi>m</mi></msubsup><mi mathvariant="normal">.</mi></mrow><annotation encoding="application/x-tex">\operatorname{det}\mathbf A=\operatorname{det}\mathbf A^\mathrm T=\det\overrightarrow{\vec a_{n+k}}_{k=0}^m.</annotation></semantics></math></span></span></span> Prove by contradiction. Assume that the value of the determinant is not <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mn>0</mn></mrow><annotation encoding="application/x-tex">0</annotation></semantics></math></span></span>, i.e. <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi mathvariant="normal">det</mi><mo>⁡</mo><mi mathvariant="bold">A</mi><mo mathvariant="normal">≠</mo><mn>0</mn></mrow><annotation encoding="application/x-tex">\operatorname{det}\mathbf A\ne0</annotation></semantics></math></span></span>, then the matrix <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi mathvariant="bold">A</mi></mrow><annotation encoding="application/x-tex">\mathbf A</annotation></semantics></math></span></span> is invertible. Multiply the equation <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi mathvariant="bold">A</mi><mover accent="true"><mi>C</mi><mo>⃗</mo></mover><mo>=</mo><mover accent="true"><mn>0</mn><mo>⃗</mo></mover></mrow><annotation encoding="application/x-tex">\mathbf A\vec C=\vec 0</annotation></semantics></math></span></span> by <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><msup><mi mathvariant="bold">A</mi><mrow><mo>−</mo><mn>1</mn></mrow></msup></mrow><annotation encoding="application/x-tex">\mathbf A^{-1}</annotation></semantics></math></span></span> from the left on both sides, and we have <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mover accent="true"><mi>C</mi><mo>⃗</mo></mover><mo>=</mo><mover accent="true"><mn>0</mn><mo>⃗</mo></mover></mrow><annotation encoding="application/x-tex">\vec C=\vec 0</annotation></semantics></math></span></span>, which contradicts with the fact that <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mover accent="true"><mi>C</mi><mo>⃗</mo></mover></mrow><annotation encoding="application/x-tex">\vec C</annotation></semantics></math></span></span> is not all zero.</p>
<p>Therefore, <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>det</mi><mo>⁡</mo><msubsup><mover accent="true"><msub><mover accent="true"><mi>a</mi><mo>⃗</mo></mover><mrow><mi>n</mi><mo>+</mo><mi>k</mi></mrow></msub><mo stretchy="true">→</mo></mover><mrow><mi>k</mi><mo>=</mo><mn>0</mn></mrow><mi>m</mi></msubsup><mo>=</mo><mn>0</mn></mrow><annotation encoding="application/x-tex">\det\overrightarrow{\vec a_{n+k}}_{k=0}^m=0</annotation></semantics></math></span></span>.</p>
<p>(Boohoo! I cannot prove the sufficiency myself.) <span class="qed-wrapper qed-normal"><span class="qed qed-normal"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi mathvariant="normal">□</mi></mrow><annotation encoding="application/x-tex">\square</annotation></semantics></math></span></span></span></span></p>
<p class="no-indent">
<strong>Lemma 11.</strong> Suppose the sequence equation <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mover accent="true"><mi>p</mi><mo>⃗</mo></mover><mo>⋅</mo><msubsup><mover accent="true"><msub><mi>a</mi><mrow><mi>n</mi><mo>+</mo><mi>k</mi></mrow></msub><mo stretchy="true">→</mo></mover><mrow><mi>k</mi><mo>=</mo><mn>0</mn></mrow><mi>m</mi></msubsup><mo>=</mo><mn>0</mn></mrow><annotation encoding="application/x-tex">\vec p\cdot\overrightarrow{a_{n+k}}_{k=0}^m=0</annotation></semantics></math></span></span></span> (where <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mover accent="true"><mi>p</mi><mo>⃗</mo></mover></mrow><annotation encoding="application/x-tex">\vec p</annotation></semantics></math></span></span> is a <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mo fence="true">(</mo><mi>m</mi><mo>+</mo><mn>1</mn><mo fence="true">)</mo></mrow><annotation encoding="application/x-tex">\left(m+1\right)</annotation></semantics></math></span></span>-dimensional constant vector and not all zero) has a set of <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>m</mi></mrow><annotation encoding="application/x-tex">m</annotation></semantics></math></span></span> linearly independent special solutions <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mo fence="true">{</mo><msubsup><mover accent="true"><msubsup><mi>a</mi><mi>n</mi><mrow><mo>∗</mo><mi>l</mi></mrow></msubsup><mo stretchy="true">→</mo></mover><mrow><mi>l</mi><mo>=</mo><mn>1</mn></mrow><mi>m</mi></msubsup><mo fence="true">}</mo></mrow><annotation encoding="application/x-tex">\left\{\overrightarrow{a_n^{*l}}_{l=1}^m\right\}</annotation></semantics></math></span></span>, then the general solution of the sequence solution is <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mover accent="true"><mi>C</mi><mo>⃗</mo></mover><mo>⋅</mo><msubsup><mover accent="true"><msubsup><mi>a</mi><mi>n</mi><mrow><mo>∗</mo><mi>l</mi></mrow></msubsup><mo stretchy="true">→</mo></mover><mrow><mi>l</mi><mo>=</mo><mn>1</mn></mrow><mi>m</mi></msubsup></mrow><annotation encoding="application/x-tex">\vec C\cdot\overrightarrow{a_n^{*l}}_{l=1}^m</annotation></semantics></math></span></span>, where <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mover accent="true"><mi>C</mi><mo>⃗</mo></mover></mrow><annotation encoding="application/x-tex">\vec C</annotation></semantics></math></span></span> is a tuple of <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>m</mi></mrow><annotation encoding="application/x-tex">m</annotation></semantics></math></span></span> constants.
</p>
<p class="no-indent">
<em>Proof.</em> First prove that <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mo fence="true">{</mo><msub><mi>a</mi><mi>n</mi></msub><mo fence="true">}</mo></mrow><annotation encoding="application/x-tex">\left\{a_n\right\}</annotation></semantics></math></span></span>, where <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><msub><mi>a</mi><mi>n</mi></msub><mo><mi mathvariant="normal">≔</mi></mo><mover accent="true"><mi>C</mi><mo>⃗</mo></mover><mo>⋅</mo><msubsup><mover accent="true"><msubsup><mi>a</mi><mi>n</mi><mrow><mo>∗</mo><mi>l</mi></mrow></msubsup><mo stretchy="true">→</mo></mover><mrow><mi>l</mi><mo>=</mo><mn>1</mn></mrow><mi>m</mi></msubsup><mo separator="true">,</mo></mrow><annotation encoding="application/x-tex">a_n\coloneqq\vec C\cdot\overrightarrow{a_n^{*l}}_{l=1}^m,</annotation></semantics></math></span></span></span> must be a special solution of the original sequence equation.
</p>
<p>Substitute it into the LHS of the original sequence equation, and we have <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mtable rowspacing="0.25em" columnalign="right left right" columnspacing="0em 1em"><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mover accent="true"><mi>p</mi><mo>⃗</mo></mover><mo>⋅</mo><msubsup><mover accent="true"><mrow><mover accent="true"><mi>C</mi><mo>⃗</mo></mover><mo>⋅</mo><msubsup><mover accent="true"><msubsup><mi>a</mi><mrow><mi>n</mi><mo>+</mo><mi>k</mi></mrow><mrow><mo>∗</mo><mi>l</mi></mrow></msubsup><mo stretchy="true">→</mo></mover><mrow><mi>l</mi><mo>=</mo><mn>1</mn></mrow><mi>m</mi></msubsup></mrow><mo stretchy="true">→</mo></mover><mrow><mi>k</mi><mo>=</mo><mn>0</mn></mrow><mi>m</mi></msubsup></mrow></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mo>=</mo><mover accent="true"><mi>C</mi><mo>⃗</mo></mover><mo>⋅</mo><msubsup><mover accent="true"><mrow><mover accent="true"><mi>p</mi><mo>⃗</mo></mover><mo>⋅</mo><msubsup><mover accent="true"><msubsup><mi>a</mi><mrow><mi>n</mi><mo>+</mo><mi>k</mi></mrow><mrow><mo>∗</mo><mi>l</mi></mrow></msubsup><mo stretchy="true">→</mo></mover><mrow><mi>k</mi><mo>=</mo><mn>0</mn></mrow><mi>m</mi></msubsup></mrow><mo stretchy="true">→</mo></mover><mrow><mi>l</mi><mo>=</mo><mn>1</mn></mrow><mi>m</mi></msubsup></mrow></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mtext>(Lemma 7)</mtext></mstyle></mtd></mtr><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow/></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mo>=</mo><mover accent="true"><mi>C</mi><mo>⃗</mo></mover><mo>⋅</mo><msubsup><mover accent="true"><mn>0</mn><mo stretchy="true">→</mo></mover><mrow><mi>l</mi><mo>=</mo><mn>1</mn></mrow><mi>m</mi></msubsup></mrow></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mtext>(Definition 9)</mtext></mstyle></mtd></mtr><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow/></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mo>=</mo><mn>0.</mn></mrow></mstyle></mtd></mtr></mtable><annotation encoding="application/x-tex">\begin{align*}
\vec p\cdot\overrightarrow{\vec C\cdot\overrightarrow{a_{n+k}^{*l}}_{l=1}^m}_{k=0}^m
&amp;=\vec C\cdot\overrightarrow{\vec p\cdot\overrightarrow{a_{n+k}^{*l}}_{k=0}^m}_{l=1}^m&amp;
\text{(Lemma 7)}\\
&amp;=\vec C\cdot\overrightarrow0_{l=1}^m&amp;
\text{(Definition 9)}\\
&amp;=0.
\end{align*}</annotation></semantics></math></span></span></span> By Definition 9, the sequence <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mo fence="true">{</mo><msub><mi>a</mi><mi>n</mi></msub><mo fence="true">}</mo></mrow><annotation encoding="application/x-tex">\left\{a_n\right\}</annotation></semantics></math></span></span> is a special solution of the original sequence equation.</p>
<p>Then prove that the original sequence equation does not have a special solution <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mo fence="true">{</mo><msub><mi>a</mi><mi>n</mi></msub><mo fence="true">}</mo></mrow><annotation encoding="application/x-tex">\left\{a_n\right\}</annotation></semantics></math></span></span>, such that there does not exist a set of <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>m</mi></mrow><annotation encoding="application/x-tex">m</annotation></semantics></math></span></span> constants <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mover accent="true"><mi>C</mi><mo>⃗</mo></mover></mrow><annotation encoding="application/x-tex">\vec C</annotation></semantics></math></span></span> such that <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><msub><mi>a</mi><mi>n</mi></msub><mo>=</mo><mover accent="true"><mi>C</mi><mo>⃗</mo></mover><mo>⋅</mo><msubsup><mover accent="true"><msubsup><mi>a</mi><mi>n</mi><mrow><mo>∗</mo><mi>l</mi></mrow></msubsup><mo stretchy="true">→</mo></mover><mrow><mi>l</mi><mo>=</mo><mn>1</mn></mrow><mi>m</mi></msubsup></mrow><annotation encoding="application/x-tex">a_n=\vec C\cdot\overrightarrow{a_n^{*l}}_{l=1}^m</annotation></semantics></math></span></span> for any <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>n</mi></mrow><annotation encoding="application/x-tex">n</annotation></semantics></math></span></span>.</p>
<p>Prove by contradiction. Assume there is such a special solution, denoted as <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mo fence="true">{</mo><msubsup><mi>a</mi><mi>n</mi><mrow><mo>∗</mo><mn>0</mn></mrow></msubsup><mo fence="true">}</mo></mrow><annotation encoding="application/x-tex">\left\{a_n^{*0}\right\}</annotation></semantics></math></span></span>. Then by Definition 10, the set of sequences (sequence of tuples) <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><msubsup><mover accent="true"><msubsup><mi>a</mi><mi>n</mi><mrow><mo>∗</mo><mi>l</mi></mrow></msubsup><mo stretchy="true">→</mo></mover><mrow><mi>l</mi><mo>=</mo><mn>0</mn></mrow><mi>m</mi></msubsup></mrow><annotation encoding="application/x-tex">\overrightarrow{a_n^{*l}}_{l=0}^m</annotation></semantics></math></span></span> are linearly independent. Let matrix <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mi mathvariant="bold">A</mi><mo><mi mathvariant="normal">≔</mi></mo><msubsup><mover accent="true"><msub><mover accent="true"><msubsup><mi>a</mi><mi>n</mi><mrow><mo>∗</mo><mi>l</mi></mrow></msubsup><mo stretchy="true">→</mo></mover><mrow><mi>l</mi><mo>=</mo><mn>0</mn></mrow></msub><mo stretchy="true">→</mo></mover><mrow><mi>k</mi><mo>=</mo><mn>0</mn></mrow><mi>m</mi></msubsup><mo separator="true">,</mo></mrow><annotation encoding="application/x-tex">\mathbf A\coloneqq\overrightarrow{\overrightarrow{a_n^{*l}}_{l=0}}_{k=0}^m,</annotation></semantics></math></span></span></span> then according to Lemma 10, <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi mathvariant="bold">A</mi></mrow><annotation encoding="application/x-tex">\mathbf A</annotation></semantics></math></span></span> is invertible.</p>
<p>Because the set of sequences are all special solutions of the original sequence equation, by Definition 9, <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><msubsup><mover accent="true"><mrow><mover accent="true"><mi>p</mi><mo>⃗</mo></mover><mo>⋅</mo><msubsup><mover accent="true"><msubsup><mi>a</mi><mrow><mi>n</mi><mo>+</mo><mi>k</mi></mrow><mrow><mo>∗</mo><mi>l</mi></mrow></msubsup><mo stretchy="true">→</mo></mover><mrow><mi>k</mi><mo>=</mo><mn>0</mn></mrow><mi>m</mi></msubsup></mrow><mo stretchy="true">→</mo></mover><mrow><mi>l</mi><mo>=</mo><mn>0</mn></mrow><mi>m</mi></msubsup><mo>=</mo><mover accent="true"><mn>0</mn><mo>⃗</mo></mover><mi mathvariant="normal">.</mi></mrow><annotation encoding="application/x-tex">\overrightarrow{\vec p\cdot\overrightarrow{a_{n+k}^{*l}}_{k=0}^m}_{l=0}^m=\vec 0.</annotation></semantics></math></span></span></span> By Lemma 9, the LHS of the equation is actually <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi mathvariant="bold">A</mi><mover accent="true"><mi>p</mi><mo>⃗</mo></mover></mrow><annotation encoding="application/x-tex">\mathbf A\vec p</annotation></semantics></math></span></span>. Therefore, <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mi mathvariant="bold">A</mi><mover accent="true"><mi>p</mi><mo>⃗</mo></mover><mo>=</mo><mover accent="true"><mn>0</mn><mo>⃗</mo></mover><mi mathvariant="normal">.</mi></mrow><annotation encoding="application/x-tex">\mathbf A\vec p=\vec 0.</annotation></semantics></math></span></span></span> Multiply the equation by <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><msup><mi mathvariant="bold">A</mi><mrow><mo>−</mo><mn>1</mn></mrow></msup></mrow><annotation encoding="application/x-tex">\mathbf A^{-1}</annotation></semantics></math></span></span> from the left on both sides, we have <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mover accent="true"><mi>p</mi><mo>⃗</mo></mover><mo>=</mo><mover accent="true"><mn>0</mn><mo>⃗</mo></mover><mo separator="true">,</mo></mrow><annotation encoding="application/x-tex">\vec p=\vec 0,</annotation></semantics></math></span></span></span> which contradicts with the fact that <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mover accent="true"><mi>p</mi><mo>⃗</mo></mover></mrow><annotation encoding="application/x-tex">\vec p</annotation></semantics></math></span></span> is not all zero.</p>
<p>From all the above, we have proved that the general solution of the sequence equation is <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mover accent="true"><mi>C</mi><mo>⃗</mo></mover><mo>⋅</mo><msubsup><mover accent="true"><msubsup><mi>a</mi><mi>n</mi><mrow><mo>∗</mo><mi>l</mi></mrow></msubsup><mo stretchy="true">→</mo></mover><mrow><mi>l</mi><mo>=</mo><mn>1</mn></mrow><mi>m</mi></msubsup></mrow><annotation encoding="application/x-tex">\vec C\cdot\overrightarrow{a_n^{*l}}_{l=1}^m</annotation></semantics></math></span></span>. <span class="qed-wrapper qed-normal"><span class="qed qed-normal"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi mathvariant="normal">□</mi></mrow><annotation encoding="application/x-tex">\square</annotation></semantics></math></span></span></span></span></p>
<p class="no-indent">
<strong>Definition 11</strong> (polynomial)<strong>.</strong> Suppose <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mover accent="true"><mi>p</mi><mo>⃗</mo></mover></mrow><annotation encoding="application/x-tex">\vec p</annotation></semantics></math></span></span> is a constant vector whose <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mo fence="true">(</mo><mi>m</mi><mo>+</mo><mn>1</mn><mo fence="true">)</mo></mrow><annotation encoding="application/x-tex">\left(m+1\right)</annotation></semantics></math></span></span>th component is not <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mn>0</mn></mrow><annotation encoding="application/x-tex">0</annotation></semantics></math></span></span>, then the function <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mi>F</mi><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mi>x</mi><mo fence="true">)</mo></mrow><mo><mi mathvariant="normal">≔</mi></mo><mover accent="true"><mi>p</mi><mo>⃗</mo></mover><mo>⋅</mo><msubsup><mover accent="true"><msup><mi>x</mi><mi>k</mi></msup><mo stretchy="true">→</mo></mover><mrow><mi>k</mi><mo>=</mo><mn>0</mn></mrow><mi>m</mi></msubsup></mrow><annotation encoding="application/x-tex">F\!\left(x\right)\coloneqq\vec p\cdot\overrightarrow{x^k}_{k=0}^m</annotation></semantics></math></span></span></span> is called a polynomial of degree <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>m</mi></mrow><annotation encoding="application/x-tex">m</annotation></semantics></math></span></span> w.r.t. <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>x</mi></mrow><annotation encoding="application/x-tex">x</annotation></semantics></math></span></span>, and <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mover accent="true"><mi>p</mi><mo>⃗</mo></mover></mrow><annotation encoding="application/x-tex">\vec p</annotation></semantics></math></span></span> is called the coefficients of the polynomial.
</p>
<p class="no-indent">
<strong>Definition 12</strong> (multiplicity)<strong>.</strong> Suppose <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>F</mi><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mi>x</mi><mo fence="true">)</mo></mrow></mrow><annotation encoding="application/x-tex">F\!\left(x\right)</annotation></semantics></math></span></span> is an <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>m</mi></mrow><annotation encoding="application/x-tex">m</annotation></semantics></math></span></span>-degree polynomial w.r.t. <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>x</mi></mrow><annotation encoding="application/x-tex">x</annotation></semantics></math></span></span>, and <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>r</mi></mrow><annotation encoding="application/x-tex">r</annotation></semantics></math></span></span> is a complex number, then the maximum natural number <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>w</mi><mo>≤</mo><mi>m</mi></mrow><annotation encoding="application/x-tex">w\le m</annotation></semantics></math></span></span> such that <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mover accent="true"><mrow><msup><mi mathvariant="normal">D</mi><mi>q</mi></msup><mi>F</mi><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mi>r</mi><mo fence="true">)</mo></mrow></mrow><mo stretchy="true">→</mo></mover><msubsup><mo stretchy="false">)</mo><mrow><mi>q</mi><mo>=</mo><mn>0</mn></mrow><mrow><mi>w</mi><mo>−</mo><mn>1</mn></mrow></msubsup><mo>=</mo><mover accent="true"><mn>0</mn><mo>⃗</mo></mover></mrow><annotation encoding="application/x-tex">\overrightarrow{\mathrm D^qF\!\left(r\right)})_{q=0}^{w-1}=\vec 0</annotation></semantics></math></span></span></span> is called the multiplicity of <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>r</mi></mrow><annotation encoding="application/x-tex">r</annotation></semantics></math></span></span> in the polynomial. The complex number with non-zero multiplicity is called a root of the polynomial.
</p>
<p class="no-indent">
<strong>Lemma 12</strong> (fundamental theorem of algebra)<strong>.</strong> The sum of multiplicity of roots of a polynomial equals the degree of the polynomial.
</p>
<p>Proof is omitted.</p>
<p class="no-indent">
<strong>Definition 13</strong> (binomial coefficient)<strong>.</strong> <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mrow><mo fence="true">(</mo><mfrac linethickness="0px"><mi>u</mi><mi>v</mi></mfrac><mo fence="true">)</mo></mrow><mo><mi mathvariant="normal">≔</mi></mo><mfrac><mrow><mi>u</mi><mo stretchy="false">!</mo></mrow><mrow><mi>v</mi><mo stretchy="false">!</mo><mo stretchy="false">(</mo><mi>u</mi><mo>−</mo><mi>v</mi><mo stretchy="false">)</mo><mo stretchy="false">!</mo></mrow></mfrac><mi mathvariant="normal">.</mi></mrow><annotation encoding="application/x-tex">\binom uv\coloneqq\frac{u!}{v!(u-v)!}.</annotation></semantics></math></span></span></span>
</p>
<p class="no-indent">
<strong>Lemma 13.</strong> If <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>r</mi></mrow><annotation encoding="application/x-tex">r</annotation></semantics></math></span></span> is a root with multiplicity <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>w</mi></mrow><annotation encoding="application/x-tex">w</annotation></semantics></math></span></span> of the polynomial with coefficients <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mover accent="true"><mi>p</mi><mo>⃗</mo></mover></mrow><annotation encoding="application/x-tex">\vec p</annotation></semantics></math></span></span>, then for any natural number <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>q</mi><mo>&lt;</mo><mi>w</mi></mrow><annotation encoding="application/x-tex">q&lt;w</annotation></semantics></math></span></span>, we have <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mover accent="true"><mi>p</mi><mo>⃗</mo></mover><mo>⋅</mo><msubsup><mover accent="true"><mrow><mfrac><mrow><mi>k</mi><mo stretchy="false">!</mo></mrow><mrow><mrow><mo fence="true">(</mo><mi>k</mi><mo>−</mo><mi>q</mi><mo fence="true">)</mo></mrow><mo stretchy="false">!</mo></mrow></mfrac><msup><mi>r</mi><mrow><mi>k</mi><mo>−</mo><mi>q</mi></mrow></msup></mrow><mo stretchy="true">→</mo></mover><mrow><mi>k</mi><mo>=</mo><mn>0</mn></mrow><mi>m</mi></msubsup><mo>=</mo><mn>0.</mn></mrow><annotation encoding="application/x-tex">\vec p\cdot\overrightarrow{\frac{k!}{\left(k-q\right)!}r^{k-q}}_{k=0}^m=0.</annotation></semantics></math></span></span></span>
</p>
<p class="no-indent">
<em>Brief proof.</em> First use Definition 11 and Definition 12, and then use Lemma 2 and Lemma 5. <span class="qed-wrapper qed-normal"><span class="qed qed-normal"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi mathvariant="normal">□</mi></mrow><annotation encoding="application/x-tex">\square</annotation></semantics></math></span></span></span></span>
</p>
<p class="no-indent">
<strong>Lemma 14</strong> (Vandermonde’s identity)<strong>.</strong> <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><msubsup><mover accent="true"><mrow><mo fence="true">(</mo><mfrac linethickness="0px"><mi>u</mi><mrow><mi>q</mi><mo>−</mo><mi>u</mi></mrow></mfrac><mo fence="true">)</mo></mrow><mo stretchy="true">→</mo></mover><mrow><mi>u</mi><mo>=</mo><mn>0</mn></mrow><mi>q</mi></msubsup><mo>⋅</mo><msubsup><mover accent="true"><mrow><mo fence="true">(</mo><mfrac linethickness="0px"><mi>k</mi><mi>u</mi></mfrac><mo fence="true">)</mo></mrow><mo stretchy="true">→</mo></mover><mrow><mi>u</mi><mo>=</mo><mn>0</mn></mrow><mi>q</mi></msubsup><mo>=</mo><mrow><mo fence="true">(</mo><mfrac linethickness="0px"><mrow><mi>n</mi><mo>+</mo><mi>k</mi></mrow><mi>q</mi></mfrac><mo fence="true">)</mo></mrow><mi mathvariant="normal">.</mi></mrow><annotation encoding="application/x-tex">\overrightarrow{\binom u{q-u}}_{u=0}^q\cdot\overrightarrow{\binom ku}_{u=0}^q=\binom{n+k}q.</annotation></semantics></math></span></span></span>
</p>
<p>Proof is omitted.</p>
<p class="no-indent">
<strong>Lemma 15.</strong> <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><msubsup><mover accent="true"><mrow><mo fence="true">(</mo><mfrac linethickness="0px"><mi>q</mi><mi>u</mi></mfrac><mo fence="true">)</mo></mrow><mo stretchy="true">→</mo></mover><mrow><mi>u</mi><mo>=</mo><mn>0</mn></mrow><mi>q</mi></msubsup><mo>⋅</mo><msubsup><mover accent="true"><mrow><mfrac><mrow><mi>n</mi><mo stretchy="false">!</mo></mrow><mrow><mrow><mo fence="true">(</mo><mi>n</mi><mo>−</mo><mi>q</mi><mo>+</mo><mi>u</mi><mo fence="true">)</mo></mrow><mo stretchy="false">!</mo></mrow></mfrac><mfrac><mrow><mi>k</mi><mo stretchy="false">!</mo></mrow><mrow><mrow><mo fence="true">(</mo><mi>k</mi><mo>−</mo><mi>u</mi><mo fence="true">)</mo></mrow><mo stretchy="false">!</mo></mrow></mfrac></mrow><mo stretchy="true">→</mo></mover><mrow><mi>u</mi><mo>=</mo><mn>0</mn></mrow><mi>q</mi></msubsup><mo>=</mo><mfrac><mrow><mrow><mo fence="true">(</mo><mi>n</mi><mo>+</mo><mi>k</mi><mo fence="true">)</mo></mrow><mo stretchy="false">!</mo></mrow><mrow><mrow><mo fence="true">(</mo><mi>n</mi><mo>+</mo><mi>k</mi><mo>−</mo><mi>q</mi><mo fence="true">)</mo></mrow><mo stretchy="false">!</mo></mrow></mfrac><mi mathvariant="normal">.</mi></mrow><annotation encoding="application/x-tex">\overrightarrow{\binom qu}_{u=0}^q\cdot
\overrightarrow{\frac{n!}{\left(n-q+u\right)!}\frac{k!}{\left(k-u\right)!}}_{u=0}^q
=\frac{\left(n+k\right)!}{\left(n+k-q\right)!}.</annotation></semantics></math></span></span></span>
</p>
<p class="no-indent">
<em>Proof.</em> <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mtable rowspacing="0.25em" columnalign="right left right" columnspacing="0em 1em"><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><msubsup><mover accent="true"><mrow><mo fence="true">(</mo><mfrac linethickness="0px"><mi>q</mi><mi>u</mi></mfrac><mo fence="true">)</mo></mrow><mo stretchy="true">→</mo></mover><mrow><mi>u</mi><mo>=</mo><mn>0</mn></mrow><mi>q</mi></msubsup><mo>⋅</mo><msubsup><mover accent="true"><mrow><mfrac><mrow><mi>n</mi><mo stretchy="false">!</mo></mrow><mrow><mrow><mo fence="true">(</mo><mi>n</mi><mo>−</mo><mi>q</mi><mo>+</mo><mi>u</mi><mo fence="true">)</mo></mrow><mo stretchy="false">!</mo></mrow></mfrac><mfrac><mrow><mi>k</mi><mo stretchy="false">!</mo></mrow><mrow><mrow><mo fence="true">(</mo><mi>k</mi><mo>−</mo><mi>u</mi><mo fence="true">)</mo></mrow><mo stretchy="false">!</mo></mrow></mfrac></mrow><mo stretchy="true">→</mo></mover><mrow><mi>u</mi><mo>=</mo><mn>0</mn></mrow><mi>q</mi></msubsup></mrow></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mo>=</mo><msubsup><mover accent="true"><mfrac><mrow><mi>q</mi><mo stretchy="false">!</mo></mrow><mrow><mi>u</mi><mo stretchy="false">!</mo><mrow><mo fence="true">(</mo><mi>q</mi><mo>−</mo><mi>u</mi><mo fence="true">)</mo></mrow><mo stretchy="false">!</mo></mrow></mfrac><mo stretchy="true">→</mo></mover><mrow><mi>u</mi><mo>=</mo><mn>0</mn></mrow><mi>q</mi></msubsup><mo>⋅</mo><msubsup><mover accent="true"><mrow><mfrac><mrow><mi>n</mi><mo stretchy="false">!</mo></mrow><mrow><mrow><mo fence="true">(</mo><mi>n</mi><mo>−</mo><mi>q</mi><mo>+</mo><mi>u</mi><mo fence="true">)</mo></mrow><mo stretchy="false">!</mo></mrow></mfrac><mfrac><mrow><mi>k</mi><mo stretchy="false">!</mo></mrow><mrow><mrow><mo fence="true">(</mo><mi>k</mi><mo>−</mo><mi>u</mi><mo fence="true">)</mo></mrow><mo stretchy="false">!</mo></mrow></mfrac></mrow><mo stretchy="true">→</mo></mover><mrow><mi>u</mi><mo>=</mo><mn>0</mn></mrow><mi>q</mi></msubsup></mrow></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mtext>(Definition 13)</mtext></mstyle></mtd></mtr><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow/></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mo>=</mo><mi>q</mi><mo stretchy="false">!</mo><msubsup><mover accent="true"><mfrac><mrow><mi>n</mi><mo stretchy="false">!</mo></mrow><mrow><mrow><mo fence="true">(</mo><mi>q</mi><mo>−</mo><mi>u</mi><mo fence="true">)</mo></mrow><mo stretchy="false">!</mo><mrow><mo fence="true">(</mo><mi>n</mi><mo>−</mo><mi>q</mi><mo>+</mo><mi>u</mi><mo fence="true">)</mo></mrow><mo stretchy="false">!</mo></mrow></mfrac><mo stretchy="true">→</mo></mover><mrow><mi>u</mi><mo>=</mo><mn>0</mn></mrow><mi>q</mi></msubsup><mo>⋅</mo><msubsup><mover accent="true"><mfrac><mrow><mi>k</mi><mo stretchy="false">!</mo></mrow><mrow><mi>u</mi><mo stretchy="false">!</mo><mrow><mo fence="true">(</mo><mi>k</mi><mo>−</mo><mi>u</mi><mo fence="true">)</mo></mrow><mo stretchy="false">!</mo></mrow></mfrac><mo stretchy="true">→</mo></mover><mrow><mi>u</mi><mo>=</mo><mn>0</mn></mrow><mi>q</mi></msubsup></mrow></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mtext>(Lemma 4)</mtext></mstyle></mtd></mtr><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow/></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mo>=</mo><mi>q</mi><mo stretchy="false">!</mo><msubsup><mover accent="true"><mrow><mo fence="true">(</mo><mfrac linethickness="0px"><mi>n</mi><mrow><mi>q</mi><mo>−</mo><mi>u</mi></mrow></mfrac><mo fence="true">)</mo></mrow><mo stretchy="true">→</mo></mover><mrow><mi>u</mi><mo>=</mo><mn>0</mn></mrow><mi>q</mi></msubsup><mo>⋅</mo><msubsup><mover accent="true"><mrow><mo fence="true">(</mo><mfrac linethickness="0px"><mi>k</mi><mi>u</mi></mfrac><mo fence="true">)</mo></mrow><mo stretchy="true">→</mo></mover><mrow><mi>u</mi><mo>=</mo><mn>0</mn></mrow><mi>q</mi></msubsup></mrow></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mtext>(Definition 13)</mtext></mstyle></mtd></mtr><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow/></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mo>=</mo><mi>q</mi><mo stretchy="false">!</mo><mrow><mo fence="true">(</mo><mfrac linethickness="0px"><mrow><mi>n</mi><mo>+</mo><mi>k</mi></mrow><mi>q</mi></mfrac><mo fence="true">)</mo></mrow></mrow></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mtext>(Lemma 14)</mtext></mstyle></mtd></mtr><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow/></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mo>=</mo><mi>q</mi><mo stretchy="false">!</mo><mfrac><mrow><mrow><mo fence="true">(</mo><mi>n</mi><mo>+</mo><mi>k</mi><mo fence="true">)</mo></mrow><mo stretchy="false">!</mo></mrow><mrow><mi>q</mi><mo stretchy="false">!</mo><mrow><mo fence="true">(</mo><mi>n</mi><mo>+</mo><mi>k</mi><mo>−</mo><mi>q</mi><mo fence="true">)</mo></mrow><mo stretchy="false">!</mo></mrow></mfrac></mrow></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mtext>(Definition 13)</mtext></mstyle></mtd></mtr><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow/></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mo>=</mo><mfrac><mrow><mrow><mo fence="true">(</mo><mi>n</mi><mo>+</mo><mi>k</mi><mo fence="true">)</mo></mrow><mo stretchy="false">!</mo></mrow><mrow><mrow><mo fence="true">(</mo><mi>n</mi><mo>+</mo><mi>k</mi><mo>−</mo><mi>q</mi><mo fence="true">)</mo></mrow><mo stretchy="false">!</mo></mrow></mfrac><mi mathvariant="normal">.</mi></mrow></mstyle></mtd></mtr></mtable><annotation encoding="application/x-tex">\begin{align*}
\overrightarrow{\binom qu}_{u=0}^q\cdot
\overrightarrow{\frac{n!}{\left(n-q+u\right)!}\frac{k!}{\left(k-u\right)!}}_{u=0}^q
&amp;=\overrightarrow{\frac{q!}{u!\left(q-u\right)!}}_{u=0}^q\cdot
\overrightarrow{\frac{n!}{\left(n-q+u\right)!}\frac{k!}{\left(k-u\right)!}}_{u=0}^q&amp;
\text{(Definition 13)}\\
&amp;=q!\overrightarrow{\frac{n!}{\left(q-u\right)!\left(n-q+u\right)!}}_{u=0}^q\cdot
\overrightarrow{\frac{k!}{u!\left(k-u\right)!}}_{u=0}^q&amp;
\text{(Lemma 4)}\\
&amp;=q!\overrightarrow{\binom n{q-u}}_{u=0}^q\cdot
\overrightarrow{\binom ku}_{u=0}^q&amp;
\text{(Definition 13)}\\
&amp;=q!\binom{n+k}q&amp;
\text{(Lemma 14)}\\
&amp;=q!\frac{\left(n+k\right)!}{q!\left(n+k-q\right)!}&amp;
\text{(Definition 13)}\\
&amp;=\frac{\left(n+k\right)!}{\left(n+k-q\right)!}.
\end{align*}</annotation></semantics></math></span></span></span> <span class="qed-wrapper qed-last"><span class="qed qed-last"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi mathvariant="normal">□</mi></mrow><annotation encoding="application/x-tex">\square</annotation></semantics></math></span></span></span></span>
</p>
<p class="no-indent">
<strong>Lemma 16.</strong> If <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>r</mi></mrow><annotation encoding="application/x-tex">r</annotation></semantics></math></span></span> is a root with multiplicity <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>w</mi></mrow><annotation encoding="application/x-tex">w</annotation></semantics></math></span></span> of the polynomial with coefficients <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mover accent="true"><mi>p</mi><mo>⃗</mo></mover></mrow><annotation encoding="application/x-tex">\vec p</annotation></semantics></math></span></span>, then for any natural number <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>q</mi><mo>&lt;</mo><mi>w</mi></mrow><annotation encoding="application/x-tex">q&lt;w</annotation></semantics></math></span></span>, the sequence <span id="eq:special-sol-of-seq-eq" data-label="(2)"><span class="katex-display-table"> <span class="katex-display-numbered"><span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><msub><mi>a</mi><mi>n</mi></msub><mo><mi mathvariant="normal">≔</mi></mo><mfrac><mrow><mi>n</mi><mo stretchy="false">!</mo></mrow><mrow><mrow><mo fence="true">(</mo><mi>n</mi><mo>−</mo><mi>q</mi><mo fence="true">)</mo></mrow><mo stretchy="false">!</mo></mrow></mfrac><msup><mi>r</mi><mrow><mi>n</mi><mo>−</mo><mi>q</mi></mrow></msup></mrow><annotation encoding="application/x-tex">a_n\coloneqq\frac{n!}{\left(n-q\right)!}r^{n-q}</annotation></semantics></math></span></span></span></span> <span class="katex-display-number"><span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mo stretchy="false">(</mo><mn>2</mn><mo stretchy="false">)</mo></mrow><annotation encoding="application/x-tex">(2)</annotation></semantics></math></span></span></span></span> </span></span> is a special solution of the sequence equation <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mover accent="true"><mi>p</mi><mo>⃗</mo></mover><mo>⋅</mo><msubsup><mover accent="true"><msub><mi>a</mi><mrow><mi>n</mi><mo>+</mo><mi>k</mi></mrow></msub><mo stretchy="true">→</mo></mover><mrow><mi>k</mi><mo>=</mo><mn>0</mn></mrow><mi>m</mi></msubsup><mo>=</mo><mover accent="true"><mn>0</mn><mo>⃗</mo></mover></mrow><annotation encoding="application/x-tex">\vec p\cdot\overrightarrow{a_{n+k}}_{k=0}^m=\vec 0</annotation></semantics></math></span></span>.
</p>
<p class="no-indent">
<em>Proof.</em> Because <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><msub><mi>a</mi><mrow><mi>n</mi><mo>+</mo><mi>k</mi></mrow></msub><mo>=</mo><mfrac><mrow><mrow><mo fence="true">(</mo><mi>n</mi><mo>+</mo><mi>k</mi><mo fence="true">)</mo></mrow><mo stretchy="false">!</mo></mrow><mrow><mrow><mo fence="true">(</mo><mi>n</mi><mo>+</mo><mi>k</mi><mo>−</mo><mi>q</mi><mo fence="true">)</mo></mrow><mo stretchy="false">!</mo></mrow></mfrac><msup><mi>r</mi><mrow><mi>n</mi><mo>+</mo><mi>k</mi><mo>−</mo><mi>q</mi></mrow></msup><mo separator="true">,</mo></mrow><annotation encoding="application/x-tex">a_{n+k}=\frac{\left(n+k\right)!}{\left(n+k-q\right)!}r^{n+k-q},</annotation></semantics></math></span></span></span> we have <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mtable rowspacing="0.25em" columnalign="right left right" columnspacing="0em 1em"><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mfrac><msub><mi>a</mi><mrow><mi>n</mi><mo>+</mo><mi>k</mi></mrow></msub><msup><mi>r</mi><mrow><mi>n</mi><mo>+</mo><mi>k</mi><mo>−</mo><mi>q</mi></mrow></msup></mfrac></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mo>=</mo><mfrac><mrow><mrow><mo fence="true">(</mo><mi>n</mi><mo>+</mo><mi>k</mi><mo fence="true">)</mo></mrow><mo stretchy="false">!</mo></mrow><mrow><mrow><mo fence="true">(</mo><mi>n</mi><mo>+</mo><mi>k</mi><mo>−</mo><mi>q</mi><mo fence="true">)</mo></mrow><mo stretchy="false">!</mo></mrow></mfrac></mrow></mstyle></mtd></mtr><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow/></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mo>=</mo><msubsup><mover accent="true"><mrow><mo fence="true">(</mo><mfrac linethickness="0px"><mi>q</mi><mi>u</mi></mfrac><mo fence="true">)</mo></mrow><mo stretchy="true">→</mo></mover><mrow><mi>u</mi><mo>=</mo><mn>0</mn></mrow><mi>q</mi></msubsup><mo>⋅</mo><msubsup><mover accent="true"><mrow><mfrac><mrow><mi>n</mi><mo stretchy="false">!</mo></mrow><mrow><mrow><mo fence="true">(</mo><mi>n</mi><mo>−</mo><mi>q</mi><mo>+</mo><mi>u</mi><mo fence="true">)</mo></mrow><mo stretchy="false">!</mo></mrow></mfrac><mfrac><mrow><mi>k</mi><mo stretchy="false">!</mo></mrow><mrow><mrow><mo fence="true">(</mo><mi>k</mi><mo>−</mo><mi>u</mi><mo fence="true">)</mo></mrow><mo stretchy="false">!</mo></mrow></mfrac></mrow><mo stretchy="true">→</mo></mover><mrow><mi>u</mi><mo>=</mo><mn>0</mn></mrow><mi>q</mi></msubsup></mrow></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mtext>(Lemma 15)</mtext></mstyle></mtd></mtr><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow/></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mo>=</mo><msup><mi>r</mi><mrow><mo>−</mo><mi>k</mi></mrow></msup><mrow><mo fence="true">(</mo><msubsup><mover accent="true"><mfrac><mrow><mi>k</mi><mo stretchy="false">!</mo></mrow><mrow><mrow><mo fence="true">(</mo><mi>k</mi><mo>−</mo><mi>u</mi><mo fence="true">)</mo></mrow><mo stretchy="false">!</mo></mrow></mfrac><mo stretchy="true">→</mo></mover><mrow><mi>u</mi><mo>=</mo><mn>0</mn></mrow><mi>q</mi></msubsup><mo>⋅</mo><msubsup><mover accent="true"><mrow><mrow><mo fence="true">(</mo><mfrac linethickness="0px"><mi>q</mi><mi>u</mi></mfrac><mo fence="true">)</mo></mrow><mfrac><mrow><mi>n</mi><mo stretchy="false">!</mo></mrow><mrow><mrow><mo fence="true">(</mo><mi>n</mi><mo>−</mo><mi>q</mi><mo>+</mo><mi>u</mi><mo fence="true">)</mo></mrow><mo stretchy="false">!</mo></mrow></mfrac><msup><mi>r</mi><mi>u</mi></msup></mrow><mo stretchy="true">→</mo></mover><mrow><mi>u</mi><mo>=</mo><mn>0</mn></mrow><mi>q</mi></msubsup><mo fence="true">)</mo></mrow><mo separator="true">,</mo></mrow></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mtext>(Lemma 4)</mtext></mstyle></mtd></mtr></mtable><annotation encoding="application/x-tex">\begin{align*}
\frac{a_{n+k}}{r^{n+k-q}}&amp;=\frac{\left(n+k\right)!}{\left(n+k-q\right)!}\\
&amp;=\overrightarrow{\binom qu}_{u=0}^q\cdot
\overrightarrow{\frac{n!}{\left(n-q+u\right)!}\frac{k!}{\left(k-u\right)!}}_{u=0}^q&amp;
\text{(Lemma 15)}\\
&amp;=r^{-k}\left(\overrightarrow{\frac{k!}{\left(k-u\right)!}}_{u=0}^q\cdot
\overrightarrow{\binom qu\frac{n!}{\left(n-q+u\right)!}r^u}_{u=0}^q\right),&amp;
\text{(Lemma 4)}
\end{align*}</annotation></semantics></math></span></span></span> and thus <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><msub><mi>a</mi><mrow><mi>n</mi><mo>+</mo><mi>k</mi></mrow></msub><mo>=</mo><msup><mi>r</mi><mrow><mi>n</mi><mo>−</mo><mi>q</mi></mrow></msup><mrow><mo fence="true">(</mo><msubsup><mover accent="true"><mrow><mfrac><mrow><mi>k</mi><mo stretchy="false">!</mo></mrow><mrow><mrow><mo fence="true">(</mo><mi>k</mi><mo>−</mo><mi>u</mi><mo fence="true">)</mo></mrow><mo stretchy="false">!</mo></mrow></mfrac><msup><mi>r</mi><mrow><mi>k</mi><mo>−</mo><mi>u</mi></mrow></msup></mrow><mo stretchy="true">→</mo></mover><mrow><mi>u</mi><mo>=</mo><mn>0</mn></mrow><mi>q</mi></msubsup><mo>⋅</mo><msubsup><mover accent="true"><mrow><mrow><mo fence="true">(</mo><mfrac linethickness="0px"><mi>q</mi><mi>u</mi></mfrac><mo fence="true">)</mo></mrow><mfrac><mrow><mi>n</mi><mo stretchy="false">!</mo></mrow><mrow><mrow><mo fence="true">(</mo><mi>n</mi><mo>−</mo><mi>q</mi><mo>+</mo><mi>u</mi><mo fence="true">)</mo></mrow><mo stretchy="false">!</mo></mrow></mfrac><msup><mi>r</mi><mi>u</mi></msup></mrow><mo stretchy="true">→</mo></mover><mrow><mi>u</mi><mo>=</mo><mn>0</mn></mrow><mi>q</mi></msubsup><mo fence="true">)</mo></mrow><mi mathvariant="normal">.</mi></mrow><annotation encoding="application/x-tex">a_{n+k}=r^{n-q}\left(\overrightarrow{\frac{k!}{\left(k-u\right)!}r^{k-u}}_{u=0}^q\cdot
\overrightarrow{\binom qu\frac{n!}{\left(n-q+u\right)!}r^u}_{u=0}^q\right).</annotation></semantics></math></span></span></span> Because the LHS of the original sequence equation <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mtable rowspacing="0.25em" columnalign="right left right" columnspacing="0em 1em"><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mover accent="true"><mi>p</mi><mo>⃗</mo></mover><mo>⋅</mo><msubsup><mover accent="true"><msub><mi>a</mi><mrow><mi>n</mi><mo>+</mo><mi>k</mi></mrow></msub><mo stretchy="true">→</mo></mover><mrow><mi>k</mi><mo>=</mo><mn>0</mn></mrow><mi>m</mi></msubsup></mrow></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mo>=</mo><mover accent="true"><mi>p</mi><mo>⃗</mo></mover><mo>⋅</mo><msubsup><mover accent="true"><mrow><msup><mi>r</mi><mrow><mi>n</mi><mo>−</mo><mi>q</mi></mrow></msup><mrow><mo fence="true">(</mo><msubsup><mover accent="true"><mrow><mfrac><mrow><mi>k</mi><mo stretchy="false">!</mo></mrow><mrow><mrow><mo fence="true">(</mo><mi>k</mi><mo>−</mo><mi>u</mi><mo fence="true">)</mo></mrow><mo stretchy="false">!</mo></mrow></mfrac><msup><mi>r</mi><mrow><mi>k</mi><mo>−</mo><mi>u</mi></mrow></msup></mrow><mo stretchy="true">→</mo></mover><mrow><mi>u</mi><mo>=</mo><mn>0</mn></mrow><mi>q</mi></msubsup><mo>⋅</mo><msubsup><mover accent="true"><mrow><mrow><mo fence="true">(</mo><mfrac linethickness="0px"><mi>q</mi><mi>u</mi></mfrac><mo fence="true">)</mo></mrow><mfrac><mrow><mi>n</mi><mo stretchy="false">!</mo></mrow><mrow><mrow><mo fence="true">(</mo><mi>n</mi><mo>−</mo><mi>q</mi><mo>+</mo><mi>u</mi><mo fence="true">)</mo></mrow><mo stretchy="false">!</mo></mrow></mfrac><msup><mi>r</mi><mi>u</mi></msup></mrow><mo stretchy="true">→</mo></mover><mrow><mi>u</mi><mo>=</mo><mn>0</mn></mrow><mi>q</mi></msubsup><mo fence="true">)</mo></mrow></mrow><mo stretchy="true">→</mo></mover><mrow><mi>k</mi><mo>=</mo><mn>0</mn></mrow><mi>m</mi></msubsup></mrow></mstyle></mtd></mtr><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow/></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mo>=</mo><msup><mi>r</mi><mrow><mi>n</mi><mo>−</mo><mi>q</mi></mrow></msup><msubsup><mover accent="true"><mrow><mrow><mo fence="true">(</mo><mfrac linethickness="0px"><mi>q</mi><mi>u</mi></mfrac><mo fence="true">)</mo></mrow><mfrac><mrow><mi>n</mi><mo stretchy="false">!</mo></mrow><mrow><mrow><mo fence="true">(</mo><mi>n</mi><mo>−</mo><mi>q</mi><mo>+</mo><mi>u</mi><mo fence="true">)</mo></mrow><mo stretchy="false">!</mo></mrow></mfrac><msup><mi>r</mi><mi>u</mi></msup></mrow><mo stretchy="true">→</mo></mover><mrow><mi>u</mi><mo>=</mo><mn>0</mn></mrow><mi>q</mi></msubsup><mo>⋅</mo><msubsup><mover accent="true"><mrow><mover accent="true"><mi>p</mi><mo>⃗</mo></mover><mo>⋅</mo><msubsup><mover accent="true"><mrow><mfrac><mrow><mi>k</mi><mo stretchy="false">!</mo></mrow><mrow><mrow><mo fence="true">(</mo><mi>k</mi><mo>−</mo><mi>u</mi><mo fence="true">)</mo></mrow><mo stretchy="false">!</mo></mrow></mfrac><msup><mi>r</mi><mrow><mi>k</mi><mo>−</mo><mi>u</mi></mrow></msup></mrow><mo stretchy="true">→</mo></mover><mrow><mi>u</mi><mo>=</mo><mn>0</mn></mrow><mi>q</mi></msubsup></mrow><mo stretchy="true">→</mo></mover><mrow><mi>k</mi><mo>=</mo><mn>0</mn></mrow><mi>m</mi></msubsup></mrow></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mtext>(Lemma 7)</mtext></mstyle></mtd></mtr><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow/></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mo>=</mo><msup><mi>r</mi><mrow><mi>n</mi><mo>−</mo><mi>q</mi></mrow></msup><msubsup><mover accent="true"><mrow><mfrac><mrow><mi>n</mi><mo stretchy="false">!</mo></mrow><mrow><mrow><mo fence="true">(</mo><mi>n</mi><mo>−</mo><mi>q</mi><mo>+</mo><mi>u</mi><mo fence="true">)</mo></mrow><mo stretchy="false">!</mo></mrow></mfrac><msup><mi>r</mi><mi>u</mi></msup></mrow><mo stretchy="true">→</mo></mover><mrow><mi>u</mi><mo>=</mo><mn>0</mn></mrow><mi>q</mi></msubsup><mo>⋅</mo><msubsup><mover accent="true"><mn>0</mn><mo stretchy="true">→</mo></mover><mrow><mi>k</mi><mo>=</mo><mn>0</mn></mrow><mi>m</mi></msubsup></mrow></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mtext>(Lemma 13)</mtext></mstyle></mtd></mtr><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow/></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mo>=</mo><mn>0</mn><mo separator="true">,</mo></mrow></mstyle></mtd></mtr></mtable><annotation encoding="application/x-tex">\begin{align*}
\vec p\cdot\overrightarrow{a_{n+k}}_{k=0}^m
&amp;=\vec p\cdot\overrightarrow{r^{n-q}\left(\overrightarrow{\frac{k!}{\left(k-u\right)!}r^{k-u}}_{u=0}^q\cdot
\overrightarrow{\binom qu\frac{n!}{\left(n-q+u\right)!}r^u}_{u=0}^q\right)}_{k=0}^m\\
&amp;=r^{n-q}\overrightarrow{\binom qu\frac{n!}{\left(n-q+u\right)!}r^u}_{u=0}^q\cdot
\overrightarrow{\vec p\cdot\overrightarrow{\frac{k!}{\left(k-u\right)!}r^{k-u}}_{u=0}^q}_{k=0}^m&amp;
\text{(Lemma 7)}\\
&amp;=r^{n-q}\overrightarrow{\frac{n!}{\left(n-q+u\right)!}r^u}_{u=0}^q\cdot
\overrightarrow{0}_{k=0}^m&amp;
\text{(Lemma 13)}\\
&amp;=0,
\end{align*}</annotation></semantics></math></span></span></span> by Definition 9, <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mo fence="true">{</mo><msub><mi>a</mi><mi>n</mi></msub><mo fence="true">}</mo></mrow><annotation encoding="application/x-tex">\left\{a_n\right\}</annotation></semantics></math></span></span> is a special solution of the sequence equation. <span class="qed-wrapper qed-normal"><span class="qed qed-normal"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi mathvariant="normal">□</mi></mrow><annotation encoding="application/x-tex">\square</annotation></semantics></math></span></span></span></span>
</p>
<p class="no-indent">
<strong>Lemma 17.</strong> The sequence <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><msub><mi>a</mi><mi>n</mi></msub><mo><mi mathvariant="normal">≔</mi></mo><msubsup><mover accent="true"><mrow><msubsup><mover accent="true"><msub><mi>C</mi><mrow><mi>l</mi><mo separator="true">,</mo><mi>q</mi></mrow></msub><mo stretchy="true">→</mo></mover><mrow><mi>q</mi><mo>=</mo><mn>0</mn></mrow><mrow><msub><mi>w</mi><mi>l</mi></msub><mo>−</mo><mn>1</mn></mrow></msubsup><mo>⋅</mo><msubsup><mover accent="true"><mrow><mfrac><mrow><mi>n</mi><mo stretchy="false">!</mo></mrow><mrow><mrow><mo fence="true">(</mo><mi>n</mi><mo>−</mo><mi>q</mi><mo fence="true">)</mo></mrow><mo stretchy="false">!</mo></mrow></mfrac><msubsup><mi>r</mi><mi>l</mi><mrow><mi>n</mi><mo>−</mo><mi>q</mi></mrow></msubsup></mrow><mo stretchy="true">→</mo></mover><mrow><mi>q</mi><mo>=</mo><mn>0</mn></mrow><mrow><msub><mi>w</mi><mi>l</mi></msub><mo>−</mo><mn>1</mn></mrow></msubsup></mrow><mo stretchy="true">→</mo></mover><mrow><mi>l</mi><mo>=</mo><mn>1</mn></mrow><mi>o</mi></msubsup><mo>⋅</mo><mover accent="true"><mn>1</mn><mo>⃗</mo></mover></mrow><annotation encoding="application/x-tex">a_n\coloneqq\overrightarrow{\overrightarrow{C_{l,q}}_{q=0}^{w_l-1}\cdot
\overrightarrow{\frac{n!}{\left(n-q\right)!}r_l^{n-q}}_{q=0}^{w_l-1}}_{l=1}^o\cdot\vec 1</annotation></semantics></math></span></span></span> is the general solution to the sequence equation <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mover accent="true"><mi>p</mi><mo>⃗</mo></mover><mo>⋅</mo><msubsup><mover accent="true"><msub><mi>a</mi><mrow><mi>n</mi><mo>+</mo><mi>k</mi></mrow></msub><mo stretchy="true">→</mo></mover><mrow><mi>k</mi><mo>=</mo><mn>0</mn></mrow><mi>m</mi></msubsup><mo>=</mo><mn>0</mn></mrow><annotation encoding="application/x-tex">\vec p\cdot\overrightarrow{a_{n+k}}_{k=0}^m=0</annotation></semantics></math></span></span>, where <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><msubsup><mover accent="true"><msub><mi>r</mi><mi>l</mi></msub><mo stretchy="true">→</mo></mover><mrow><mi>l</mi><mo>=</mo><mn>1</mn></mrow><mi>o</mi></msubsup></mrow><annotation encoding="application/x-tex">\overrightarrow{r_l}_{l=1}^o</annotation></semantics></math></span></span> all different roots of the polynomial with coefficients <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mover accent="true"><mi>p</mi><mo>⃗</mo></mover></mrow><annotation encoding="application/x-tex">\vec p</annotation></semantics></math></span></span>, and <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><msubsup><mover accent="true"><msub><mi>w</mi><mi>l</mi></msub><mo stretchy="true">→</mo></mover><mrow><mi>l</mi><mo>=</mo><mn>1</mn></mrow><mi>o</mi></msubsup></mrow><annotation encoding="application/x-tex">\overrightarrow{w_l}_{l=1}^o</annotation></semantics></math></span></span> are the corresponding multiplicities of the roots, and <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><msub><mi>C</mi><mrow><mi>l</mi><mo separator="true">,</mo><mi>q</mi></mrow></msub></mrow><annotation encoding="application/x-tex">C_{l,q}</annotation></semantics></math></span></span> are arbitrary constants.
</p>
<p class="no-indent">
<em>Brief proof.</em> By Lemma 16, the root <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><msub><mi>r</mi><mi>l</mi></msub></mrow><annotation encoding="application/x-tex">r_l</annotation></semantics></math></span></span> brings <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><msub><mi>w</mi><mi>l</mi></msub></mrow><annotation encoding="application/x-tex">w_l</annotation></semantics></math></span></span> special solutions. All the special solutions brought by all the roots can be proved to be linearly independent. According to Lemma 12, there are <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>m</mi></mrow><annotation encoding="application/x-tex">m</annotation></semantics></math></span></span> linearly independent special solutions. According to Lemma 11, the result can be proved. <span class="qed-wrapper qed-normal"><span class="qed qed-normal"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi mathvariant="normal">□</mi></mrow><annotation encoding="application/x-tex">\square</annotation></semantics></math></span></span></span></span>
</p>
<p class="no-indent">
<strong>Lemma 18.</strong> The sufficient and necessary condition for the sequence <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mo fence="true">{</mo><msub><mi>a</mi><mi>n</mi></msub><mo fence="true">}</mo></mrow><annotation encoding="application/x-tex">\left\{a_n\right\}</annotation></semantics></math></span></span> to be a special solution of the sequence equation <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mover accent="true"><mi>p</mi><mo>⃗</mo></mover><mo>⋅</mo><msubsup><mover accent="true"><msub><mi>a</mi><mrow><mi>n</mi><mo>+</mo><mi>k</mi></mrow></msub><mo stretchy="true">→</mo></mover><mrow><mi>k</mi><mo>=</mo><mn>0</mn></mrow><mi>m</mi></msubsup><mo>=</mo><mn>0</mn></mrow><annotation encoding="application/x-tex">\vec p\cdot\overrightarrow{a_{n+k}}_{k=0}^m=0</annotation></semantics></math></span></span> is that its EGF is a special solution of the ODE <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mover accent="true"><mi>p</mi><mo>⃗</mo></mover><mo>⋅</mo><msubsup><mover accent="true"><msup><mi mathvariant="normal">D</mi><mi>k</mi></msup><mo stretchy="true">→</mo></mover><mrow><mi>k</mi><mo>=</mo><mn>0</mn></mrow><mi>m</mi></msubsup><mi>y</mi><mo>=</mo><mn>0.</mn></mrow><annotation encoding="application/x-tex">\vec p\cdot\overrightarrow{\mathrm D^k}_{k=0}^m y=0.</annotation></semantics></math></span></span></span>
</p>
<p class="no-indent">
<em>Proof.</em> First prove the sufficiency. Suppose <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>y</mi></mrow><annotation encoding="application/x-tex">y</annotation></semantics></math></span></span> is the EGF of <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mo fence="true">{</mo><msub><mi>a</mi><mi>n</mi></msub><mo fence="true">}</mo></mrow><annotation encoding="application/x-tex">\left\{a_n\right\}</annotation></semantics></math></span></span>, i.e. <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mi>y</mi><mo>=</mo><msubsup><mover accent="true"><mfrac><msub><mi>a</mi><mi>n</mi></msub><mrow><mi>n</mi><mo stretchy="false">!</mo></mrow></mfrac><mo stretchy="true">→</mo></mover><mrow><mi>n</mi><mo>=</mo><mn>0</mn></mrow><mi mathvariant="normal">∞</mi></msubsup><mo>⋅</mo><msubsup><mover accent="true"><msup><mi>x</mi><mi>n</mi></msup><mo stretchy="true">→</mo></mover><mrow><mi>n</mi><mo>=</mo><mn>0</mn></mrow><mi mathvariant="normal">∞</mi></msubsup></mrow><annotation encoding="application/x-tex">y=\overrightarrow{\frac{a_n}{n!}}_{n=0}^{\infty}\cdot\overrightarrow{x^n}_{n=0}^\infty</annotation></semantics></math></span></span></span> (Definition 6), then the LHS of the original ODE <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mtable rowspacing="0.25em" columnalign="right left right" columnspacing="0em 1em"><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mi>L</mi><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mi mathvariant="normal">D</mi><mo fence="true">)</mo></mrow><mi>y</mi></mrow></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mo>=</mo><mover accent="true"><mi>p</mi><mo>⃗</mo></mover><mo>⋅</mo><msubsup><mover accent="true"><msup><mi mathvariant="normal">D</mi><mi>k</mi></msup><mo stretchy="true">→</mo></mover><mrow><mi>k</mi><mo>=</mo><mn>0</mn></mrow><mi>m</mi></msubsup><mrow><mo fence="true">(</mo><msubsup><mover accent="true"><mfrac><msub><mi>a</mi><mi>n</mi></msub><mrow><mi>n</mi><mo stretchy="false">!</mo></mrow></mfrac><mo stretchy="true">→</mo></mover><mrow><mi>n</mi><mo>=</mo><mn>0</mn></mrow><mi mathvariant="normal">∞</mi></msubsup><mo>⋅</mo><msubsup><mover accent="true"><msup><mi>x</mi><mi>n</mi></msup><mo stretchy="true">→</mo></mover><mrow><mi>n</mi><mo>=</mo><mn>0</mn></mrow><mi mathvariant="normal">∞</mi></msubsup><mo fence="true">)</mo></mrow></mrow></mstyle></mtd></mtr><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow/></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mo>=</mo><mover accent="true"><mi>p</mi><mo>⃗</mo></mover><mo>⋅</mo><msubsup><mover accent="true"><mrow><msubsup><mover accent="true"><mfrac><msub><mi>a</mi><mrow><mi>n</mi><mo>+</mo><mi>k</mi></mrow></msub><mrow><mi>n</mi><mo stretchy="false">!</mo></mrow></mfrac><mo stretchy="true">→</mo></mover><mrow><mi>n</mi><mo>=</mo><mn>0</mn></mrow><mi mathvariant="normal">∞</mi></msubsup><mo>⋅</mo><msubsup><mover accent="true"><msup><mi>x</mi><mi>n</mi></msup><mo stretchy="true">→</mo></mover><mrow><mi>n</mi><mo>=</mo><mn>0</mn></mrow><mi mathvariant="normal">∞</mi></msubsup></mrow><mo stretchy="true">→</mo></mover><mrow><mi>k</mi><mo>=</mo><mn>0</mn></mrow><mi>m</mi></msubsup></mrow></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mtext>(Lemma 6)</mtext></mstyle></mtd></mtr><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow/></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mo>=</mo><msubsup><mover accent="true"><mrow><mover accent="true"><mi>p</mi><mo>⃗</mo></mover><mo>⋅</mo><msubsup><mover accent="true"><mfrac><msub><mi>a</mi><mrow><mi>n</mi><mo>+</mo><mi>k</mi></mrow></msub><mrow><mi>n</mi><mo stretchy="false">!</mo></mrow></mfrac><mo stretchy="true">→</mo></mover><mrow><mi>k</mi><mo>=</mo><mn>0</mn></mrow><mi>m</mi></msubsup></mrow><mo stretchy="true">→</mo></mover><mrow><mi>n</mi><mo>=</mo><mn>0</mn></mrow><mi mathvariant="normal">∞</mi></msubsup><mo>⋅</mo><msubsup><mover accent="true"><msup><mi>x</mi><mi>n</mi></msup><mo stretchy="true">→</mo></mover><mrow><mi>n</mi><mo>=</mo><mn>0</mn></mrow><mi mathvariant="normal">∞</mi></msubsup></mrow></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mtext>(Lemma 7)</mtext></mstyle></mtd></mtr><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow/></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mo>=</mo><msubsup><mover accent="true"><mfrac><mrow><mover accent="true"><mi>p</mi><mo>⃗</mo></mover><mo>⋅</mo><msubsup><mover accent="true"><msub><mi>a</mi><mrow><mi>n</mi><mo>+</mo><mi>k</mi></mrow></msub><mo stretchy="true">→</mo></mover><mrow><mi>k</mi><mo>=</mo><mn>0</mn></mrow><mi>m</mi></msubsup></mrow><mrow><mi>n</mi><mo stretchy="false">!</mo></mrow></mfrac><mo stretchy="true">→</mo></mover><mrow><mi>n</mi><mo>=</mo><mn>0</mn></mrow><mi mathvariant="normal">∞</mi></msubsup><mo>⋅</mo><msubsup><mover accent="true"><msup><mi>x</mi><mi>n</mi></msup><mo stretchy="true">→</mo></mover><mrow><mi>n</mi><mo>=</mo><mn>0</mn></mrow><mi mathvariant="normal">∞</mi></msubsup><mi mathvariant="normal">.</mi></mrow></mstyle></mtd></mtr></mtable><annotation encoding="application/x-tex">\begin{align*}
L\!\left(\mathrm D\right)y
&amp;=\vec p\cdot\overrightarrow{\mathrm D^k}_{k=0}^m
\left(\overrightarrow{\frac{a_n}{n!}}_{n=0}^{\infty}\cdot\overrightarrow{x^n}_{n=0}^\infty\right)\\
&amp;=\vec p\cdot\overrightarrow{\overrightarrow{\frac{a_{n+k}}{n!}}_{n=0}^\infty\cdot\overrightarrow{x^n}_{n=0}^\infty}_{k=0}^m&amp;
\text{(Lemma 6)}\\
&amp;=\overrightarrow{\vec p\cdot\overrightarrow{\frac{a_{n+k}}{n!}}_{k=0}^m}_{n=0}^\infty\cdot
\overrightarrow{x^n}_{n=0}^\infty&amp;
\text{(Lemma 7)}\\
&amp;=\overrightarrow{\frac{\vec p\cdot\overrightarrow{a_{n+k}}_{k=0}^m}{n!}}_{n=0}^\infty\cdot
\overrightarrow{x^n}_{n=0}^\infty.
\end{align*}</annotation></semantics></math></span></span></span> Therefore, <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>L</mi><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mi mathvariant="normal">D</mi><mo fence="true">)</mo></mrow><mi>y</mi></mrow><annotation encoding="application/x-tex">L\!\left(\mathrm D\right)y</annotation></semantics></math></span></span> is the EGF of the sequence <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><msubsup><mrow><mo fence="true">{</mo><mover accent="true"><mi>p</mi><mo>⃗</mo></mover><mo>⋅</mo><msubsup><mover accent="true"><msub><mi>a</mi><mrow><mi>n</mi><mo>+</mo><mi>k</mi></mrow></msub><mo stretchy="true">→</mo></mover><mrow><mi>k</mi><mo>=</mo><mn>0</mn></mrow><mi>m</mi></msubsup><mo fence="true">}</mo></mrow><mrow><mi>n</mi><mo>=</mo><mn>0</mn></mrow><mi mathvariant="normal">∞</mi></msubsup></mrow><annotation encoding="application/x-tex">\left\{\vec p\cdot\overrightarrow{a_{n+k}}_{k=0}^m\right\}_{n=0}^\infty</annotation></semantics></math></span></span>. Because it is a zero function, by Lemma 8, for any <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>n</mi></mrow><annotation encoding="application/x-tex">n</annotation></semantics></math></span></span>, <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mover accent="true"><mi>p</mi><mo>⃗</mo></mover><mo>⋅</mo><msubsup><mover accent="true"><msub><mi>a</mi><mrow><mi>n</mi><mo>+</mo><mi>k</mi></mrow></msub><mo stretchy="true">→</mo></mover><mrow><mi>k</mi><mo>=</mo><mn>0</mn></mrow><mi>m</mi></msubsup><mo>=</mo><mn>0.</mn></mrow><annotation encoding="application/x-tex">\vec p\cdot\overrightarrow{a_{n+k}}_{k=0}^m=0.</annotation></semantics></math></span></span></span> All the steps are reversible, so the necessity is also proved. <span class="qed-wrapper qed-normal"><span class="qed qed-normal"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi mathvariant="normal">□</mi></mrow><annotation encoding="application/x-tex">\square</annotation></semantics></math></span></span></span></span>
</p>
<p class="no-indent">
<strong>Definition 14</strong> (exponential function)<strong>.</strong> The EGF of the sequence <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mo fence="true">{</mo><mn>1</mn><mo fence="true">}</mo></mrow><annotation encoding="application/x-tex">\left\{1\right\}</annotation></semantics></math></span></span> is called the exponential function, i.e. <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><msup><mi mathvariant="normal">e</mi><mi>x</mi></msup><mo><mi mathvariant="normal">≔</mi></mo><msubsup><mover accent="true"><mfrac><mn>1</mn><mrow><mi>n</mi><mo stretchy="false">!</mo></mrow></mfrac><mo stretchy="true">→</mo></mover><mrow><mi>n</mi><mo>=</mo><mn>0</mn></mrow><mi mathvariant="normal">∞</mi></msubsup><mo>⋅</mo><msubsup><mover accent="true"><msup><mi>x</mi><mi>n</mi></msup><mo stretchy="true">→</mo></mover><mrow><mi>n</mi><mo>=</mo><mn>0</mn></mrow><mi mathvariant="normal">∞</mi></msubsup><mi mathvariant="normal">.</mi></mrow><annotation encoding="application/x-tex">\mathrm e^x\coloneqq\overrightarrow{\frac 1{n!}}_{n=0}^{\infty}\cdot\overrightarrow{x^n}_{n=0}^\infty.</annotation></semantics></math></span></span></span>
</p>
<p class="no-indent">
<strong>Lemma 19.</strong> If <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>y</mi></mrow><annotation encoding="application/x-tex">y</annotation></semantics></math></span></span> is the EGF of the sequence in Equation <a href="#eq:special-sol-of-seq-eq">2</a>, then <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>y</mi><mo>=</mo><msup><mi>x</mi><mi>q</mi></msup><msup><mi mathvariant="normal">e</mi><mrow><mi>r</mi><mi>x</mi></mrow></msup></mrow><annotation encoding="application/x-tex">y=x^q\mathrm e^{rx}</annotation></semantics></math></span></span>.
</p>
<p class="no-indent">
<em>Proof.</em> <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mtable rowspacing="0.25em" columnalign="right left right" columnspacing="0em 1em"><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mi>y</mi></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mo>=</mo><msubsup><mover accent="true"><mfrac><mfrac><mrow><mi>n</mi><mo stretchy="false">!</mo></mrow><mrow><mrow><mo fence="true">(</mo><mi>n</mi><mo>−</mo><mi>q</mi><mo fence="true">)</mo></mrow><mo stretchy="false">!</mo></mrow></mfrac><mrow><mi>n</mi><mo stretchy="false">!</mo></mrow></mfrac><mo stretchy="true">→</mo></mover><mrow><mi>n</mi><mo>=</mo><mn>0</mn></mrow><mi mathvariant="normal">∞</mi></msubsup><mo>⋅</mo><msubsup><mover accent="true"><msup><mi>x</mi><mi>n</mi></msup><mo stretchy="true">→</mo></mover><mrow><mi>n</mi><mo>=</mo><mn>0</mn></mrow><mi mathvariant="normal">∞</mi></msubsup></mrow></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mtext>(Definition 6)</mtext></mstyle></mtd></mtr><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow/></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mo>=</mo><msubsup><mover accent="true"><mfrac><msup><mi>r</mi><mrow><mi>n</mi><mo>−</mo><mi>q</mi></mrow></msup><mrow><mrow><mo fence="true">(</mo><mi>n</mi><mo>−</mo><mi>q</mi><mo fence="true">)</mo></mrow><mo stretchy="false">!</mo></mrow></mfrac><mo stretchy="true">→</mo></mover><mrow><mi>n</mi><mo>=</mo><mn>0</mn></mrow><mi mathvariant="normal">∞</mi></msubsup><mo>⋅</mo><msubsup><mover accent="true"><msup><mi>x</mi><mi>n</mi></msup><mo stretchy="true">→</mo></mover><mrow><mi>n</mi><mo>=</mo><mn>0</mn></mrow><mi mathvariant="normal">∞</mi></msubsup></mrow></mstyle></mtd></mtr><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow/></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mo>=</mo><msubsup><mover accent="true"><mfrac><msup><mi>r</mi><mi>n</mi></msup><mrow><mi>n</mi><mo stretchy="false">!</mo></mrow></mfrac><mo stretchy="true">→</mo></mover><mrow><mi>n</mi><mo>=</mo><mn>0</mn></mrow><mi mathvariant="normal">∞</mi></msubsup><mo>⋅</mo><msubsup><mover accent="true"><msup><mi>x</mi><mrow><mi>n</mi><mo>+</mo><mi>q</mi></mrow></msup><mo stretchy="true">→</mo></mover><mrow><mi>n</mi><mo>=</mo><mn>0</mn></mrow><mi mathvariant="normal">∞</mi></msubsup></mrow></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mtext>(note of Lemma 5)</mtext></mstyle></mtd></mtr><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow/></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mo>=</mo><msup><mi>x</mi><mi>q</mi></msup><msubsup><mover accent="true"><mfrac><mn>1</mn><mrow><mi>n</mi><mo stretchy="false">!</mo></mrow></mfrac><mo stretchy="true">→</mo></mover><mrow><mi>n</mi><mo>=</mo><mn>0</mn></mrow><mi mathvariant="normal">∞</mi></msubsup><mo>⋅</mo><msubsup><mover accent="true"><msup><mrow><mo fence="true">(</mo><mi>r</mi><mi>x</mi><mo fence="true">)</mo></mrow><mi>n</mi></msup><mo stretchy="true">→</mo></mover><mrow><mi>n</mi><mo>=</mo><mn>0</mn></mrow><mi mathvariant="normal">∞</mi></msubsup></mrow></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mtext>(Lemma 4)</mtext></mstyle></mtd></mtr><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow/></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mo>=</mo><msup><mi>x</mi><mi>q</mi></msup><msup><mi mathvariant="normal">e</mi><mrow><mi>r</mi><mi>x</mi></mrow></msup><mi mathvariant="normal">.</mi></mrow></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mtext>(Definition 14)</mtext></mstyle></mtd></mtr></mtable><annotation encoding="application/x-tex">\begin{align*}
y&amp;=\overrightarrow{\frac{\frac{n!}{\left(n-q\right)!}}{n!}}_{n=0}^{\infty}\cdot\overrightarrow{x^n}_{n=0}^\infty&amp;
\text{(Definition 6)}\\
&amp;=\overrightarrow{\frac{r^{n-q}}{\left(n-q\right)!}}_{n=0}^{\infty}\cdot\overrightarrow{x^n}_{n=0}^\infty\\
&amp;=\overrightarrow{\frac{r^n}{n!}}_{n=0}^{\infty}\cdot\overrightarrow{x^{n+q}}_{n=0}^\infty&amp;
\text{(note of Lemma 5)}\\
&amp;=x^q\overrightarrow{\frac 1{n!}}_{n=0}^{\infty}\cdot\overrightarrow{\left(rx\right)^n}_{n=0}^\infty&amp;
\text{(Lemma 4)}\\
&amp;=x^q\mathrm e^{rx}.&amp;
\text{(Definition 14)}
\end{align*}</annotation></semantics></math></span></span></span> <span class="qed-wrapper qed-span"><span class="qed qed-span"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi mathvariant="normal">□</mi></mrow><annotation encoding="application/x-tex">\square</annotation></semantics></math></span></span></span></span>
</p>
<p class="no-indent">
<strong>Corollary of Lemma 18 and 19.</strong> The function <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mi>y</mi><mo>=</mo><msubsup><mover accent="true"><mrow><msubsup><mover accent="true"><msub><mi>C</mi><mrow><mi>l</mi><mo separator="true">,</mo><mi>q</mi></mrow></msub><mo stretchy="true">→</mo></mover><mrow><mi>q</mi><mo>=</mo><mn>0</mn></mrow><mrow><msub><mi>w</mi><mi>l</mi></msub><mo>−</mo><mn>1</mn></mrow></msubsup><mo>⋅</mo><mover accent="true"><msup><mi>x</mi><mi>q</mi></msup><mo stretchy="true">→</mo></mover><msup><mrow><mi>q</mi><mo>=</mo><mn>0</mn></mrow><mrow><msub><mi>w</mi><mi>l</mi></msub><mo>−</mo><mn>1</mn></mrow></msup><msup><mi mathvariant="normal">e</mi><mrow><msub><mi>r</mi><mi>l</mi></msub><mi>x</mi></mrow></msup></mrow><mo stretchy="true">→</mo></mover><mrow><mi>l</mi><mo>=</mo><mn>1</mn></mrow><mi>o</mi></msubsup><mo>⋅</mo><mover accent="true"><mn>1</mn><mo>⃗</mo></mover></mrow><annotation encoding="application/x-tex">y=\overrightarrow{\overrightarrow{C_{l,q}}_{q=0}^{w_l-1}\cdot\overrightarrow{x^q}{q=0}^{w_l-1}\mathrm e^{r_lx}}_{l=1}^o\cdot\vec 1</annotation></semantics></math></span></span></span> is the general solution of the ODE <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mover accent="true"><mi>p</mi><mo>⃗</mo></mover><mo>⋅</mo><msubsup><mover accent="true"><msup><mi mathvariant="normal">D</mi><mi>k</mi></msup><mo stretchy="true">→</mo></mover><mrow><mi>k</mi><mo>=</mo><mn>0</mn></mrow><mi>m</mi></msubsup><mi>y</mi><mo>=</mo><mn>0</mn><mo separator="true">,</mo></mrow><annotation encoding="application/x-tex">\vec p\cdot\overrightarrow{\mathrm D^k}_{k=0}^m y=0,</annotation></semantics></math></span></span></span> where <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><msubsup><mover accent="true"><msub><mi>r</mi><mi>l</mi></msub><mo stretchy="true">→</mo></mover><mrow><mi>l</mi><mo>=</mo><mn>1</mn></mrow><mi>o</mi></msubsup></mrow><annotation encoding="application/x-tex">\overrightarrow{r_l}_{l=1}^o</annotation></semantics></math></span></span> are the different roots of the polynomial with coefficients <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mover accent="true"><mi>p</mi><mo>⃗</mo></mover></mrow><annotation encoding="application/x-tex">\vec p</annotation></semantics></math></span></span>, and <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><msubsup><mover accent="true"><msub><mi>w</mi><mi>l</mi></msub><mo stretchy="true">→</mo></mover><mrow><mi>l</mi><mo>=</mo><mn>1</mn></mrow><mi>o</mi></msubsup></mrow><annotation encoding="application/x-tex">\overrightarrow{w_l}_{l=1}^o</annotation></semantics></math></span></span> are the corresponding multiplicities of the roots, and <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><msub><mi>C</mi><mrow><mi>l</mi><mo separator="true">,</mo><mi>q</mi></mrow></msub></mrow><annotation encoding="application/x-tex">C_{l,q}</annotation></semantics></math></span></span> are arbitrary constants.
</p>
<p>Finally, according to all the lemmas above, we now know how to solve the ODE <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mover accent="true"><mi>p</mi><mo>⃗</mo></mover><mo>⋅</mo><msubsup><mover accent="true"><msup><mi mathvariant="normal">D</mi><mi>k</mi></msup><mo stretchy="true">→</mo></mover><mrow><mi>k</mi><mo>=</mo><mn>0</mn></mrow><mi>m</mi></msubsup><mi>y</mi><mo>=</mo><mn>0</mn><mo separator="true">,</mo></mrow><annotation encoding="application/x-tex">\vec p\cdot\overrightarrow{\mathrm D^k}_{k=0}^m y=0,</annotation></semantics></math></span></span></span> where the <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mo fence="true">(</mo><mi>m</mi><mo>+</mo><mn>1</mn><mo fence="true">)</mo></mrow><annotation encoding="application/x-tex">\left(m+1\right)</annotation></semantics></math></span></span>th component of <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mover accent="true"><mi>p</mi><mo>⃗</mo></mover></mrow><annotation encoding="application/x-tex">\vec p</annotation></semantics></math></span></span> is not zero. Actually, all we need to do is to solve the polynomial with coefficients <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mover accent="true"><mi>p</mi><mo>⃗</mo></mover></mrow><annotation encoding="application/x-tex">\vec p</annotation></semantics></math></span></span>, and use the corollary above, and then we can get the general solution of the original ODE.</p>
<p>The method is identical to that in <cite>Advanced Mathematics</cite> (notes of translation: this is a popular book in China about calculus), but the derivation is different. Although mine is much more complex, but it is very interesting, because it involves much knowledge in algebra.</p>
<p>(I haven’t used the summation symbol! I’m so good!</p>
<p>The whole article is using the scalar product of vectors as summation, very entertaining. Actually, when examining linear problems, vectors are good. Also, it looks clear if I use the vector notation.)</p>]]></content><author><name>UlyssesZhan</name><email>ulysseszhan@gmail.com</email></author><category term="math" /><category term="calculus" /><category term="linear algebra" /><category term="combinatorics" /><category term="ode" /><category term="long paper" /><category term="from zhihu" /><summary type="html"><![CDATA[By using power series, we can prove that the problem of solving linear homogeneous ODE with constant coefficients can be reduced to the problem of solving a polynomial with those coefficients. This article illustrates this point in detail, but it uses a very awful notation…]]></summary><media:thumbnail xmlns:media="http://search.yahoo.com/mrss/" url="https://ulysseszh.github.io/assets/images/covers/2022-11-06-linear-ode-solution.png" /><media:content medium="image" url="https://ulysseszh.github.io/assets/images/covers/2022-11-06-linear-ode-solution.png" xmlns:media="http://search.yahoo.com/mrss/" /></entry><entry><title type="html"><![CDATA[Thoughts on a middle school thermal physics problem]]></title><link href="https://ulysseszh.github.io/physics/2022/11/06/separate-and-heat.html" rel="alternate" type="text/html" title="Thoughts on a middle school thermal physics problem" /><published>2022-11-06T09:21:56-08:00</published><updated>2022-11-06T09:21:56-08:00</updated><id>https://ulysseszh.github.io/physics/2022/11/06/separate-and-heat</id><content type="html" xml:base="https://ulysseszh.github.io/physics/2022/11/06/separate-and-heat.html"><![CDATA[<p>
  <em>This article is translated from a Chinese <a href="https://zhuanlan.zhihu.com/p/60146217" target="_blank" rel="external">article</a> on my Zhihu account. The original article was posted at 2019-03-23 12:49 +0800.</em>
</p>
<hr/>
<blockquote>
<p>A field construction requires heating an aluminum alloy component of mass <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mn>4.2</mn><mtext> </mtext><mrow><mi mathvariant="normal">k</mi><mi mathvariant="normal">g</mi></mrow></mrow><annotation encoding="application/x-tex">4.2\,\mathrm{kg}</annotation></semantics></math></span></span> from <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mn>1</mn><msup><mn>0</mn><mo>∘</mo></msup><mi mathvariant="normal">C</mi></mrow><annotation encoding="application/x-tex">10^\circ\mathrm{C}</annotation></semantics></math></span></span> to <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mn>6</mn><msup><mn>3</mn><mo>∘</mo></msup><mi mathvariant="normal">C</mi></mrow><annotation encoding="application/x-tex">63^\circ\mathrm{C}</annotation></semantics></math></span></span> or above. Now, we only have <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mn>1.2</mn><mtext> </mtext><mrow><mi mathvariant="normal">k</mi><mi mathvariant="normal">g</mi></mrow></mrow><annotation encoding="application/x-tex">1.2\,\mathrm{kg}</annotation></semantics></math></span></span> of water of <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mn>9</mn><msup><mn>0</mn><mo>∘</mo></msup><mi mathvariant="normal">C</mi></mrow><annotation encoding="application/x-tex">90^\circ\mathrm{C}</annotation></semantics></math></span></span> in the thermos. Ignoring heat dissipation, design a method to heat the component.</p>
</blockquote>
<p>These texts are adapted from some competition problem from Zhejiang. Just throwing the component into the water is not the correct method. The correct answer is to divide the hot water into <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mn>3</mn></mrow><annotation encoding="application/x-tex">3</annotation></semantics></math></span></span> (or more) parts of equal mass, and heat the components for <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mn>3</mn></mrow><annotation encoding="application/x-tex">3</annotation></semantics></math></span></span> times.</p>
<p>The more parts we separate the hot water into, the higher the final temperature of the component is. This can trigger our thoughts: what is the final temperature if the number of parts tends to infinity?</p>
<p>Suppose the heat capacity of the component is <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><msub><mi>C</mi><mn>0</mn></msub></mrow><annotation encoding="application/x-tex">C_0</annotation></semantics></math></span></span>, the initial temperature is <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><msub><mi>T</mi><mn>0</mn></msub></mrow><annotation encoding="application/x-tex">T_0</annotation></semantics></math></span></span>; the heat capacity of hot water is <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>C</mi></mrow><annotation encoding="application/x-tex">C</annotation></semantics></math></span></span>, the temperature is <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>T</mi></mrow><annotation encoding="application/x-tex">T</annotation></semantics></math></span></span>. Separate the hot water into <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>n</mi></mrow><annotation encoding="application/x-tex">n</annotation></semantics></math></span></span> parts of equal heat capacity (i.e. equal mass). Suppose the temperature of the component is <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><msub><mi>T</mi><mi>m</mi></msub></mrow><annotation encoding="application/x-tex">T_m</annotation></semantics></math></span></span> after reaching thermal equilibrium with the <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>m</mi></mrow><annotation encoding="application/x-tex">m</annotation></semantics></math></span></span>th part of the water. Then, the final temperature is <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><msub><mi>T</mi><mi>n</mi></msub></mrow><annotation encoding="application/x-tex">T_n</annotation></semantics></math></span></span>.</p>
<p>We now want to find the final temperature at <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>n</mi><mo>→</mo><mi mathvariant="normal">∞</mi></mrow><annotation encoding="application/x-tex">n\to\infty</annotation></semantics></math></span></span>: <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><msup><mi>T</mi><mo mathvariant="normal" lspace="0em" rspace="0em">′</mo></msup><mo><mi mathvariant="normal">≔</mi></mo><munder><mrow><mi>lim</mi><mo>⁡</mo></mrow><mrow><mi>n</mi><mo>→</mo><mi mathvariant="normal">∞</mi></mrow></munder><msub><mi>T</mi><mi>n</mi></msub><mi mathvariant="normal">.</mi></mrow><annotation encoding="application/x-tex">T'\coloneqq\lim_{n\to\infty}T_n.</annotation></semantics></math></span></span></span> According to the formula of thermal equilibrium, <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><msub><mi>C</mi><mn>0</mn></msub><mrow><mo fence="true">(</mo><msub><mi>T</mi><mrow><mi>m</mi><mo>+</mo><mn>1</mn></mrow></msub><mo>−</mo><msub><mi>T</mi><mi>m</mi></msub><mo fence="true">)</mo></mrow><mo>+</mo><mfrac><mi>C</mi><mi>n</mi></mfrac><mrow><mo fence="true">(</mo><msub><mi>T</mi><mrow><mi>m</mi><mo>+</mo><mn>1</mn></mrow></msub><mo>−</mo><mi>T</mi><mo fence="true">)</mo></mrow><mo>=</mo><mn>0.</mn></mrow><annotation encoding="application/x-tex">C_0\left(T_{m+1}-T_m\right)+\frac Cn\left(T_{m+1}-T\right)=0.</annotation></semantics></math></span></span></span> Solve for
<span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><msub><mi>T</mi><mrow><mi>m</mi><mo>+</mo><mn>1</mn></mrow></msub></mrow><annotation encoding="application/x-tex">T_{m+1}</annotation></semantics></math></span></span>: <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><msub><mi>T</mi><mrow><mi>m</mi><mo>+</mo><mn>1</mn></mrow></msub><mo>=</mo><mfrac><mrow><msub><mi>C</mi><mn>0</mn></msub><msub><mi>T</mi><mi>m</mi></msub><mo>+</mo><mfrac><mi>C</mi><mi>n</mi></mfrac><mi>T</mi></mrow><mrow><msub><mi>C</mi><mn>0</mn></msub><mo>+</mo><mfrac><mi>C</mi><mi>n</mi></mfrac></mrow></mfrac><mi mathvariant="normal">.</mi></mrow><annotation encoding="application/x-tex">T_{m+1}=\frac{C_0T_m+\frac CnT}{C_0+\frac Cn}.</annotation></semantics></math></span></span></span> Let
<span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>k</mi><mo><mi mathvariant="normal">≔</mi></mo><mfrac><msub><mi>C</mi><mn>0</mn></msub><mrow><msub><mi>C</mi><mn>0</mn></msub><mo>+</mo><mfrac><mi>C</mi><mi>n</mi></mfrac></mrow></mfrac></mrow><annotation encoding="application/x-tex">k\coloneqq\frac{C_0}{C_0+\frac Cn}</annotation></semantics></math></span></span>, and <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>b</mi><mo><mi mathvariant="normal">≔</mi></mo><mfrac><mrow><mfrac><mi>C</mi><mi>n</mi></mfrac><mi>T</mi></mrow><mrow><msub><mi>C</mi><mn>0</mn></msub><mo>+</mo><mfrac><mi>C</mi><mi>n</mi></mfrac></mrow></mfrac></mrow><annotation encoding="application/x-tex">b\coloneqq\frac{\frac CnT}{C_0+\frac Cn}</annotation></semantics></math></span></span>, and we have
<span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><msub><mi>T</mi><mrow><mi>m</mi><mo>+</mo><mn>1</mn></mrow></msub><mo>=</mo><mi>k</mi><msub><mi>T</mi><mi>m</mi></msub><mo>+</mo><mi>b</mi><mi mathvariant="normal">.</mi></mrow><annotation encoding="application/x-tex">T_{m+1}=kT_m+b.</annotation></semantics></math></span></span></span> Let <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>m</mi><mo><mi mathvariant="normal">≔</mi></mo><mn>0</mn><mo separator="true">,</mo><mn>1</mn><mo separator="true">,</mo><mo>…</mo><mo separator="true">,</mo><mi>n</mi><mo>−</mo><mn>1</mn></mrow><annotation encoding="application/x-tex">m\coloneqq0,1,\ldots,n-1</annotation></semantics></math></span></span> respectively, and we have <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mtable rowspacing="0.25em" columnalign="right left" columnspacing="0em"><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><msub><mi>T</mi><mn>1</mn></msub></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mo>=</mo><mi>k</mi><msub><mi>T</mi><mn>0</mn></msub><mo>+</mo><mi>b</mi><mo separator="true">,</mo></mrow></mstyle></mtd></mtr><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><msub><mi>T</mi><mn>2</mn></msub></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mo>=</mo><mi>k</mi><msub><mi>T</mi><mn>1</mn></msub><mo>+</mo><mi>b</mi><mo separator="true">,</mo></mrow></mstyle></mtd></mtr><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow/></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mi><mi mathvariant="normal">⋮</mi><mpadded height="0em" voffset="0em"><mspace mathbackground="black" width="0em" height="1.5em"/></mpadded></mi></mrow></mstyle></mtd></mtr><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><msub><mi>T</mi><mi>n</mi></msub></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mo>=</mo><mi>k</mi><msub><mi>T</mi><mrow><mi>n</mi><mo>−</mo><mn>1</mn></mrow></msub><mo>+</mo><mi>b</mi><mi mathvariant="normal">.</mi></mrow></mstyle></mtd></mtr></mtable><annotation encoding="application/x-tex">\begin{align*}
T_1&amp;=kT_0+b,\\
T_2&amp;=kT_1+b,\\
&amp;\vdots\\
T_n&amp;=kT_{n-1}+b.
\end{align*}</annotation></semantics></math></span></span></span> Transform the <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>n</mi></mrow><annotation encoding="application/x-tex">n</annotation></semantics></math></span></span> equations a little, and we have <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mtable rowspacing="0.25em" columnalign="right left right left" columnspacing="0em 1em 0em"><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><msup><mi>k</mi><mrow><mi>n</mi><mo>−</mo><mn>1</mn></mrow></msup><msub><mi>T</mi><mn>1</mn></msub></mrow></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mo>=</mo><msup><mi>k</mi><mi>n</mi></msup><msub><mi>T</mi><mn>0</mn></msub><mo>+</mo><msup><mi>k</mi><mrow><mi>n</mi><mo>−</mo><mn>1</mn></mrow></msup><mi>b</mi><mo separator="true">,</mo><msup><mi>k</mi><mrow><mi>n</mi><mo>−</mo><mn>2</mn></mrow></msup><msub><mi>T</mi><mn>2</mn></msub></mrow></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mo>=</mo><msup><mi>k</mi><mrow><mi>n</mi><mo>−</mo><mn>1</mn></mrow></msup><msub><mi>T</mi><mn>1</mn></msub><mo>+</mo><msup><mi>k</mi><mrow><mi>n</mi><mo>−</mo><mn>2</mn></mrow></msup><mi>b</mi><mo separator="true">,</mo></mrow></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mi><mi mathvariant="normal">⋮</mi><mpadded height="0em" voffset="0em"><mspace mathbackground="black" width="0em" height="1.5em"/></mpadded></mi></mrow></mstyle></mtd></mtr><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><msub><mi>T</mi><mi>n</mi></msub><mo>=</mo><mi>k</mi><msub><mi>T</mi><mrow><mi>n</mi><mo>−</mo><mn>1</mn></mrow></msub><mo>+</mo><mi>b</mi><mi mathvariant="normal">.</mi></mrow></mstyle></mtd></mtr></mtable><annotation encoding="application/x-tex">\begin{align*}
k^{n-1}T_1&amp;=k^nT_0+k^{n-1}b,
k^{n-2}T_2&amp;=k^{n-1}T_1+k^{n-2}b,
&amp;\vdots\\
T_n=kT_{n-1}+b.
\end{align*}</annotation></semantics></math></span></span></span>
Sum up all the <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>n</mi></mrow><annotation encoding="application/x-tex">n</annotation></semantics></math></span></span> equations, and we have <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><msub><mi>T</mi><mi>n</mi></msub><mo>=</mo><msup><mi>k</mi><mi>n</mi></msup><msub><mi>T</mi><mn>0</mn></msub><mo>+</mo><munderover><mo>∑</mo><mrow><mi>j</mi><mo>=</mo><mn>0</mn></mrow><mrow><mi>n</mi><mo>−</mo><mn>1</mn></mrow></munderover><msup><mi>k</mi><mi>j</mi></msup><mi>b</mi><mi mathvariant="normal">.</mi></mrow><annotation encoding="application/x-tex">T_n=k^nT_0+\sum_{j=0}^{n-1}k^jb.</annotation></semantics></math></span></span></span> According to the formula for summation of geometric progression, we have <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><msub><mi>T</mi><mi>n</mi></msub><mo>=</mo><msup><mi>k</mi><mi>n</mi></msup><msub><mi>T</mi><mn>0</mn></msub><mo>+</mo><mfrac><mrow><mn>1</mn><mo>−</mo><msup><mi>k</mi><mi>n</mi></msup></mrow><mrow><mn>1</mn><mo>−</mo><mi>k</mi></mrow></mfrac><mi>b</mi></mrow><annotation encoding="application/x-tex">T_n=k^nT_0+\frac{1-k^n}{1-k}b</annotation></semantics></math></span></span></span> (this is actually the formula for the <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>n</mi></mrow><annotation encoding="application/x-tex">n</annotation></semantics></math></span></span>th recursion of linear function.)</p>
<p>Because <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mtable rowspacing="0.25em" columnalign="right left" columnspacing="0em"><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mi>b</mi></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mo><mi mathvariant="normal">≔</mi></mo><mfrac><mrow><mfrac><mi>C</mi><mi>n</mi></mfrac><mi>T</mi></mrow><mrow><msub><mi>C</mi><mn>0</mn></msub><mo>+</mo><mfrac><mi>C</mi><mi>n</mi></mfrac></mrow></mfrac></mrow></mstyle></mtd></mtr><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow/></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mo>=</mo><mfrac><msub><mi>C</mi><mn>0</mn></msub><mrow><msub><mi>C</mi><mn>0</mn></msub><mo>+</mo><mfrac><mi>C</mi><mi>n</mi></mfrac></mrow></mfrac><mfrac><mrow><mfrac><mi>C</mi><mi>n</mi></mfrac><mi>T</mi></mrow><msub><mi>C</mi><mn>0</mn></msub></mfrac></mrow></mstyle></mtd></mtr><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow/></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mo>=</mo><mfrac><msub><mi>C</mi><mn>0</mn></msub><mrow><msub><mi>C</mi><mn>0</mn></msub><mo>+</mo><mfrac><mi>C</mi><mi>n</mi></mfrac></mrow></mfrac><mrow><mo fence="true">(</mo><mfrac><mrow><msub><mi>C</mi><mn>0</mn></msub><mo>+</mo><mfrac><mi>C</mi><mi>n</mi></mfrac></mrow><msub><mi>C</mi><mn>0</mn></msub></mfrac><mo>−</mo><mn>1</mn><mo fence="true">)</mo></mrow><mi>T</mi></mrow></mstyle></mtd></mtr><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow/></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mo>=</mo><mrow><mo fence="true">(</mo><mn>1</mn><mo>−</mo><mfrac><msub><mi>C</mi><mn>0</mn></msub><mrow><msub><mi>C</mi><mn>0</mn></msub><mo>+</mo><mfrac><mi>C</mi><mi>n</mi></mfrac></mrow></mfrac><mo fence="true">)</mo></mrow><mi>T</mi><mo separator="true">,</mo></mrow></mstyle></mtd></mtr></mtable><annotation encoding="application/x-tex">\begin{align*}
b&amp;\coloneqq\frac{\frac CnT}{C_0+\frac Cn}\\
&amp;=\frac{C_0}{C_0+\frac Cn}\frac{\frac CnT}{C_0}\\
&amp;=\frac{C_0}{C_0+\frac Cn}\left(\frac{C_0+\frac Cn}{C_0}-1\right)T\\
&amp;=\left(1-\frac{C_0}{C_0+\frac Cn}\right)T,
\end{align*}</annotation></semantics></math></span></span></span>
then <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mtable rowspacing="0.25em" columnalign="right left" columnspacing="0em"><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><msub><mi>T</mi><mi>n</mi></msub></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mo>=</mo><msup><mi>k</mi><mi>n</mi></msup><msub><mi>T</mi><mn>0</mn></msub><mo>+</mo><mfrac><mrow><mn>1</mn><mo>−</mo><msup><mi>k</mi><mi>n</mi></msup></mrow><mrow><mn>1</mn><mo>−</mo><mi>k</mi></mrow></mfrac><mrow><mo fence="true">(</mo><mn>1</mn><mo>−</mo><mi>k</mi><mo fence="true">)</mo></mrow><mi>T</mi></mrow></mstyle></mtd></mtr><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow/></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mo>=</mo><mi>T</mi><mo>+</mo><msup><mi>k</mi><mi>n</mi></msup><mrow><mo fence="true">(</mo><msub><mi>T</mi><mn>0</mn></msub><mo>−</mo><mi>T</mi><mo fence="true">)</mo></mrow><mi mathvariant="normal">.</mi></mrow></mstyle></mtd></mtr></mtable><annotation encoding="application/x-tex">\begin{align*}
T_n&amp;=k^nT_0+\frac{1-k^n}{1-k}\left(1-k\right)T\\
&amp;=T+k^n\left(T_0-T\right).
\end{align*}</annotation></semantics></math></span></span></span> Now calculate the limit of <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><msup><mi>k</mi><mi>n</mi></msup></mrow><annotation encoding="application/x-tex">k^n</annotation></semantics></math></span></span>. We have
<span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mtable rowspacing="0.25em" columnalign="right left" columnspacing="0em"><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><munder><mrow><mi>lim</mi><mo>⁡</mo></mrow><mrow><mi>n</mi><mo>→</mo><mi mathvariant="normal">∞</mi></mrow></munder><msup><mi>k</mi><mi>n</mi></msup></mrow></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mo>=</mo><munder><mrow><mi>lim</mi><mo>⁡</mo></mrow><mrow><mi>n</mi><mo>→</mo><mi mathvariant="normal">∞</mi></mrow></munder><msup><mrow><mo fence="true">(</mo><mfrac><msub><mi>C</mi><mn>0</mn></msub><mrow><msub><mi>C</mi><mn>0</mn></msub><mo>+</mo><mfrac><mi>C</mi><mi>n</mi></mfrac></mrow></mfrac><mo fence="true">)</mo></mrow><mi>n</mi></msup></mrow></mstyle></mtd></mtr><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow/></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mo>=</mo><munder><mrow><mi>lim</mi><mo>⁡</mo></mrow><mrow><mi>n</mi><mo>→</mo><mi mathvariant="normal">∞</mi></mrow></munder><mfrac><mn>1</mn><msup><mrow><mo fence="true">(</mo><mfrac><mrow><msub><mi>C</mi><mn>0</mn></msub><mo>+</mo><mfrac><mi>C</mi><mi>n</mi></mfrac></mrow><msub><mi>C</mi><mn>0</mn></msub></mfrac><mo fence="true">)</mo></mrow><mi>n</mi></msup></mfrac></mrow></mstyle></mtd></mtr><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow/></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mo>=</mo><munder><mrow><mi>lim</mi><mo>⁡</mo></mrow><mrow><mi>n</mi><mo>→</mo><mi mathvariant="normal">∞</mi></mrow></munder><mfrac><mn>1</mn><msup><mrow><mo fence="true">(</mo><mn>1</mn><mo>+</mo><mfrac><mfrac><mi>C</mi><msub><mi>C</mi><mn>0</mn></msub></mfrac><mi>n</mi></mfrac><mo fence="true">)</mo></mrow><mi>n</mi></msup></mfrac></mrow></mstyle></mtd></mtr><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow/></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mo>=</mo><msup><mi mathvariant="normal">e</mi><mrow><mo>−</mo><mfrac><mi>C</mi><msub><mi>C</mi><mn>0</mn></msub></mfrac></mrow></msup><mi mathvariant="normal">.</mi></mrow></mstyle></mtd></mtr></mtable><annotation encoding="application/x-tex">\begin{align*}
\lim_{n\to\infty}k^n&amp;=\lim_{n\to\infty}\left(\frac{C_0}{C_0+\frac Cn}\right)^n\\
&amp;=\lim_{n\to\infty}\frac1{\left(\frac{C_0+\frac Cn}{C_0}\right)^n}\\
&amp;=\lim_{n\to\infty}\frac{1}{\left(1+\frac{\frac C{C_0}}{n}\right)^n}\\
&amp;=\mathrm e^{-\frac C{C_0}}.
\end{align*}</annotation></semantics></math></span></span></span>
Therefore, <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mtable rowspacing="0.25em" columnalign="right left" columnspacing="0em"><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><msup><mi>T</mi><mo mathvariant="normal" lspace="0em" rspace="0em">′</mo></msup></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mo><mi mathvariant="normal">≔</mi></mo><munder><mrow><mi>lim</mi><mo>⁡</mo></mrow><mrow><mi>n</mi><mo>→</mo><mi mathvariant="normal">∞</mi></mrow></munder><msub><mi>T</mi><mi>n</mi></msub></mrow></mstyle></mtd></mtr><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow/></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow/><mo>=</mo><mi>T</mi><mo>+</mo><msup><mi mathvariant="normal">e</mi><mrow><mo>−</mo><mfrac><mi>C</mi><msub><mi>C</mi><mn>0</mn></msub></mfrac></mrow></msup><mrow><mo fence="true">(</mo><msub><mi>T</mi><mn>0</mn></msub><mo>−</mo><mi>T</mi><mo fence="true">)</mo></mrow><mi mathvariant="normal">.</mi></mrow></mstyle></mtd></mtr></mtable><annotation encoding="application/x-tex">\begin{align*}
T'&amp;\coloneqq\lim_{n\to\infty}T_n\\
&amp;=T+\mathrm e^{-\frac C{C_0}}\left(T_0-T\right).
\end{align*}</annotation></semantics></math></span></span></span> This is a intuitive result.</p>
<p>(Gonna take exams for high school entrance…)</p>]]></content><author><name>UlyssesZhan</name><email>ulysseszhan@gmail.com</email></author><category term="physics" /><category term="calculus" /><category term="number sequence" /><category term="from zhihu" /><summary type="html"><![CDATA[To heat an object with hot water, if we divide the water into more parts and use each part to heat the object one after another, the final temperature will be higher. If the number of parts tends to infinity, then the final temperature will tend to the limit <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>T</mi><mo>+</mo><msup><mi mathvariant="normal">e</mi><mrow><mo>−</mo><mfrac><mi>C</mi><msub><mi>C</mi><mn>0</mn></msub></mfrac></mrow></msup><mrow><mo fence="true">(</mo><msub><mi>T</mi><mn>0</mn></msub><mo>−</mo><mi>T</mi><mo fence="true">)</mo></mrow></mrow><annotation encoding="application/x-tex">T+\mathrm e^{-\frac C{C_0}}\left(T_0-T\right)</annotation></semantics></math></span></span>, where <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>T</mi></mrow><annotation encoding="application/x-tex">T</annotation></semantics></math></span></span> is the initial temperature of the object, <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><msub><mi>T</mi><mn>0</mn></msub></mrow><annotation encoding="application/x-tex">T_0</annotation></semantics></math></span></span> is the temperature of the hot water, <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>C</mi></mrow><annotation encoding="application/x-tex">C</annotation></semantics></math></span></span> is the heat capacity of the object, and <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><msub><mi>C</mi><mn>0</mn></msub></mrow><annotation encoding="application/x-tex">C_0</annotation></semantics></math></span></span> is the heat capacity of the hot water.]]></summary><media:thumbnail xmlns:media="http://search.yahoo.com/mrss/" url="https://ulysseszh.github.io/assets/images/covers/2022-11-06-separate-and-heat.png" /><media:content medium="image" url="https://ulysseszh.github.io/assets/images/covers/2022-11-06-separate-and-heat.png" xmlns:media="http://search.yahoo.com/mrss/" /></entry><entry><title type="html"><![CDATA[Generalization of Euler–Lagrange equation]]></title><link href="https://ulysseszh.github.io/math/2020/05/31/high-dim-euler-eq.html" rel="alternate" type="text/html" title="Generalization of Euler–Lagrange equation" /><published>2020-05-30T21:53:17-07:00</published><updated>2020-05-30T21:53:17-07:00</updated><id>https://ulysseszh.github.io/math/2020/05/31/high-dim-euler-eq</id><content type="html" xml:base="https://ulysseszh.github.io/math/2020/05/31/high-dim-euler-eq.html"><![CDATA[<p><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi mathvariant="normal">Ω</mi><mo>∈</mo><msup><mi mathvariant="double-struck">R</mi><mi>m</mi></msup></mrow><annotation encoding="application/x-tex">\Omega\in\mathbb R^m</annotation></semantics></math></span></span> is a closed region. The variable <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi mathvariant="bold">f</mi><mo>:</mo><mi mathvariant="normal">Ω</mi><mo>→</mo><msup><mi mathvariant="double-struck">R</mi><mi>p</mi></msup></mrow><annotation encoding="application/x-tex">\mathbf f:\Omega\rightarrow\mathbb R^p</annotation></semantics></math></span></span> is an <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>n</mi></mrow><annotation encoding="application/x-tex">n</annotation></semantics></math></span></span> differentiable function with fixed boundary conditions on <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi mathvariant="normal">∂</mi><mi mathvariant="normal">Ω</mi></mrow><annotation encoding="application/x-tex">\partial\Omega</annotation></semantics></math></span></span>. The function <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi mathvariant="script">L</mi></mrow><annotation encoding="application/x-tex">\mathcal L</annotation></semantics></math></span></span> is real-valued and has continuous first partial derivatives, and the <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mn>0</mn></mrow><annotation encoding="application/x-tex">0</annotation></semantics></math></span></span>th to <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>n</mi></mrow><annotation encoding="application/x-tex">n</annotation></semantics></math></span></span>th partial derivatives of <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi mathvariant="bold">f</mi></mrow><annotation encoding="application/x-tex">\mathbf f</annotation></semantics></math></span></span> and the independent variable <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi mathvariant="bold">x</mi><mo>∈</mo><mi mathvariant="normal">Ω</mi></mrow><annotation encoding="application/x-tex">\mathbf x\in\Omega</annotation></semantics></math></span></span> will be arguments of <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi mathvariant="script">L</mi></mrow><annotation encoding="application/x-tex">\mathcal L</annotation></semantics></math></span></span>. Define a functional <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mi>I</mi><mo><mi mathvariant="normal">≔</mi></mo><mi mathvariant="bold">f</mi><mo>↦</mo><msub><mo>∫</mo><mi mathvariant="normal">Ω</mi></msub><mi mathvariant="script">L</mi><mrow><mo fence="true">(</mo><mo>⋯</mo><mtext> </mtext><mo fence="true">)</mo></mrow><mi mathvariant="normal">d</mi><mi>V</mi><mo separator="true">,</mo></mrow><annotation encoding="application/x-tex">
    I\coloneqq\mathbf f\mapsto\int_\Omega\mathcal L\left(\cdots\right)\mathrm dV,
</annotation></semantics></math></span></span></span> where <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi mathvariant="normal">d</mi><mi>V</mi></mrow><annotation encoding="application/x-tex">\mathrm dV</annotation></semantics></math></span></span> is the volume element in <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi mathvariant="normal">Ω</mi></mrow><annotation encoding="application/x-tex">\Omega</annotation></semantics></math></span></span>. Then the extremal of <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>I</mi></mrow><annotation encoding="application/x-tex">I</annotation></semantics></math></span></span> satisfies a set of PDEs with respect to <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi mathvariant="bold">f</mi></mrow><annotation encoding="application/x-tex">\mathbf f</annotation></semantics></math></span></span>. The set of PDEs consists of <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>p</mi></mrow><annotation encoding="application/x-tex">p</annotation></semantics></math></span></span> equations, the <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>i</mi></mrow><annotation encoding="application/x-tex">i</annotation></semantics></math></span></span>th of which is <span id="eq:ret" data-label="(1)"><span class="katex-display-table"> <span class="katex-display-numbered"><span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><munderover><mo>∑</mo><mrow><mi>j</mi><mo>=</mo><mn>0</mn></mrow><mi>n</mi></munderover><munder><mo>∑</mo><mrow><mi>μ</mi><mo>∈</mo><msub><mi>P</mi><mrow><mi>j</mi><mo separator="true">,</mo><mi>m</mi></mrow></msub></mrow></munder><msup><mrow><mo fence="true">(</mo><mo>−</mo><mn>1</mn><mo fence="true">)</mo></mrow><mi>j</mi></msup><msub><mi mathvariant="normal">∂</mi><mi>μ</mi></msub><mfrac><mrow><mi mathvariant="normal">∂</mi><mi mathvariant="script">L</mi></mrow><mrow><mi mathvariant="normal">∂</mi><mrow><mo fence="true">(</mo><msub><mi mathvariant="normal">∂</mi><mi>μ</mi></msub><msub><mi>f</mi><mi>i</mi></msub><mo fence="true">)</mo></mrow></mrow></mfrac><mo>=</mo><mn>0</mn><mo separator="true">,</mo></mrow><annotation encoding="application/x-tex">\sum_{j=0}^n\sum_{\mu\in P_{j,m}}\left(-1\right)^j
    \partial_\mu\frac{\partial\mathcal L}{\partial\left(\partial_\mu f_i\right)}=0,</annotation></semantics></math></span></span></span></span> <span class="katex-display-number"><span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mo stretchy="false">(</mo><mn>1</mn><mo stretchy="false">)</mo></mrow><annotation encoding="application/x-tex">(1)</annotation></semantics></math></span></span></span></span> </span></span> where <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><msub><mi>P</mi><mrow><mi>j</mi><mo separator="true">,</mo><mi>m</mi></mrow></msub></mrow><annotation encoding="application/x-tex">P_{j,m}</annotation></semantics></math></span></span> is the set of all (not necessarily strictly) ascending <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>j</mi></mrow><annotation encoding="application/x-tex">j</annotation></semantics></math></span></span>-tuples in
<span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><msup><mrow><mo fence="true">{</mo><mn>1</mn><mo separator="true">,</mo><mo>…</mo><mo separator="true">,</mo><mi>m</mi><mo fence="true">}</mo></mrow><mi>j</mi></msup></mrow><annotation encoding="application/x-tex">\left\{1,\dots,m\right\}^j</annotation></semantics></math></span></span>, and <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><msub><mi mathvariant="normal">∂</mi><mi>μ</mi></msub><mo><mi mathvariant="normal">≔</mi></mo><mfrac><msup><mi mathvariant="normal">∂</mi><mrow><mi mathvariant="normal">len</mi><mo>⁡</mo><mi>μ</mi></mrow></msup><mrow><munder><mo>∏</mo><mi>k</mi></munder><mi mathvariant="normal">∂</mi><msub><mi>x</mi><msub><mi>μ</mi><mi>k</mi></msub></msub></mrow></mfrac><mi mathvariant="normal">.</mi></mrow><annotation encoding="application/x-tex">
    \partial_\mu\coloneqq\frac{\partial^{\operatorname{len}\mu}}{\prod_k\partial x_{\mu_k}}.
</annotation></semantics></math></span></span></span> Equation <a href="#eq:ret">1</a> is the Generalization of Euler–Lagrange equation.</p>]]></content><author><name>UlyssesZhan</name><email>ulysseszhan@gmail.com</email></author><category term="math" /><category term="calculus" /><summary type="html"><![CDATA[We may generalize Euler–Lagrange equation to higher dimensional optimization problems: find a function defined inside a region to extremize a functional defined as an integral over that region, with the constraint that the value of the function is fixed on the boundary of the region.]]></summary><media:thumbnail xmlns:media="http://search.yahoo.com/mrss/" url="https://ulysseszh.github.io/assets/images/covers/2020-05-31-high-dim-euler-eq.png" /><media:content medium="image" url="https://ulysseszh.github.io/assets/images/covers/2020-05-31-high-dim-euler-eq.png" xmlns:media="http://search.yahoo.com/mrss/" /></entry><entry><title type="html"><![CDATA[Simulating a mechanical system using rpg_core.js]]></title><link href="https://ulysseszh.github.io/physics/2020/05/14/simulation-rpgmv.html" rel="alternate" type="text/html" title="Simulating a mechanical system using rpg_core.js" /><published>2020-05-13T09:57:39-07:00</published><updated>2020-05-13T09:57:39-07:00</updated><id>https://ulysseszh.github.io/physics/2020/05/14/simulation-rpgmv</id><content type="html" xml:base="https://ulysseszh.github.io/physics/2020/05/14/simulation-rpgmv.html"><![CDATA[<p>This post is the continuation of <a href="/physics/2020/04/28/simulation-rgss.html">the last post</a>.</p>
<p>If you visit <a href="/rpg/mechsimul/">the page</a> I have just created, you may find the simulation of a mechanical system.</p>
<figure>
<img src="/assets/images/figures/2020-05-14-simulation-rpgmv/rpgmv_simul.png" alt="Result of simulation"/>

</figure>
<p>It is currently <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mi mathvariant="script">H</mi><mo>=</mo><msubsup><mi>p</mi><mn>1</mn><mn>2</mn></msubsup><mo>+</mo><msubsup><mi>p</mi><mn>2</mn><mn>2</mn></msubsup><mo>−</mo><mi>cos</mi><mo>⁡</mo><msub><mi>q</mi><mn>1</mn></msub><mo>−</mo><mi>cos</mi><mo>⁡</mo><msub><mi>q</mi><mn>2</mn></msub><mo>−</mo><mi>cos</mi><mo>⁡</mo><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><msub><mi>q</mi><mn>1</mn></msub><mo>−</mo><msub><mi>q</mi><mn>2</mn></msub><mo fence="true">)</mo></mrow></mrow><annotation encoding="application/x-tex">
    \mathcal H=p_1^2+p_2^2-\cos q_1-\cos q_2-
    \cos\!\left(q_1-q_2\right)
</annotation></semantics></math></span></span></span> depicting two pendulum coupled with a spring (with <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><msub><mi>l</mi><mn>1</mn></msub><mo>=</mo><msub><mi>l</mi><mn>2</mn></msub></mrow><annotation encoding="application/x-tex">l_1=l_2</annotation></semantics></math></span></span> and <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><msub><mi>m</mi><mn>1</mn></msub><mo>=</mo><msub><mi>m</mi><mn>2</mn></msub></mrow><annotation encoding="application/x-tex">m_1=m_2</annotation></semantics></math></span></span>, and the original length of the spring is zero, and the two hanging points overlap),</p>
<figure>
<img src="/assets/images/figures/2020-05-14-simulation-rpgmv/spring_coupled_pendulum.png" class="dark-adaptive" alt="Spring-coupled pendulums"/>

</figure>
<p class="no-indent">
which is a classical example of non-linearly coupled system.
</p>
<p>The pattern of the oscillation can be analyzed using discrete Fourier transformation, whose result can be found by clicking the buttons in the up-left corner (after the simulator has detected a period).</p>
<figure>
<img src="/assets/images/figures/2020-05-14-simulation-rpgmv/rpgmv_simul_fft.png" alt="Result of DFT"/>

</figure>
<p class="no-indent">
Hitting the space bar can make the simulation pause.
</p>
<p>If you want to use it to simulate other mechanical systems, you can study <a href="/rpg/mechsimul/js/mechsimul.js">the codes</a> I wrote and write your own codes in the console.</p>
<p>By the way, the <a href="https://github.com/UlyssesZh/OpenRGSS/" target="_blank" rel="external">OpenRGSS</a> version of the simulator is open-source <a href="https://github.com/UlyssesZh/mechsimul/" target="_blank" rel="external">here</a>. Please star the repo if you like it.</p>]]></content><author><name>UlyssesZhan</name><email>ulysseszhan@gmail.com</email></author><category term="physics" /><category term="javascript" /><category term="rgss" /><category term="hamiltonian" /><category term="calculus" /><category term="ode" /><category term="web" /><category term="fourier transform" /><summary type="html"><![CDATA[Continuing my last work of simulating a mechanical system using RGSS3, I made a new version using rpg_core.js, the game scripting system shipped with RPG Maker MV. This version is live <a href="/rpg/mechsimul">on web</a>!]]></summary><media:thumbnail xmlns:media="http://search.yahoo.com/mrss/" url="https://ulysseszh.github.io/assets/images/covers/2020-05-14-simulation-rpgmv.png" /><media:content medium="image" url="https://ulysseszh.github.io/assets/images/covers/2020-05-14-simulation-rpgmv.png" xmlns:media="http://search.yahoo.com/mrss/" /></entry><entry><title type="html"><![CDATA[Simulating a mechanical system using RGSS3]]></title><link href="https://ulysseszh.github.io/physics/2020/04/28/simulation-rgss.html" rel="alternate" type="text/html" title="Simulating a mechanical system using RGSS3" /><published>2020-04-27T20:51:17-07:00</published><updated>2020-04-27T20:51:17-07:00</updated><id>https://ulysseszh.github.io/physics/2020/04/28/simulation-rgss</id><content type="html" xml:base="https://ulysseszh.github.io/physics/2020/04/28/simulation-rgss.html"><![CDATA[<p>Our goal is to simulate a mechanical system according to its Hamiltonian <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi mathvariant="script">H</mi><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mi mathvariant="bold">q</mi><mo separator="true">,</mo><mi mathvariant="bold">p</mi><mo separator="true">,</mo><mi>t</mi><mo fence="true">)</mo></mrow></mrow><annotation encoding="application/x-tex">\mathcal H\!\left(\mathbf q,\mathbf p,t\right)</annotation></semantics></math></span></span>.</p>
<p>To utilize the canonical equations <span id="eq:canonical" data-label="(1)"><span class="katex-display-table"> <span class="katex-display-numbered"><span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mfrac><mrow><mi mathvariant="normal">d</mi><mi mathvariant="bold">q</mi></mrow><mrow><mi mathvariant="normal">d</mi><mi>t</mi></mrow></mfrac><mo>=</mo><mfrac><mrow><mi mathvariant="normal">∂</mi><mi mathvariant="script">H</mi></mrow><mrow><mi mathvariant="normal">∂</mi><mi mathvariant="bold">p</mi></mrow></mfrac><mo separator="true">,</mo><mspace width="1em"/><mfrac><mrow><mi mathvariant="normal">d</mi><mi mathvariant="bold">p</mi></mrow><mrow><mi mathvariant="normal">d</mi><mi>t</mi></mrow></mfrac><mo>=</mo><mo>−</mo><mfrac><mrow><mi mathvariant="normal">∂</mi><mi mathvariant="script">H</mi></mrow><mrow><mi mathvariant="normal">∂</mi><mi mathvariant="bold">p</mi></mrow></mfrac><mo separator="true">,</mo></mrow><annotation encoding="application/x-tex">\frac{\mathrm d\mathbf q}{\mathrm dt}=
    \frac{\partial\mathcal H}{\partial\mathbf p},\quad
    \frac{\mathrm d\mathbf p}{\mathrm dt}=
    -\frac{\partial\mathcal H}{\partial\mathbf p},</annotation></semantics></math></span></span></span></span> <span class="katex-display-number"><span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mo stretchy="false">(</mo><mn>1</mn><mo stretchy="false">)</mo></mrow><annotation encoding="application/x-tex">(1)</annotation></semantics></math></span></span></span></span> </span></span> we need to calculate the partial derivatives of <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi mathvariant="script">H</mi></mrow><annotation encoding="application/x-tex">\mathcal H</annotation></semantics></math></span></span>. Here is a simple code to calculate partial derivatives.</p>
<table class="rouge-table">
  <tbody>
    <tr>
      <td class="highlight language-ruby">
        <pre>
          <code>
            <span class="line line-1"><span class="k">def</span> <span class="nf">div</span> <span class="n">x0</span><span class="p">,</span> <span class="n">dx</span><span class="p">,</span> <span class="n">f</span>
</span>
            <span class="line line-2">	<span class="n">f0</span> <span class="o">=</span> <span class="n">f</span><span class="o">.</span><span class="p">(</span><span class="n">x0</span><span class="p">)</span>
</span>
            <span class="line line-3">	<span class="n">n</span> <span class="o">=</span> <span class="n">x0</span><span class="p">.</span><span class="nf">size</span>
</span>
            <span class="line line-4">	<span class="no">Array</span><span class="p">.</span><span class="nf">new</span> <span class="n">n</span> <span class="k">do</span> <span class="o">|</span><span class="n">i</span><span class="o">|</span>
</span>
            <span class="line line-5">		<span class="p">(</span><span class="n">f</span><span class="o">.</span><span class="p">(</span><span class="n">x0</span> <span class="o">+</span> <span class="no">Vector</span><span class="p">.</span><span class="nf">basis</span><span class="p">(</span><span class="n">n</span><span class="p">,</span> <span class="n">i</span><span class="p">)</span> <span class="o">*</span> <span class="n">dx</span><span class="p">)</span> <span class="o">-</span> <span class="n">f0</span><span class="p">)</span> <span class="o">/</span> <span class="n">dx</span>
</span>
            <span class="line line-6">	<span class="k">end</span>
</span>
            <span class="line line-7"><span class="k">end</span>
</span>
          </code>
        </pre>
      </td>
    </tr>
  </tbody>
</table>
<p class="no-indent">
(RGSS do not have <code>matrix.rb</code>, you can copy one from the attached file below.) Here <code>x0</code> is a <code>Vector</code>, <code>f</code> is a <code>call</code>-able object as a function of vectors, <code>dx</code> is a small scalar which we are going to take <code>1e-6</code>.
</p>
<p>Let <code>x = Vector[*q, *p]</code>, and then Formula <a href="#eq:canonical">1</a> has the form <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mfrac><mrow><mi mathvariant="normal">d</mi><mi mathvariant="bold">x</mi></mrow><mrow><mi mathvariant="normal">d</mi><mi>t</mi></mrow></mfrac><mo>=</mo><mi>f</mi><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mi mathvariant="bold">x</mi><mo fence="true">)</mo></mrow><mi mathvariant="normal">.</mi></mrow><annotation encoding="application/x-tex">\frac{\mathrm d\mathbf x}{\mathrm dt}=f\!\left(\mathbf x\right).</annotation></semantics></math></span></span></span> To solve this equation numerically, we need to use a famous method called the (explicit) Runge–Kutta method.</p>
<table class="rouge-table">
  <tbody>
    <tr>
      <td class="highlight language-ruby">
        <pre>
          <code>
            <span class="line line-1"><span class="k">def</span> <span class="nf">runge_kutta</span> <span class="n">initial</span><span class="p">,</span> <span class="n">max_t</span><span class="p">,</span> <span class="n">dt</span><span class="p">,</span> <span class="p">(</span><span class="o">*</span><span class="n">pyramid</span><span class="p">,</span> <span class="n">coefs</span><span class="p">),</span> <span class="n">func</span>
</span>
            <span class="line line-2">	<span class="p">(</span><span class="mi">0</span><span class="o">..</span><span class="n">max_t</span><span class="p">).</span><span class="nf">step</span><span class="p">(</span><span class="n">dt</span><span class="p">).</span><span class="nf">reduce</span> <span class="n">initial</span> <span class="k">do</span> <span class="o">|</span><span class="n">ret</span><span class="p">,</span> <span class="n">t</span><span class="o">|</span>
</span>
            <span class="line line-3">		<span class="vg">$canvas</span><span class="p">.</span><span class="nf">trace</span> <span class="n">t</span><span class="p">,</span> <span class="n">ret</span> <span class="k">if</span> <span class="vg">$canvas</span>
</span>
            <span class="line line-4">		<span class="n">coefs</span><span class="p">.</span><span class="nf">zip</span><span class="p">(</span><span class="n">pyramid</span><span class="p">).</span><span class="nf">each_with_object</span><span class="p">([]).</span><span class="nf">sum</span> <span class="k">do</span> <span class="o">|</span><span class="p">(</span><span class="n">coef</span><span class="p">,</span> <span class="n">row</span><span class="p">),</span> <span class="n">ary</span><span class="o">|</span>
</span>
            <span class="line line-5">			<span class="n">coef</span> <span class="o">*</span> <span class="n">ary</span><span class="p">.</span><span class="nf">push</span><span class="p">(</span><span class="n">func</span><span class="o">.</span><span class="p">(</span><span class="n">t</span><span class="p">,</span> <span class="n">row</span><span class="p">.</span><span class="nf">inner</span><span class="p">(</span><span class="n">ary</span><span class="p">)</span> <span class="o">*</span> <span class="n">dt</span> <span class="o">+</span> <span class="n">ret</span><span class="p">)).</span><span class="nf">last</span>
</span>
            <span class="line line-6">		<span class="k">end</span> <span class="o">*</span> <span class="n">dt</span> <span class="o">+</span> <span class="n">ret</span><span class="c1">#p(ret)</span>
</span>
            <span class="line line-7">	<span class="k">end</span>
</span>
            <span class="line line-8"><span class="k">end</span>
</span>
          </code>
        </pre>
      </td>
    </tr>
  </tbody>
</table>
<p class="no-indent">
Note that Runge–Kutta is a family of methods. The argument <code>(*pyramid, coefs)</code> takes one of the following, each of which is a single Runge–Kutta method.
</p>
<table class="rouge-table">
  <tbody>
    <tr>
      <td class="highlight language-ruby">
        <pre>
          <code>
            <span class="line line-1"><span class="no">FORWARD_EULER</span> <span class="o">=</span> <span class="p">[[],[</span><span class="mi">1</span><span class="p">]]</span>
</span>
            <span class="line line-2"><span class="no">EXPLICIT_MIDPOINT</span> <span class="o">=</span> <span class="p">[[],[</span><span class="mi">1</span><span class="o">/</span><span class="mf">2.0</span><span class="p">],[</span><span class="mi">0</span><span class="p">,</span><span class="mi">1</span><span class="p">]]</span>
</span>
            <span class="line line-3"><span class="no">HEUN</span> <span class="o">=</span> <span class="p">[[],[</span><span class="mi">1</span><span class="p">],[</span><span class="mi">1</span><span class="o">/</span><span class="mf">2.0</span><span class="p">,</span><span class="mi">1</span><span class="o">/</span><span class="mf">2.0</span><span class="p">]]</span>
</span>
            <span class="line line-4"><span class="no">RALSTON</span> <span class="o">=</span> <span class="p">[[],[</span><span class="mi">2</span><span class="o">/</span><span class="mf">3.0</span><span class="p">],[</span><span class="mi">1</span><span class="o">/</span><span class="mf">4.0</span><span class="p">,</span><span class="mi">3</span><span class="o">/</span><span class="mf">4.0</span><span class="p">]]</span>
</span>
            <span class="line line-5"><span class="no">KUTTA_3RD</span> <span class="o">=</span> <span class="p">[[],[</span><span class="mi">1</span><span class="o">/</span><span class="mf">2.0</span><span class="p">],[</span><span class="o">-</span><span class="mi">1</span><span class="p">,</span><span class="mi">2</span><span class="p">],[</span><span class="mi">1</span><span class="o">/</span><span class="mf">6.0</span><span class="p">,</span><span class="mi">2</span><span class="o">/</span><span class="mf">3.0</span><span class="p">,</span><span class="mi">1</span><span class="o">/</span><span class="mf">6.0</span><span class="p">]]</span>
</span>
            <span class="line line-6"><span class="no">HEUN_3RD</span> <span class="o">=</span> <span class="p">[[],[</span><span class="mi">1</span><span class="o">/</span><span class="mf">3.0</span><span class="p">],[</span><span class="mi">0</span><span class="p">,</span><span class="mi">2</span><span class="o">/</span><span class="mf">3.0</span><span class="p">],[</span><span class="mi">1</span><span class="o">/</span><span class="mf">4.0</span><span class="p">,</span><span class="mi">0</span><span class="p">,</span><span class="mi">3</span><span class="o">/</span><span class="mf">4.0</span><span class="p">]]</span>
</span>
            <span class="line line-7"><span class="no">RALSTON_3RD</span> <span class="o">=</span> <span class="p">[[],[</span><span class="mi">1</span><span class="o">/</span><span class="mf">2.0</span><span class="p">],[</span><span class="mi">0</span><span class="p">,</span><span class="mi">3</span><span class="o">/</span><span class="mf">4.0</span><span class="p">],[</span><span class="mi">2</span><span class="o">/</span><span class="mf">9.0</span><span class="p">,</span><span class="mi">1</span><span class="o">/</span><span class="mf">3.0</span><span class="p">,</span><span class="mi">4</span><span class="o">/</span><span class="mf">9.0</span><span class="p">]]</span>
</span>
            <span class="line line-8"><span class="no">SSPRK3</span> <span class="o">=</span> <span class="p">[[],[</span><span class="mi">1</span><span class="p">],[</span><span class="mi">1</span><span class="o">/</span><span class="mf">4.0</span><span class="p">,</span><span class="mi">1</span><span class="o">/</span><span class="mf">4.0</span><span class="p">],[</span><span class="mi">1</span><span class="o">/</span><span class="mf">6.0</span><span class="p">,</span><span class="mi">1</span><span class="o">/</span><span class="mf">6.0</span><span class="p">,</span><span class="mi">2</span><span class="o">/</span><span class="mf">3.0</span><span class="p">]]</span>
</span>
            <span class="line line-9"><span class="no">CLASSIC_4TH</span> <span class="o">=</span> <span class="p">[[],[</span><span class="mi">1</span><span class="o">/</span><span class="mf">2.0</span><span class="p">],[</span><span class="mi">0</span><span class="p">,</span><span class="mi">1</span><span class="o">/</span><span class="mf">2.0</span><span class="p">],[</span><span class="mi">0</span><span class="p">,</span><span class="mi">0</span><span class="p">,</span><span class="mi">1</span><span class="p">],[</span><span class="mi">1</span><span class="o">/</span><span class="mf">6.0</span><span class="p">,</span><span class="mi">1</span><span class="o">/</span><span class="mf">3.0</span><span class="p">,</span><span class="mi">1</span><span class="o">/</span><span class="mf">3.0</span><span class="p">,</span><span class="mi">1</span><span class="o">/</span><span class="mf">6.0</span><span class="p">]]</span>
</span>
            <span class="line line-10"><span class="no">RALSTON_4TH</span> <span class="o">=</span> <span class="p">[[],[</span><span class="mf">0.4</span><span class="p">],[</span><span class="mf">0.29697761</span><span class="p">,</span><span class="mf">0.15875964</span><span class="p">],[</span><span class="mf">0.21810040</span><span class="p">,</span><span class="o">-</span><span class="mf">3.05096516</span><span class="p">,</span>
</span>
            <span class="line line-11">		<span class="mf">3.83286476</span><span class="p">],[</span><span class="mf">0.17476028</span><span class="p">,</span> <span class="o">-</span><span class="mf">0.55148066</span><span class="p">,</span> <span class="mf">1.20553560</span><span class="p">,</span> <span class="mf">0.17118478</span><span class="p">]]</span>
</span>
            <span class="line line-12"><span class="no">THREE_EIGHTH_4TH</span> <span class="o">=</span> <span class="p">[[],[</span><span class="mi">1</span><span class="o">/</span><span class="mf">3.0</span><span class="p">],[</span><span class="o">-</span><span class="mi">1</span><span class="o">/</span><span class="mf">3.0</span><span class="p">,</span><span class="mi">1</span><span class="p">],[</span><span class="mi">1</span><span class="p">,</span><span class="o">-</span><span class="mi">1</span><span class="p">,</span><span class="mi">1</span><span class="p">],[</span><span class="mi">1</span><span class="o">/</span><span class="mf">8.0</span><span class="p">,</span><span class="mi">3</span><span class="o">/</span><span class="mf">8.0</span><span class="p">,</span><span class="mi">3</span><span class="o">/</span><span class="mf">8.0</span><span class="p">,</span><span class="mi">1</span><span class="o">/</span><span class="mf">8.0</span><span class="p">]]</span>
</span>
          </code>
        </pre>
      </td>
    </tr>
  </tbody>
</table>
<p>Here we are going to take <code>CLASSIC_4TH</code>.</p>
<p>The <code>$canvas</code> appearing here is an object that is going to draw the result onto the screen.</p>
<p>Here we also need to have some patches to get it work.</p>
<table class="rouge-table">
  <tbody>
    <tr>
      <td class="highlight language-ruby">
        <pre>
          <code>
            <span class="line line-1"><span class="k">class</span> <span class="nc">Float</span>
</span>
            <span class="line line-2">	<span class="k">alias</span> <span class="n">ulysses20200426121236_add</span> <span class="o">+</span>
</span>
            <span class="line line-3">	<span class="k">def</span> <span class="nf">+</span> <span class="n">other</span>
</span>
            <span class="line line-4">		<span class="k">if</span> <span class="n">zero?</span> <span class="o">&amp;&amp;</span> <span class="p">[</span><span class="no">Vector</span><span class="p">,</span> <span class="no">Matrix</span><span class="p">].</span><span class="nf">any?</span> <span class="p">{</span> <span class="o">|</span><span class="n">c</span><span class="o">|</span> <span class="n">other</span><span class="p">.</span><span class="nf">is_a?</span> <span class="n">c</span> <span class="p">}</span>
</span>
            <span class="line line-5">			<span class="n">other</span>
</span>
            <span class="line line-6">		<span class="k">else</span>
</span>
            <span class="line line-7">			<span class="n">ulysses20200426121236_add</span> <span class="n">other</span>
</span>
            <span class="line line-8">		<span class="k">end</span>
</span>
            <span class="line line-9">	<span class="k">end</span>
</span>
            <span class="line line-10"><span class="k">end</span>
</span>
            <span class="line line-11"><span class="k">module</span> <span class="nn">Enumerable</span>
</span>
            <span class="line line-12">	<span class="k">def</span> <span class="nf">sum</span> <span class="n">init</span> <span class="o">=</span> <span class="mi">0</span><span class="p">,</span> <span class="o">&amp;</span><span class="n">block</span>
</span>
            <span class="line line-13">		<span class="p">(</span><span class="n">block</span> <span class="p">?</span> <span class="n">map</span><span class="p">(</span><span class="o">&amp;</span><span class="n">block</span><span class="p">)</span> <span class="p">:</span> <span class="nb">self</span><span class="p">).</span><span class="nf">reduce</span> <span class="n">init</span><span class="p">,</span> <span class="p">:</span><span class="o">+</span>
</span>
            <span class="line line-14">	<span class="k">end</span>
</span>
            <span class="line line-15"><span class="k">end</span>
</span>
            <span class="line line-16"><span class="k">class</span> <span class="nc">Array</span>
</span>
            <span class="line line-17">	<span class="k">def</span> <span class="nf">inner</span> <span class="n">other</span>
</span>
            <span class="line line-18">		<span class="n">zip</span><span class="p">(</span><span class="n">other</span><span class="p">).</span><span class="nf">sum</span> <span class="p">{</span> <span class="o">|</span><span class="n">a</span><span class="p">,</span> <span class="n">b</span><span class="o">|</span> <span class="n">a</span> <span class="o">*</span> <span class="n">b</span> <span class="p">}</span>
</span>
            <span class="line line-19">	<span class="k">end</span>
</span>
            <span class="line line-20"><span class="k">end</span>
</span>
          </code>
        </pre>
      </td>
    </tr>
  </tbody>
</table>
<p class="no-indent">
(Again, note that this is Ruby 1.9.2.)
</p>
<p>Finally, just combine them up, and we can solve a Hamiltonian numerically.</p>
<table class="rouge-table">
  <tbody>
    <tr>
      <td class="highlight language-ruby">
        <pre>
          <code>
            <span class="line line-1"><span class="k">def</span> <span class="nf">solve_hamiltonian</span> <span class="n">n</span><span class="p">,</span> <span class="n">qp0</span><span class="p">,</span> <span class="n">max_t</span><span class="p">,</span> <span class="n">dt</span><span class="p">,</span> <span class="n">hamiltonian</span>
</span>
            <span class="line line-2">	<span class="n">runge_kutta</span> <span class="n">qp0</span><span class="p">,</span> <span class="n">max_t</span><span class="p">,</span> <span class="n">dt</span><span class="p">,</span> <span class="no">CLASSIC_4TH</span><span class="p">,</span> <span class="o">-&gt;</span><span class="n">t</span><span class="p">,</span> <span class="n">qp</span> <span class="k">do</span>
</span>
            <span class="line line-3">		<span class="n">dqpdt</span> <span class="o">=</span> <span class="n">div</span> <span class="n">qp</span><span class="p">,</span> <span class="mf">1e-6</span><span class="p">,</span> <span class="o">-&gt;</span><span class="n">x</span> <span class="p">{</span> <span class="n">hamiltonian</span><span class="o">.</span><span class="p">(</span><span class="n">t</span><span class="p">,</span> <span class="n">x</span><span class="p">)</span> <span class="p">}</span>
</span>
            <span class="line line-4">		<span class="no">Vector</span><span class="p">[</span><span class="o">*</span><span class="n">dqpdt</span><span class="p">[</span><span class="n">n</span><span class="o">...</span><span class="n">n</span><span class="o">*</span><span class="mi">2</span><span class="p">],</span> <span class="o">*</span><span class="n">dqpdt</span><span class="p">[</span><span class="mi">0</span><span class="o">...</span><span class="n">n</span><span class="p">].</span><span class="nf">map</span><span class="p">(</span><span class="o">&amp;</span><span class="ss">:-@</span><span class="p">)]</span>
</span>
            <span class="line line-5">	<span class="k">end</span>
</span>
            <span class="line line-6"><span class="k">end</span>
</span>
          </code>
        </pre>
      </td>
    </tr>
  </tbody>
</table>
<p>For example, let’s simulate a double pendulum.</p>
<table class="rouge-table">
  <tbody>
    <tr>
      <td class="highlight language-ruby">
        <pre>
          <code>
            <span class="line line-1"><span class="n">solve_hamiltonian</span> <span class="mi">2</span><span class="p">,</span><span class="no">Vector</span><span class="p">[</span><span class="no">PI</span><span class="o">/</span><span class="mi">2</span><span class="p">,</span><span class="mf">0.0</span><span class="p">,</span><span class="mf">0.0</span><span class="p">,</span><span class="mf">0.0</span><span class="p">],</span><span class="no">Float</span><span class="o">::</span><span class="no">INFINITY</span><span class="p">,</span><span class="mf">1e-3</span><span class="p">,</span>
</span>
            <span class="line line-2">		<span class="o">-&gt;</span><span class="n">t</span><span class="p">,(</span><span class="n">q1</span><span class="p">,</span><span class="n">q2</span><span class="p">,</span><span class="n">p1</span><span class="p">,</span><span class="n">p2</span><span class="p">){</span><span class="n">p1</span><span class="o">**</span><span class="mi">2</span><span class="o">+</span><span class="n">p2</span><span class="o">**</span><span class="mi">2</span><span class="o">/</span><span class="mi">2</span><span class="o">+</span><span class="n">cos</span><span class="p">(</span><span class="n">q1</span><span class="o">-</span><span class="n">q2</span><span class="p">)</span><span class="o">*</span><span class="n">p1</span><span class="o">*</span><span class="n">p2</span><span class="o">-</span><span class="n">cos</span><span class="p">(</span><span class="n">q1</span><span class="p">)</span><span class="o">-</span><span class="n">cos</span><span class="p">(</span><span class="n">q2</span><span class="p">)}</span>
</span>
          </code>
        </pre>
      </td>
    </tr>
  </tbody>
</table>
<figure>
<img src="/assets/images/figures/2020-04-28-simulation-rgss/double_pendulum.gif" alt="The simulated motion of a double pendulum."/>

</figure>
<p>The codes are not complete in this post. See the <a href="/assets/codes/RungeKutta.rar">attached file</a> for details. You can open the project using <a href="https://store.steampowered.com/app/220700/RPG_Maker_VX_Ace" target="_blank" rel="external">RPG Maker VX Ace</a>. The <code>Game.exe</code> file is not the official <code>Game.exe</code> executable but the third-party improved version of it called <a href="http://cirno.blog/archives/290" target="_blank" rel="external">RGD</a> (of version 1.3.2, while the latest till now is 1.5.1).</p>]]></content><author><name>UlyssesZhan</name><email>ulysseszhan@gmail.com</email></author><category term="physics" /><category term="ruby" /><category term="rgss" /><category term="hamiltonian" /><category term="calculus" /><category term="ode" /><summary type="html"><![CDATA[Hamiltonian mechanics gives us a good way to simulate mechanical systems as long as we can get its Hamiltonian and its initial conditions. I implemented this simulation in RGSS3, the game scripting system shipped with RPG Maker VX Ace.]]></summary><media:thumbnail xmlns:media="http://search.yahoo.com/mrss/" url="https://ulysseszh.github.io/assets/images/covers/2020-04-28-simulation-rgss.png" /><media:content medium="image" url="https://ulysseszh.github.io/assets/images/covers/2020-04-28-simulation-rgss.png" xmlns:media="http://search.yahoo.com/mrss/" /></entry><entry><title type="html"><![CDATA[The concentration change of gas in reversible reactions]]></title><link href="https://ulysseszh.github.io/chemistry/2020/04/12/concentration-time.html" rel="alternate" type="text/html" title="The concentration change of gas in reversible reactions" /><published>2020-04-11T19:00:01-07:00</published><updated>2020-04-11T19:00:01-07:00</updated><id>https://ulysseszh.github.io/chemistry/2020/04/12/concentration-time</id><content type="html" xml:base="https://ulysseszh.github.io/chemistry/2020/04/12/concentration-time.html"><![CDATA[<h2 data-label="0.1" id="introduction">Introduction</h2>
<p>A reversible elementary reaction takes place inside a closed, highly thermally conductive container of constant volume, whose reactants are all gases, and the reaction equation is <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><munder><mo>∑</mo><mi>k</mi></munder><msub><mi>a</mi><mi>k</mi></msub><msub><mi>X</mi><mi>k</mi></msub><mo>⇌</mo><munder><mo>∑</mo><mi>k</mi></munder><msub><mi>b</mi><mi>k</mi></msub><msub><mi>Y</mi><mi>k</mi></msub><mo separator="true">,</mo></mrow><annotation encoding="application/x-tex">
    \sum_ka_kX_k\rightleftharpoons\sum_kb_kY_k,
</annotation></semantics></math></span></span></span> where <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><msub><mi>X</mi><mi>k</mi></msub></mrow><annotation encoding="application/x-tex">X_k</annotation></semantics></math></span></span> and <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><msub><mi>Y</mi><mi>k</mi></msub></mrow><annotation encoding="application/x-tex">Y_k</annotation></semantics></math></span></span> are reactants, and <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><msub><mi>a</mi><mi>k</mi></msub></mrow><annotation encoding="application/x-tex">a_k</annotation></semantics></math></span></span> and <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><msub><mi>b</mi><mi>k</mi></msub></mrow><annotation encoding="application/x-tex">b_k</annotation></semantics></math></span></span> are stoichiometries.</p>
<p>Use square brackets to denote concentrations. Our goal is to find <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mo fence="true">[</mo><msub><mi>X</mi><mi>k</mi></msub><mo fence="true">]</mo></mrow><annotation encoding="application/x-tex">\left[X_k\right]</annotation></semantics></math></span></span> and <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mo fence="true">[</mo><msub><mi>Y</mi><mi>k</mi></msub><mo fence="true">]</mo></mrow><annotation encoding="application/x-tex">\left[Y_k\right]</annotation></semantics></math></span></span> as functions with respect to time <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>t</mi></mrow><annotation encoding="application/x-tex">t</annotation></semantics></math></span></span>.</p>
<h2 data-label="0.2" id="the-approach">The approach</h2>
<p>It is easy to write out the rate equations <span id="eq:rate-equations" data-label="(1)"><span class="katex-display-table"> <span class="katex-display-numbered"><span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mtable rowspacing="0.25em" columnalign="right" columnspacing=""><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mfrac><mrow><mi mathvariant="normal">d</mi><mrow><mo fence="true">[</mo><msub><mi>X</mi><mi>j</mi></msub><mo fence="true">]</mo></mrow></mrow><mrow><mi mathvariant="normal">d</mi><mi>t</mi></mrow></mfrac><mo>=</mo><msub><mi>a</mi><mi>j</mi></msub><mrow><mo fence="true">(</mo><msub><mi>μ</mi><mi>Y</mi></msub><munder><mo>∏</mo><mi>k</mi></munder><msup><mrow><mo fence="true">[</mo><msub><mi>Y</mi><mi>k</mi></msub><mo fence="true">]</mo></mrow><msub><mi>b</mi><mi>k</mi></msub></msup><mo>−</mo><msub><mi>μ</mi><mi>X</mi></msub><munder><mo>∏</mo><mi>k</mi></munder><msup><mrow><mo fence="true">[</mo><msub><mi>X</mi><mi>k</mi></msub><mo fence="true">]</mo></mrow><msub><mi>a</mi><mi>k</mi></msub></msup><mo fence="true">)</mo></mrow><mo separator="true">,</mo></mrow></mstyle></mtd></mtr><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mfrac><mrow><mi mathvariant="normal">d</mi><mrow><mo fence="true">[</mo><msub><mi>Y</mi><mi>j</mi></msub><mo fence="true">]</mo></mrow></mrow><mrow><mi mathvariant="normal">d</mi><mi>t</mi></mrow></mfrac><mo>=</mo><msub><mi>b</mi><mi>j</mi></msub><mrow><mo fence="true">(</mo><msub><mi>μ</mi><mi>X</mi></msub><munder><mo>∏</mo><mi>k</mi></munder><msup><mrow><mo fence="true">[</mo><msub><mi>X</mi><mi>k</mi></msub><mo fence="true">]</mo></mrow><msub><mi>a</mi><mi>k</mi></msub></msup><mo>−</mo><msub><mi>μ</mi><mi>Y</mi></msub><munder><mo>∏</mo><mi>k</mi></munder><msup><mrow><mo fence="true">[</mo><msub><mi>Y</mi><mi>k</mi></msub><mo fence="true">]</mo></mrow><msub><mi>b</mi><mi>k</mi></msub></msup><mo fence="true">)</mo></mrow><mo separator="true">,</mo></mrow></mstyle></mtd></mtr></mtable><annotation encoding="application/x-tex">\begin{split}
    \frac{\mathrm d\left[X_j\right]}{\mathrm dt}=
        a_j\left(\mu_Y\prod_k\left[Y_k\right]^{b_k}-
        \mu_X\prod_k\left[X_k\right]^{a_k}\right),\\
    \frac{\mathrm d\left[Y_j\right]}{\mathrm dt}=
        b_j\left(\mu_X\prod_k\left[X_k\right]^{a_k}-
        \mu_Y\prod_k\left[Y_k\right]^{b_k}\right),
\end{split}</annotation></semantics></math></span></span></span></span>
<span class="katex-display-number"><span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mo stretchy="false">(</mo><mn>1</mn><mo stretchy="false">)</mo></mrow><annotation encoding="application/x-tex">(1)</annotation></semantics></math></span></span></span></span> </span></span> where <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><msub><mi>μ</mi><mi>X</mi></msub></mrow><annotation encoding="application/x-tex">\mu_X</annotation></semantics></math></span></span> and <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><msub><mi>μ</mi><mi>Y</mi></msub></mrow><annotation encoding="application/x-tex">\mu_Y</annotation></semantics></math></span></span> are rate constants derived by experimenting.</p>
<p>Apply a substitution <span id="eq:substitution" data-label="(2)"><span class="katex-display-table"> <span class="katex-display-numbered"><span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mtable rowspacing="0.25em" columnalign="right" columnspacing=""><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><msub><mi>x</mi><mi>j</mi></msub><mo><mi mathvariant="normal">≔</mi></mo><mfrac><mrow><mo fence="true">[</mo><msub><mi>X</mi><mi>j</mi></msub><mo fence="true">]</mo></mrow><msub><mi>a</mi><mi>j</mi></msub></mfrac><mo separator="true">,</mo><mspace width="1em"/><msub><mi>y</mi><mi>j</mi></msub><mo><mi mathvariant="normal">≔</mi></mo><mfrac><mrow><mo fence="true">[</mo><msub><mi>Y</mi><mi>j</mi></msub><mo fence="true">]</mo></mrow><msub><mi>b</mi><mi>j</mi></msub></mfrac><mo separator="true">,</mo></mrow></mstyle></mtd></mtr><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><msub><mi>μ</mi><mi>x</mi></msub><mo><mi mathvariant="normal">≔</mi></mo><msub><mi>μ</mi><mi>X</mi></msub><munder><mo>∏</mo><mi>k</mi></munder><msubsup><mi>a</mi><mi>k</mi><msub><mi>a</mi><mi>k</mi></msub></msubsup><mo separator="true">,</mo><mspace width="1em"/><msub><mi>μ</mi><mi>y</mi></msub><mo><mi mathvariant="normal">≔</mi></mo><msub><mi>μ</mi><mi>Y</mi></msub><munder><mo>∏</mo><mi>k</mi></munder><msubsup><mi>b</mi><mi>k</mi><msub><mi>b</mi><mi>k</mi></msub></msubsup></mrow></mstyle></mtd></mtr></mtable><annotation encoding="application/x-tex">\begin{split}
    x_j\coloneqq\frac{\left[X_j\right]}{a_j},\quad
    y_j\coloneqq\frac{\left[Y_j\right]}{b_j},\\
    \mu_x\coloneqq\mu_X\prod_ka_k^{a_k},\quad
    \mu_y\coloneqq\mu_Y\prod_kb_k^{b_k}
\end{split}</annotation></semantics></math></span></span></span></span>
<span class="katex-display-number"><span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mo stretchy="false">(</mo><mn>2</mn><mo stretchy="false">)</mo></mrow><annotation encoding="application/x-tex">(2)</annotation></semantics></math></span></span></span></span> </span></span> to Formula <a href="#eq:rate-equations">1</a>, and then it becomes <span id="eq:substituted-rate" data-label="(3)"><span class="katex-display-table"> <span class="katex-display-numbered"><span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mtable rowspacing="0.25em" columnalign="right" columnspacing=""><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mfrac><mrow><mi mathvariant="normal">d</mi><msub><mi>x</mi><mi>j</mi></msub></mrow><mrow><mi mathvariant="normal">d</mi><mi>t</mi></mrow></mfrac><mo>=</mo><msub><mi>μ</mi><mi>y</mi></msub><munder><mo>∏</mo><mi>k</mi></munder><msubsup><mi>y</mi><mi>k</mi><msub><mi>b</mi><mi>k</mi></msub></msubsup><mo>−</mo><msub><mi>μ</mi><mi>x</mi></msub><munder><mo>∏</mo><mi>k</mi></munder><msubsup><mi>x</mi><mi>k</mi><msub><mi>a</mi><mi>k</mi></msub></msubsup><mo separator="true">,</mo></mrow></mstyle></mtd></mtr><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mfrac><mrow><mi mathvariant="normal">d</mi><msub><mi>y</mi><mi>j</mi></msub></mrow><mrow><mi mathvariant="normal">d</mi><mi>t</mi></mrow></mfrac><mo>=</mo><msub><mi>μ</mi><mi>x</mi></msub><munder><mo>∏</mo><mi>k</mi></munder><msubsup><mi>x</mi><mi>k</mi><msub><mi>a</mi><mi>k</mi></msub></msubsup><mo>−</mo><msub><mi>μ</mi><mi>y</mi></msub><munder><mo>∏</mo><mi>k</mi></munder><msubsup><mi>y</mi><mi>k</mi><msub><mi>b</mi><mi>k</mi></msub></msubsup><mo separator="true">,</mo></mrow></mstyle></mtd></mtr></mtable><annotation encoding="application/x-tex">\begin{split}
    \frac{\mathrm dx_j}{\mathrm dt}=
    \mu_y\prod_ky_k^{b_k}-\mu_x\prod_kx_k^{a_k},\\
    \frac{\mathrm dy_j}{\mathrm dt}=
    \mu_x\prod_kx_k^{a_k}-\mu_y\prod_ky_k^{b_k},
\end{split}</annotation></semantics></math></span></span></span></span>
<span class="katex-display-number"><span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mo stretchy="false">(</mo><mn>3</mn><mo stretchy="false">)</mo></mrow><annotation encoding="application/x-tex">(3)</annotation></semantics></math></span></span></span></span> </span></span> which means the changes of <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><msub><mi>x</mi><mi>j</mi></msub></mrow><annotation encoding="application/x-tex">x_j</annotation></semantics></math></span></span> are all equal, the changes of <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><msub><mi>y</mi><mi>j</mi></msub></mrow><annotation encoding="application/x-tex">y_j</annotation></semantics></math></span></span> are all equal, and the changes of <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><msub><mi>x</mi><mi>j</mi></msub></mrow><annotation encoding="application/x-tex">x_j</annotation></semantics></math></span></span> are opposite to the changes of <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><msub><mi>y</mi><mi>j</mi></msub></mrow><annotation encoding="application/x-tex">y_j</annotation></semantics></math></span></span>.</p>
<p>Denote the changes of <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><msub><mi>x</mi><mi>j</mi></msub></mrow><annotation encoding="application/x-tex">x_j</annotation></semantics></math></span></span> are equal to <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>s</mi></mrow><annotation encoding="application/x-tex">s</annotation></semantics></math></span></span>, the initial value of <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><msub><mi>x</mi><mi>j</mi></msub></mrow><annotation encoding="application/x-tex">x_j</annotation></semantics></math></span></span> is <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><msub><mi>A</mi><mi>j</mi></msub></mrow><annotation encoding="application/x-tex">A_j</annotation></semantics></math></span></span>, the initial value of <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><msub><mi>y</mi><mi>j</mi></msub></mrow><annotation encoding="application/x-tex">y_j</annotation></semantics></math></span></span> is <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><msub><mi>B</mi><mi>j</mi></msub></mrow><annotation encoding="application/x-tex">B_j</annotation></semantics></math></span></span>, which means <span id="eq:back" data-label="(4)"><span class="katex-display-table"> <span class="katex-display-numbered"><span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mtable rowspacing="0.25em" columnalign="right" columnspacing=""><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><msub><mi>x</mi><mi>j</mi></msub><mo>=</mo><msub><mi>A</mi><mi>j</mi></msub><mo>+</mo><mi>s</mi><mo separator="true">,</mo></mrow></mstyle></mtd></mtr><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><msub><mi>y</mi><mi>j</mi></msub><mo>=</mo><msub><mi>B</mi><mi>j</mi></msub><mo>−</mo><mi>s</mi><mi mathvariant="normal">.</mi></mrow></mstyle></mtd></mtr></mtable><annotation encoding="application/x-tex">\begin{split}
    x_j=A_j+s,\\
    y_j=B_j-s.
\end{split}</annotation></semantics></math></span></span></span></span> <span class="katex-display-number"><span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mo stretchy="false">(</mo><mn>4</mn><mo stretchy="false">)</mo></mrow><annotation encoding="application/x-tex">(4)</annotation></semantics></math></span></span></span></span> </span></span> Substitute Formula <a href="#eq:back">4</a> into Formula <a href="#eq:substituted-rate">3</a>, and it can be derived that <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mfrac><mrow><mi mathvariant="normal">d</mi><mi>s</mi></mrow><mrow><mi mathvariant="normal">d</mi><mi>t</mi></mrow></mfrac><mo>=</mo><mi>F</mi><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mi>s</mi><mo fence="true">)</mo></mrow><mo separator="true">,</mo></mrow><annotation encoding="application/x-tex">
    \frac{\mathrm ds}{\mathrm dt}=F\!\left(s\right),
</annotation></semantics></math></span></span></span> by which we can reduce the problem to an integral problem <span id="eq:separated" data-label="(5)"><span class="katex-display-table"> <span class="katex-display-numbered"><span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mi>t</mi><mo>=</mo><msubsup><mo>∫</mo><mn>0</mn><mi>s</mi></msubsup><mfrac><mrow><mi mathvariant="normal">d</mi><mi>s</mi></mrow><mrow><mi>F</mi><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mi>s</mi><mo fence="true">)</mo></mrow></mrow></mfrac><mo separator="true">,</mo></mrow><annotation encoding="application/x-tex">t=\int_0^s\frac{\mathrm ds}{F\!\left(s\right)},</annotation></semantics></math></span></span></span></span> <span class="katex-display-number"><span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mo stretchy="false">(</mo><mn>5</mn><mo stretchy="false">)</mo></mrow><annotation encoding="application/x-tex">(5)</annotation></semantics></math></span></span></span></span> </span></span> where <span id="eq:def-F" data-label="(6)"><span class="katex-display-table"> <span class="katex-display-numbered"><span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mi>F</mi><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mi>s</mi><mo fence="true">)</mo></mrow><mo><mi mathvariant="normal">≔</mi></mo><msub><mi>μ</mi><mi>y</mi></msub><munder><mo>∏</mo><mi>k</mi></munder><msup><mrow><mo fence="true">(</mo><msub><mi>B</mi><mi>k</mi></msub><mo>−</mo><mi>s</mi><mo fence="true">)</mo></mrow><msub><mi>b</mi><mi>k</mi></msub></msup><mo>−</mo><msub><mi>μ</mi><mi>x</mi></msub><munder><mo>∏</mo><mi>k</mi></munder><msup><mrow><mo fence="true">(</mo><msub><mi>A</mi><mi>k</mi></msub><mo>+</mo><mi>s</mi><mo fence="true">)</mo></mrow><msub><mi>a</mi><mi>k</mi></msub></msup></mrow><annotation encoding="application/x-tex">F\!\left(s\right)\coloneqq\mu_y\prod_k\left(B_k-s\right)^{b_k}-
    \mu_x\prod_k\left(A_k+s\right)^{a_k}</annotation></semantics></math></span></span></span></span> <span class="katex-display-number"><span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mo stretchy="false">(</mo><mn>6</mn><mo stretchy="false">)</mo></mrow><annotation encoding="application/x-tex">(6)</annotation></semantics></math></span></span></span></span> </span></span> is a polynomial of <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>n</mi></mrow><annotation encoding="application/x-tex">n</annotation></semantics></math></span></span>th degree, where <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mi>n</mi><mo><mi mathvariant="normal">≔</mi></mo><mi>max</mi><mo>⁡</mo><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><munder><mo>∑</mo><mi>k</mi></munder><msub><mi>a</mi><mi>k</mi></msub><mo separator="true">,</mo><munder><mo>∑</mo><mi>k</mi></munder><msub><mi>b</mi><mi>k</mi></msub><mo fence="true">)</mo></mrow></mrow><annotation encoding="application/x-tex">
    n\coloneqq\max\!\left(\sum_ka_k,\sum_kb_k\right)
</annotation></semantics></math></span></span></span> is the larger of the orders of the forward and reverse reactions. The degree of <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>F</mi></mrow><annotation encoding="application/x-tex">F</annotation></semantics></math></span></span> may be lower if the high-order term is offset, but only mathematicians believe in such coincidences.</p>
<p>Since Formula <a href="#eq:separated">5</a> is to integrate a rational function, it is easy.</p>
<p>After deriving <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>s</mi></mrow><annotation encoding="application/x-tex">s</annotation></semantics></math></span></span> as a function of <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>t</mi></mrow><annotation encoding="application/x-tex">t</annotation></semantics></math></span></span>, substitute it into Formula <a href="#eq:back">4</a> and then Formula <a href="#eq:substitution">2</a>. We can derive <span id="eq:result" data-label="(7)"><span class="katex-display-table"> <span class="katex-display-numbered"><span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mtable rowspacing="0.25em" columnalign="right" columnspacing=""><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow><mo fence="true">[</mo><msub><mi>X</mi><mi>j</mi></msub><mo fence="true">]</mo></mrow><mo>=</mo><msub><mi>a</mi><mi>j</mi></msub><mrow><mo fence="true">(</mo><msub><mi>A</mi><mi>j</mi></msub><mo>+</mo><mi>s</mi><mo fence="true">)</mo></mrow><mo separator="true">,</mo></mrow></mstyle></mtd></mtr><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow><mo fence="true">[</mo><msub><mi>Y</mi><mi>j</mi></msub><mo fence="true">]</mo></mrow><mo>=</mo><msub><mi>b</mi><mi>j</mi></msub><mrow><mo fence="true">(</mo><msub><mi>B</mi><mi>j</mi></msub><mo>−</mo><mi>s</mi><mo fence="true">)</mo></mrow></mrow></mstyle></mtd></mtr></mtable><annotation encoding="application/x-tex">\begin{split}
    \left[X_j\right]=a_j\left(A_j+s\right),\\
    \left[Y_j\right]=b_j\left(B_j-s\right)
\end{split}</annotation></semantics></math></span></span></span></span> <span class="katex-display-number"><span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mo stretchy="false">(</mo><mn>7</mn><mo stretchy="false">)</mo></mrow><annotation encoding="application/x-tex">(7)</annotation></semantics></math></span></span></span></span> </span></span> as the answer.</p>
<h2 data-label="0.3" id="properties-of-f">Properties of <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>F</mi></mrow><annotation encoding="application/x-tex">F</annotation></semantics></math></span></span></h2>
<p>As we all know, here exists a state where the system is in chemical equilibrium. Denote the value of <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>s</mi></mrow><annotation encoding="application/x-tex">s</annotation></semantics></math></span></span> in this case as <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>q</mi></mrow><annotation encoding="application/x-tex">q</annotation></semantics></math></span></span>. It is easy to figure out that <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>q</mi></mrow><annotation encoding="application/x-tex">q</annotation></semantics></math></span></span> is a zero of <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>F</mi><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mi>s</mi><mo fence="true">)</mo></mrow></mrow><annotation encoding="application/x-tex">F\!\left(s\right)</annotation></semantics></math></span></span> on the interval <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mi>I</mi><mo><mi mathvariant="normal">≔</mi></mo><mrow><mo fence="true">(</mo><mo>−</mo><munder><mrow><mi>min</mi><mo>⁡</mo></mrow><mi>k</mi></munder><msub><mi>A</mi><mi>k</mi></msub><mo separator="true">,</mo><munder><mrow><mi>min</mi><mo>⁡</mo></mrow><mi>k</mi></munder><msub><mi>B</mi><mi>k</mi></msub><mo fence="true">)</mo></mrow><mo separator="true">,</mo></mrow><annotation encoding="application/x-tex">
    I\coloneqq\left(-\min_kA_k,\min_kB_k\right),
</annotation></semantics></math></span></span></span> which is the range of <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>s</mi></mrow><annotation encoding="application/x-tex">s</annotation></semantics></math></span></span> such that the concentration of all reactants are positive.</p>
<p>It is obvious that the value of <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>q</mi></mrow><annotation encoding="application/x-tex">q</annotation></semantics></math></span></span> is unique. It is because <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>F</mi></mrow><annotation encoding="application/x-tex">F</annotation></semantics></math></span></span> is monotonic over <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>I</mi></mrow><annotation encoding="application/x-tex">I</annotation></semantics></math></span></span> and the signs of its value at ends of interval <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>I</mi></mrow><annotation encoding="application/x-tex">I</annotation></semantics></math></span></span> are different.</p>
<p>Note that <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>q</mi></mrow><annotation encoding="application/x-tex">q</annotation></semantics></math></span></span> is a flaw of <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mfrac><mn>1</mn><mrow><mi>F</mi><mrow><mo fence="true">(</mo><mi>s</mi><mo fence="true">)</mo></mrow></mrow></mfrac></mrow><annotation encoding="application/x-tex">\frac1{F\left(s\right)}</annotation></semantics></math></span></span> and that the improper integral <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><msubsup><mo>∫</mo><mn>0</mn><mi>q</mi></msubsup><mfrac><mrow><mi mathvariant="normal">d</mi><mi>s</mi></mrow><mrow><mi>F</mi><mrow><mo fence="true">(</mo><mi>s</mi><mo fence="true">)</mo></mrow></mrow></mfrac></mrow><annotation encoding="application/x-tex">\int_0^q\frac{\mathrm ds}{F\left(s\right)}</annotation></semantics></math></span></span> diverges, so we can imagine how <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>s</mi></mrow><annotation encoding="application/x-tex">s</annotation></semantics></math></span></span> changes with respect to <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>t</mi></mrow><annotation encoding="application/x-tex">t</annotation></semantics></math></span></span>. <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>s</mi><mo>=</mo><mn>0</mn></mrow><annotation encoding="application/x-tex">s=0</annotation></semantics></math></span></span> when <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>t</mi><mo>=</mo><mn>0</mn></mrow><annotation encoding="application/x-tex">t=0</annotation></semantics></math></span></span>, and then <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>s</mi></mrow><annotation encoding="application/x-tex">s</annotation></semantics></math></span></span> changes monotonically, and finally <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>s</mi><mo>→</mo><mi>q</mi></mrow><annotation encoding="application/x-tex">s\rightarrow q</annotation></semantics></math></span></span> when <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>t</mi><mo>→</mo><mo>+</mo><mi mathvariant="normal">∞</mi></mrow><annotation encoding="application/x-tex">t\rightarrow+\infty</annotation></semantics></math></span></span>. Thus, the range of <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>s</mi></mrow><annotation encoding="application/x-tex">s</annotation></semantics></math></span></span> over
<span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>t</mi><mo>∈</mo><mrow><mo fence="true">[</mo><mn>0</mn><mo separator="true">,</mo><mo>+</mo><mi mathvariant="normal">∞</mi><mo fence="true">)</mo></mrow></mrow><annotation encoding="application/x-tex">t\in\left[0,+\infty\right)</annotation></semantics></math></span></span> is <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mo fence="true">[</mo><mn>0</mn><mo separator="true">,</mo><mi>q</mi><mo fence="true">)</mo></mrow><annotation encoding="application/x-tex">\left[0,q\right)</annotation></semantics></math></span></span> for <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>q</mi><mo>&gt;</mo><mn>0</mn></mrow><annotation encoding="application/x-tex">q&gt;0</annotation></semantics></math></span></span> or <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mo fence="true">(</mo><mi>q</mi><mo separator="true">,</mo><mn>0</mn><mo fence="true">]</mo></mrow><annotation encoding="application/x-tex">\left(q,0\right]</annotation></semantics></math></span></span> for <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>q</mi><mo>&lt;</mo><mn>0</mn></mrow><annotation encoding="application/x-tex">q&lt;0</annotation></semantics></math></span></span>. <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>q</mi><mo>=</mo><mn>0</mn></mrow><annotation encoding="application/x-tex">q=0</annotation></semantics></math></span></span> is not considered because only mathematicians believe in such coincidences.</p>
<p>Suppose <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>F</mi></mrow><annotation encoding="application/x-tex">F</annotation></semantics></math></span></span> has <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>n</mi></mrow><annotation encoding="application/x-tex">n</annotation></semantics></math></span></span> different complex zeros <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><msub><mi>r</mi><mi>α</mi></msub></mrow><annotation encoding="application/x-tex">r_\alpha</annotation></semantics></math></span></span>, one of which is <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>q</mi></mrow><annotation encoding="application/x-tex">q</annotation></semantics></math></span></span>. The possible existence of multiple roots is ignored because only mathematicians believe in such coincidences. Decompose the rational function <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mfrac><mn>1</mn><mrow><mi>F</mi><mrow><mo fence="true">(</mo><mi>s</mi><mo fence="true">)</mo></mrow></mrow></mfrac></mrow><annotation encoding="application/x-tex">\frac1{F\left(s\right)}</annotation></semantics></math></span></span> into several partial fractions, and it can be derived that <span id="eq:partial-fractions" data-label="(8)"><span class="katex-display-table"> <span class="katex-display-numbered"><span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mfrac><mn>1</mn><mrow><mi>F</mi><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mi>s</mi><mo fence="true">)</mo></mrow></mrow></mfrac><mo>=</mo><munder><mo>∑</mo><mi>α</mi></munder><mfrac><msub><mi>C</mi><mi>α</mi></msub><mrow><msub><mi>r</mi><mi>α</mi></msub><mo>−</mo><mi>s</mi></mrow></mfrac><mo separator="true">,</mo></mrow><annotation encoding="application/x-tex">\frac1{F\!\left(s\right)}=\sum_\alpha\frac{C_\alpha}{r_\alpha-s},</annotation></semantics></math></span></span></span></span> <span class="katex-display-number"><span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mo stretchy="false">(</mo><mn>8</mn><mo stretchy="false">)</mo></mrow><annotation encoding="application/x-tex">(8)</annotation></semantics></math></span></span></span></span> </span></span> where <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><msub><mi>C</mi><mi>α</mi></msub></mrow><annotation encoding="application/x-tex">C_\alpha</annotation></semantics></math></span></span> are undetermined coefficients.</p>
<p>Integrate Formula <a href="#eq:partial-fractions">8</a>, and then it can be derived that <span id="eq:integrated" data-label="(9)"><span class="katex-display-table"> <span class="katex-display-numbered"><span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mi>t</mi><mo>=</mo><mo>−</mo><munder><mo>∑</mo><mi>α</mi></munder><msub><mi>C</mi><mi>α</mi></msub><mi>ln</mi><mo>⁡</mo><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mn>1</mn><mo>−</mo><mfrac><mi>s</mi><msub><mi>r</mi><mi>α</mi></msub></mfrac><mo fence="true">)</mo></mrow></mrow><annotation encoding="application/x-tex">t=-\sum_\alpha C_\alpha\ln\!\left(1-\frac s{r_\alpha}\right)</annotation></semantics></math></span></span></span></span> <span class="katex-display-number"><span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mo stretchy="false">(</mo><mn>9</mn><mo stretchy="false">)</mo></mrow><annotation encoding="application/x-tex">(9)</annotation></semantics></math></span></span></span></span> </span></span> In most cases, Formula <a href="#eq:integrated">9</a> cannot be solved analytically and can only be solved numerically.</p>
<p>Note that if the coefficients <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><msub><mi>C</mi><mi>α</mi></msub></mrow><annotation encoding="application/x-tex">C_\alpha</annotation></semantics></math></span></span> are in general commensurable, Formula <a href="#eq:integrated">9</a> can be reduced into a rational equation. However, only mathematicians believe in such coincidences. However, if <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>n</mi><mo>=</mo><mn>2</mn></mrow><annotation encoding="application/x-tex">n=2</annotation></semantics></math></span></span>, it can be proved that the equation can be reduced into a rational one.</p>
<h2 data-label="0.4" id="example">Example</h2>
<p>The closed container that is highly thermally conductive is in a certain temperature environment, and the water-gas shift reaction <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mrow><mi mathvariant="normal">C</mi><mi mathvariant="normal">O</mi></mrow><mrow/><mo>+</mo><mrow/><mi mathvariant="normal">H</mi><msub><mpadded width="0px"><mphantom><mi>X</mi></mphantom></mpadded><mpadded height="0px"><mn>2</mn></mpadded></msub><mi mathvariant="normal">O</mi><mo>⇌</mo><mrow><mi mathvariant="normal">C</mi><mi mathvariant="normal">O</mi></mrow><msub><mpadded width="0px"><mphantom><mi>X</mi></mphantom></mpadded><mpadded height="0px"><mn>2</mn></mpadded></msub><mrow/><mo>+</mo><mrow/><mi mathvariant="normal">H</mi><msub><mpadded width="0px"><mphantom><mi>X</mi></mphantom></mpadded><mpadded height="0px"><mn>2</mn></mpadded></msub></mrow><annotation encoding="application/x-tex">
    \ce{CO +H2O\rightleftharpoons CO2 +H2}
</annotation></semantics></math></span></span></span> occurs under the catalysis of a certain catalyst, where the forward rate constant <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><msub><mi>μ</mi><mn>1</mn></msub><mo>=</mo><mn>2.07</mn><mo>×</mo><mn>1</mn><msup><mn>0</mn><mrow><mo>−</mo><mn>4</mn></mrow></msup><mspace width="1em"/><mrow><mo fence="true">(</mo><mtext>SI</mtext><mo fence="true">)</mo></mrow><mo separator="true">,</mo></mrow><annotation encoding="application/x-tex">
    \mu_1=2.07\times10^{-4}\quad\left(\text{SI}\right),
</annotation></semantics></math></span></span></span> and the reverse rate constant <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><msub><mi>μ</mi><mn>2</mn></msub><mo>=</mo><mn>8.29</mn><mo>×</mo><mn>1</mn><msup><mn>0</mn><mrow><mo>−</mo><mn>6</mn></mrow></msup><mspace width="1em"/><mrow><mo fence="true">(</mo><mtext>SI</mtext><mo fence="true">)</mo></mrow><mi mathvariant="normal">.</mi></mrow><annotation encoding="application/x-tex">
    \mu_2=8.29\times10^{-6}\quad\left(\text{SI}\right).
</annotation></semantics></math></span></span></span> Initial concentrations are <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mtable rowspacing="0.25em" columnalign="right" columnspacing=""><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><msub><mrow><mo fence="true">[</mo><mrow><mi mathvariant="normal">C</mi><mi mathvariant="normal">O</mi></mrow><mo fence="true">]</mo></mrow><mn>0</mn></msub><mo>=</mo><mn>10.00</mn><mspace width="1em"/><mrow><mo fence="true">(</mo><mtext>SI</mtext><mo fence="true">)</mo></mrow><mo separator="true">,</mo></mrow></mstyle></mtd></mtr><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><msub><mrow><mo fence="true">[</mo><mrow><mi mathvariant="normal">H</mi><msub><mpadded width="0px"><mphantom><mi>X</mi></mphantom></mpadded><mpadded height="0px"><mn>2</mn></mpadded></msub><mi mathvariant="normal">O</mi></mrow><mo fence="true">]</mo></mrow><mn>0</mn></msub><mo>=</mo><mn>20.00</mn><mspace width="1em"/><mrow><mo fence="true">(</mo><mtext>SI</mtext><mo fence="true">)</mo></mrow><mo separator="true">,</mo></mrow></mstyle></mtd></mtr><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><msub><mrow><mo fence="true">[</mo><mrow><mrow><mi mathvariant="normal">C</mi><mi mathvariant="normal">O</mi></mrow><msub><mpadded width="0px"><mphantom><mi>X</mi></mphantom></mpadded><mpadded height="0px"><mn>2</mn></mpadded></msub></mrow><mo fence="true">]</mo></mrow><mn>0</mn></msub><mo>=</mo><mn>30.00</mn><mspace width="1em"/><mrow><mo fence="true">(</mo><mtext>SI</mtext><mo fence="true">)</mo></mrow><mo separator="true">,</mo></mrow></mstyle></mtd></mtr><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><msub><mrow><mo fence="true">[</mo><mrow><mi mathvariant="normal">H</mi><msub><mpadded width="0px"><mphantom><mi>X</mi></mphantom></mpadded><mpadded height="0px"><mn>2</mn></mpadded></msub></mrow><mo fence="true">]</mo></mrow><mn>0</mn></msub><mo>=</mo><mn>40.00</mn><mspace width="1em"/><mrow><mo fence="true">(</mo><mtext>SI</mtext><mo fence="true">)</mo></mrow><mi mathvariant="normal">.</mi></mrow></mstyle></mtd></mtr></mtable><annotation encoding="application/x-tex">
\begin{split}
    \left[\ce{CO}\right]_0=10.00\quad\left(\text{SI}\right),\\
    \left[\ce{H2O}\right]_0=20.00\quad\left(\text{SI}\right),\\
    \left[\ce{CO2}\right]_0=30.00\quad\left(\text{SI}\right),\\
    \left[\ce{H2}\right]_0=40.00\quad\left(\text{SI}\right).
\end{split}
</annotation></semantics></math></span></span></span> Find
<span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mo fence="true">[</mo><mrow><mi mathvariant="normal">H</mi><msub><mpadded width="0px"><mphantom><mi>X</mi></mphantom></mpadded><mpadded height="0px"><mn>2</mn></mpadded></msub><mi mathvariant="normal">O</mi></mrow><mo fence="true">]</mo></mrow><annotation encoding="application/x-tex">\left[\ce{H2O}\right]</annotation></semantics></math></span></span> as a function of time.</p>
<p>Formula <a href="#eq:def-F">6</a> becomes <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mi>F</mi><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mi>s</mi><mo fence="true">)</mo></mrow><mo><mi mathvariant="normal">≔</mi></mo><mn>8.29</mn><mo>×</mo><mn>1</mn><msup><mn>0</mn><mrow><mo>−</mo><mn>6</mn></mrow></msup><mrow><mo fence="true">(</mo><mn>30</mn><mo>−</mo><mi>s</mi><mo fence="true">)</mo></mrow><mrow><mo fence="true">(</mo><mn>40</mn><mo>−</mo><mi>s</mi><mo fence="true">)</mo></mrow><mo>−</mo><mn>2.07</mn><mo>×</mo><mn>1</mn><msup><mn>0</mn><mrow><mo>−</mo><mn>4</mn></mrow></msup><mrow><mo fence="true">(</mo><mn>10</mn><mo>+</mo><mi>s</mi><mo fence="true">)</mo></mrow><mrow><mo fence="true">(</mo><mn>20</mn><mo>+</mo><mi>s</mi><mo fence="true">)</mo></mrow><mspace width="1em"/><mrow><mo fence="true">(</mo><mtext>SI</mtext><mo fence="true">)</mo></mrow><mi mathvariant="normal">.</mi></mrow><annotation encoding="application/x-tex">
    F\!\left(s\right)\coloneqq8.29\times10^{-6}\left(30-s\right)\left(40-s\right)
    -2.07\times10^{-4}\left(10+s\right)\left(20+s\right)
    \quad\left(\text{SI}\right).
</annotation></semantics></math></span></span></span> It is a polynomial of <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mn>2</mn></mrow><annotation encoding="application/x-tex">2</annotation></semantics></math></span></span>nd degree. Its two roots are <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mtable rowspacing="0.25em" columnalign="right" columnspacing=""><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><msub><mi>r</mi><mn>1</mn></msub><mo>=</mo><mo>−</mo><mn>28.65</mn><mspace width="1em"/><mrow><mo fence="true">(</mo><mtext>SI</mtext><mo fence="true">)</mo></mrow><mo separator="true">,</mo></mrow></mstyle></mtd></mtr><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><msub><mi>r</mi><mn>2</mn></msub><mo>=</mo><mo>−</mo><mn>5.53</mn><mspace width="1em"/><mrow><mo fence="true">(</mo><mtext>SI</mtext><mo fence="true">)</mo></mrow><mi mathvariant="normal">.</mi></mrow></mstyle></mtd></mtr></mtable><annotation encoding="application/x-tex">
\begin{split}
    r_1=-28.65\quad\left(\text{SI}\right),\\
    r_2=-5.53\quad\left(\text{SI}\right).
\end{split}
</annotation></semantics></math></span></span></span> Decomposing <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mfrac><mn>1</mn><mrow><mi>F</mi><mrow><mo fence="true">(</mo><mi>s</mi><mo fence="true">)</mo></mrow></mrow></mfrac></mrow><annotation encoding="application/x-tex">\frac1{F\left(s\right)}</annotation></semantics></math></span></span> into partial fractions, we can derive that <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mtable rowspacing="0.25em" columnalign="right" columnspacing=""><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><msub><mi>C</mi><mn>1</mn></msub><mo>=</mo><mo>−</mo><mn>217.654</mn><mspace width="1em"/><mrow><mo fence="true">(</mo><mtext>SI</mtext><mo fence="true">)</mo></mrow><mo separator="true">,</mo></mrow></mstyle></mtd></mtr><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><msub><mi>C</mi><mn>2</mn></msub><mo>=</mo><mn>217.654</mn><mspace width="1em"/><mrow><mo fence="true">(</mo><mtext>SI</mtext><mo fence="true">)</mo></mrow><mi mathvariant="normal">.</mi></mrow></mstyle></mtd></mtr></mtable><annotation encoding="application/x-tex">
\begin{split}
    C_1=-217.654\quad\left(\text{SI}\right),\\
    C_2=217.654\quad\left(\text{SI}\right).
\end{split}
</annotation></semantics></math></span></span></span> Thus, <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mi>t</mi><mo>=</mo><mn>217.654</mn><mi>ln</mi><mo>⁡</mo><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mn>1</mn><mo>−</mo><mfrac><mi>s</mi><mrow><mo>−</mo><mn>28.65</mn></mrow></mfrac><mo fence="true">)</mo></mrow><mo>−</mo><mn>217.654</mn><mi>ln</mi><mo>⁡</mo><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mn>1</mn><mo>−</mo><mfrac><mi>s</mi><mrow><mo>−</mo><mn>5.53</mn></mrow></mfrac><mo fence="true">)</mo></mrow><mspace width="1em"/><mrow><mo fence="true">(</mo><mtext>SI</mtext><mo fence="true">)</mo></mrow><mi mathvariant="normal">.</mi></mrow><annotation encoding="application/x-tex">
    t=217.654\ln\!\left(1-\frac s{-28.65}\right)-
    217.654\ln\!\left(1-\frac s{-5.53}\right)
    \quad\left(\text{SI}\right).
</annotation></semantics></math></span></span></span> Since <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><msub><mi>C</mi><mn>1</mn></msub></mrow><annotation encoding="application/x-tex">C_1</annotation></semantics></math></span></span> and <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><msub><mi>C</mi><mn>2</mn></msub></mrow><annotation encoding="application/x-tex">C_2</annotation></semantics></math></span></span> are in general commensurable, we can solve the equation analytically into <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mi>s</mi><mo>=</mo><mfrac><mrow><mn>5.53</mn><mrow><mo fence="true">(</mo><mn>1</mn><mo>−</mo><mn>1.004</mn><msup><mn>6</mn><mi>t</mi></msup><mo fence="true">)</mo></mrow></mrow><mrow><mn>1.004</mn><msup><mn>6</mn><mi>t</mi></msup><mo>−</mo><mn>0.1929</mn></mrow></mfrac><mspace width="1em"/><mrow><mo fence="true">(</mo><mtext>SI</mtext><mo fence="true">)</mo></mrow><mi mathvariant="normal">.</mi></mrow><annotation encoding="application/x-tex">
    s=\frac{5.53\left(1-1.0046^t\right)}{1.0046^t-0.1929}
    \quad\left(\text{SI}\right).
</annotation></semantics></math></span></span></span> Use Formula <a href="#eq:result">7</a>, and then we can find the answer <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mrow><mo fence="true">[</mo><mrow><mi mathvariant="normal">H</mi><msub><mpadded width="0px"><mphantom><mi>X</mi></mphantom></mpadded><mpadded height="0px"><mn>2</mn></mpadded></msub><mi mathvariant="normal">O</mi></mrow><mo fence="true">]</mo></mrow><mo>=</mo><mn>20</mn><mo>+</mo><mfrac><mrow><mn>5.53</mn><mrow><mo fence="true">(</mo><mn>1</mn><mo>−</mo><mn>1.004</mn><msup><mn>6</mn><mi>t</mi></msup><mo fence="true">)</mo></mrow></mrow><mrow><mn>1.004</mn><msup><mn>6</mn><mi>t</mi></msup><mo>−</mo><mn>0.1929</mn></mrow></mfrac><mspace width="1em"/><mrow><mo fence="true">(</mo><mtext>SI</mtext><mo fence="true">)</mo></mrow><mi mathvariant="normal">.</mi></mrow><annotation encoding="application/x-tex">
    \left[\ce{H2O}\right]=20+
    \frac{5.53\left(1-1.0046^t\right)}{1.0046^t-0.1929}
    \quad\left(\text{SI}\right).
</annotation></semantics></math></span></span></span></p>]]></content><author><name>UlyssesZhan</name><email>ulysseszhan@gmail.com</email></author><category term="chemistry" /><category term="calculus" /><category term="ode" /><category term="chemical reaction" /><category term="long paper" /><summary type="html"><![CDATA[A reversible elementary reaction takes place inside a closed, highly thermally conductive container of constant volume, whose reactants are all gases. Given the reaction equations and the reaction rate constants, a natural question to ask is how the concentration of each gas changes w.r.t. time. In this article, I will answer this question by proposing a general approach to solve it.]]></summary><media:thumbnail xmlns:media="http://search.yahoo.com/mrss/" url="https://ulysseszh.github.io/assets/images/covers/2020-04-12-concentration-time.png" /><media:content medium="image" url="https://ulysseszh.github.io/assets/images/covers/2020-04-12-concentration-time.png" xmlns:media="http://search.yahoo.com/mrss/" /></entry><entry><title type="html"><![CDATA[Normal vectors of a scalar field]]></title><link href="https://ulysseszh.github.io/math/2020/03/03/normal-field.html" rel="alternate" type="text/html" title="Normal vectors of a scalar field" /><published>2020-03-03T04:56:59-08:00</published><updated>2020-03-03T04:56:59-08:00</updated><id>https://ulysseszh.github.io/math/2020/03/03/normal-field</id><content type="html" xml:base="https://ulysseszh.github.io/math/2020/03/03/normal-field.html"><![CDATA[<p>Consider the function <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>y</mi><mo>=</mo><mi>f</mi><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mi mathvariant="bold">x</mi><mo fence="true">)</mo></mrow></mrow><annotation encoding="application/x-tex">y=f\!\left(\mathbf x\right)</annotation></semantics></math></span></span>, where the domain <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>D</mi><mo>⊆</mo><msup><mi mathvariant="double-struck">R</mi><mi>n</mi></msup></mrow><annotation encoding="application/x-tex">D\subseteq\mathbb R^n</annotation></semantics></math></span></span>, and the function is differentiable everywhere.</p>
<p>According to some well-known theories, we can derive that the normal vector of the graph of the function at <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mo fence="true">(</mo><msub><mi mathvariant="bold">x</mi><mn>0</mn></msub><mo separator="true">,</mo><mi>f</mi><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><msub><mi mathvariant="bold">x</mi><mn>0</mn></msub><mo fence="true">)</mo></mrow><mo fence="true">)</mo></mrow><annotation encoding="application/x-tex">\left(\mathbf x_0,f\!\left(\mathbf x_0\right)\right)</annotation></semantics></math></span></span> is <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mo fence="true">(</mo><mi mathvariant="normal">∇</mi><mi>f</mi><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><msub><mi mathvariant="bold">x</mi><mn>0</mn></msub><mo fence="true">)</mo></mrow><mo separator="true">,</mo><mo>−</mo><mn>1</mn><mo fence="true">)</mo></mrow><annotation encoding="application/x-tex">\left(\nabla f\!\left(\mathbf x_0\right),-1\right)</annotation></semantics></math></span></span>.</p>
<p>This gives us an idea that, in fact a conservative field consists of normal vectors of its potential function (a scalar function).</p>
<p>We also know that a scalar function can be derived from its gradient by integrating it along an arbitrary path (what exactly the path is is not important because it is a conservative field, so you can choose one as long as it can make the calculation easy). Here it can come into our minds that we can derive a multi-variable function from its normal vectors.</p>
<p>The method is to make the last component of the normal vectors be <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mo>−</mo><mn>1</mn></mrow><annotation encoding="application/x-tex">-1</annotation></semantics></math></span></span> and then calculate the integral of the rest components.</p>
<p>I am sorry that the passage is too brief, but I need to have some rest after experiencing several continuous tests today and yesterday. Bless me!</p>]]></content><author><name>UlyssesZhan</name><email>ulysseszhan@gmail.com</email></author><category term="math" /><category term="calculus" /><category term="vector analysis" /><summary type="html"><![CDATA[This article gives the formula for the normal vectors of a surface defined by a scalar field on <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><msup><mi mathvariant="double-struck">R</mi><mi>n</mi></msup></mrow><annotation encoding="application/x-tex">\mathbb R^n</annotation></semantics></math></span></span>. The normal vector of the graph of the function <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>y</mi><mo>=</mo><mi>f</mi><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><mi mathvariant="bold">x</mi><mo fence="true">)</mo></mrow></mrow><annotation encoding="application/x-tex">y=f\!\left(\mathbf x\right)</annotation></semantics></math></span></span> at <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mo fence="true">(</mo><msub><mi mathvariant="bold">x</mi><mn>0</mn></msub><mo separator="true">,</mo><mi>f</mi><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><msub><mi mathvariant="bold">x</mi><mn>0</mn></msub><mo fence="true">)</mo></mrow><mo fence="true">)</mo></mrow><annotation encoding="application/x-tex">\left(\mathbf x_0,f\!\left(\mathbf x_0\right)\right)</annotation></semantics></math></span></span> is <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mo fence="true">(</mo><mi mathvariant="normal">∇</mi><mi>f</mi><mtext> ⁣</mtext><mrow><mo fence="true">(</mo><msub><mi mathvariant="bold">x</mi><mn>0</mn></msub><mo fence="true">)</mo></mrow><mo separator="true">,</mo><mo>−</mo><mn>1</mn><mo fence="true">)</mo></mrow><annotation encoding="application/x-tex">\left(\nabla f\!\left(\mathbf x_0\right),-1\right)</annotation></semantics></math></span></span>. This also provides us a way to recover a scalar field from the normal vectors of its graph: normalizing the vectors so that the last component is <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mo>−</mo><mn>1</mn></mrow><annotation encoding="application/x-tex">-1</annotation></semantics></math></span></span>, and then integrate the rest components.]]></summary><media:thumbnail xmlns:media="http://search.yahoo.com/mrss/" url="https://ulysseszh.github.io/assets/images/covers/2020-03-03-normal-field.png" /><media:content medium="image" url="https://ulysseszh.github.io/assets/images/covers/2020-03-03-normal-field.png" xmlns:media="http://search.yahoo.com/mrss/" /></entry></feed>