Discrete Calculus

Table of Contents

In contrast to the continuous calculus, it does calculus on discrete functions. May be used for numerical analysis.

1. Discrete Function

1.1. Sequence

A sequence \((a_n)_{n\in \mathbb{N}}\) can be reformulated as a function from natural number (or integer) to a set \(S\). \[ a\colon \mathbb{N} \to S. \]

Discrete calculus mostly deals with a sequence in real or complex number.

2. Forward Difference

It is discrete equivalent of differentiation, defined as \[ \Delta f(n)=f(n+1)-f(n) \]

2.1. Properties

Falling and rising factorials are the discrete equivalent of power functions.

\begin{align*} \Delta n^{\underline{p}}&=(n+1)n^{\underline{p-1}} - (n-p+1)n^{\underline{p-1}} \\ &=p\, n^{\underline{p-1}} \end{align*}

Exponential function with base 2 is the discrete equivalent of the natural exponential function \(e^x\). \[ \Delta 2^n = 2^n \]

Linearity applies \[ \Delta(a f_n + b g_n) = a\Delta f_n + b\Delta g_n, \] but Leibniz rule (product rule) does not \[ \Delta (f_ng_n) \\= \Delta f_ng_n + f_{n+1}\Delta g_n = \Delta f_ng_{n+1} + f_n\Delta g_n \\=\Delta f_ng_n + f_n\Delta g_n + \Delta f_n \Delta g_n. \] This is directly related to the summation by parts, and the form is similar to the quadratic variation

Quotient Rules

  • \[ \Delta \left(\frac{1}{a_n}\right) = -\frac{\Delta a_n}{a_{n+1}a_n} = -\frac{\Delta a_n}{a_n^2 + a_n\Delta a_n} \]
  • \[ \Delta \left(\frac{a_n}{b_n}\right) = \frac{\Delta a_n b_n - a_n\Delta b_n}{b_n(b_n+\Delta b_n)} \]

Higher Order Difference

  • \[ \Delta^k a_n = \sum_{i = 0}^k(-1)^i\binom{k}{i}a_{n+k-i} \]

The linear operator \(L\colon a_{n+m} \mapsto a^m\) also maps \[ L\colon \Delta^m a_n \mapsto (a-1)^m. \] See umbral calculus.

2.2. Newton's Forward Difference Formula

\[ a_{n+k} = \sum_{i=0}^k \binom{k}{i}\Delta^ia_n \]

It applies to continuous function as well, \[ f(x) = \sum_{n=0}^\infty \binom{x}{n}\Delta^n f(0). \]

3. Summation

The summation is used for discrete integration \[ \sum_{k=0}^{n-1}f(k)=F(n) \]

3.1. Summation by Parts

  • Abel's Lemma, Abel Transformation

\[ \sum_{k=m}^n f_k\Delta g_k = (f_{n+1}g_{n+1}-f_mg_m)-\sum_{k=m}^n g_{k+1}\Delta f_k \]

3.1.1. Abel's Summation Formula

The interchange between summation and integration \[ \sum_{x < n \le y} a_n\phi(n) = A(y)\phi(y) - A(x)\phi(x) - \int_x^y A(u)\phi'(u)\,du. \] where \[ A(t) = \sum_{0 \le n \le t} a_n. \]

4. Fundamental Theorem of Discrete Calculus

Similar to the fundamental theorem of calculus, \[ \sum_{k=0}^{n-1}\Delta f(k) = f(n)-f(0). \]

5. Difference Equation

5.1. First Order Linear Constant Coefficient

\[ \Delta y_n + ay_n = 0 \]

The solution is \(y_n = C(1-a)^n\)

5.2. Homogeneous Linear Constant Coefficient

\[ a_ky_{n+k} + a_{k-1}y_{n+k-1} + \cdots + a_1y_{n+1} + a_0 y_n = 0 \]

The solution is the linear combination of the powers of the roots of characteristic equation: \[ a_k\alpha^k + a_{k-1}\alpha^{k-1} + \cdots + a_1\alpha + a_0 = 0. \]

The full solution is given by: \[ y_n = C_1 \alpha_1^n + C_2\alpha_2^n +\cdots + C_k\alpha_k^n \]

5.3. Inhomogeneous Linear Constant Coefficient

The homogeneous solution with the particular solution.

For the constant case: \[ a_ky_{n+k} + a_{k-1}y_{n+k-1} + \cdots + a_1y_{n+1} + a_0 y_n = s \] the particular solution is a constant.

5.4. Matrix Difference Equation

\[ \mathbf{x}_{t+2} = \mathbf{A}\mathbf{x}_{t+1} + \mathbf{B}\mathbf{x}_t \]

6. Transformation to Continuous Calculus

One can define a linear operator \(\phi : x^{n}\mapsto x^{\underline{n}}\), which comes from the umbral calculus, and find that \[ \phi D=\Delta \phi. \]

Using this, one can find the formulae for summation, Newton's forward difference formula, and much more.

6.1. Special Transformations

Power function \[ \phi(x^n) = \sum_{k=1}^n (-1)^{n-k}\left[\vphantom{1}n \atop k\right]x^k \] \[ \phi^{-1}(x^n) = \sum_{k=1}^n \left\{\vphantom{1}n\atop k\right\}x^k \] where the coefficients are Stirling numbers.

Exponential Function \[ \phi(e^{ax}) = \sum_{n=0}^\infty \binom{x}{n}a^n = (a+1)^x \]

Trigonometric Function \[ \phi(\sin x) = \sqrt{2^x}\sin\left(\frac{\pi x}{4}\right) \]

Logarithmc Function \[ \phi(\ln x) = H_{x-1} \] where \(H_x\) is the .

7. Discrete Fourier Transform

7.1. Definition

\[ X_{k}=\sum_{n=0}^{N-1}x_n\cdot e^{-i2\pi k n/N} \] for \(\lbrace x_n\rbrace_{n=0}^{N-1}, \lbrace X_k\rbrace_{k=0}^{N-1}\).

8. Z-Transform

  • Discrete-time equivalent of Laplace transform
  • Complex valued frequency domain, the z-domain.

8.1. Definition

\[ \mathcal{Z}\{x_n\}(z) = \sum_{n=-\infty}^{\infty}x_nz^{-n}. \]

\(z^{-n}\) is used because it is discrete equivalent of exponential function.

See equivalences.

9. Time-Scale Calculus

Unification of difference equations with the differential equations, thus unification of integral and differential calculus with the calculus of finite differences.

For a function \(f\colon \mathbb{T} \to \mathbb{R}\) the delta derivative, Higher derivative, \(f^{\Delta}(t)\) exists if and only if: \[ \exists U \in \mathcal{N}(t), \forall\varepsilon > 0, \forall s \in U\colon | f(\sigma(t)) - f(s) - f^{\Delta}(t)(\sigma(t) -s) \le \varepsilon|\sigma(t) - s| \] where \(\sigma(t)\) is the infimum of the upper bound of \(t\).

Three popular examples are differential calculus, difference calculus, and quantum calculus.

10. Reference

Author: Jeemin Kim

Created: 2026-10-27 Tue 05:57