Skip to content
Understanding ARMA: The Core of Stationary Time Series Models
Fundamentals 3 min read

Understanding ARMA: The Core of Stationary Time Series Models

This article explains the three main types of stationary time‑series models—AR, MA, and ARMA—detailing their definitions, back‑shift operator notation, polynomial representations, and the essential stationarity and invertibility conditions required for valid modeling.

Model Perspective
Model Perspective
Model Perspective

ARMA Time Series Overview

AR model (Auto Regressive)

MA model (Moving Average)

ARMA model (Auto Regressive Moving Average)

Let {X_t} be a zero‑mean stationary series that satisfies a linear relation with a zero‑mean white‑noise error {ε_t} of variance σ². An AR(p) process can be written as X_t = φ₁X_{t-1}+…+φ_pX_{t-p}+ε_t, where φ = (φ₁,…,φ_p) is the autoregressive coefficient vector.

Introducing the back‑shift operator B (B X_t = X_{t-1}) simplifies the representation. The operator polynomial Φ(B)=1-φ₁B-…-φ_pB^p allows the model to be expressed compactly as Φ(B)X_t = ε_t.

Similarly, an MA(q) process uses the moving‑average coefficient vector θ and can be written as X_t = θ₁ε_{t-1}+…+θ_qε_{t-q}+ε_t, or equivalently Θ(B)ε_t = X_t with Θ(B)=1+θ₁B+…+θ_qB^q.

An ARMA(p,q) model combines both: Φ(B)X_t = Θ(B)ε_t. When q=0 it reduces to an AR(p) model; when p=0 it reduces to an MA(q) model.

For a stationary ARMA model, the following assumptions are required:

The polynomials Φ(B) and Θ(B) share no common factors.

All roots of Φ(B)=0 lie outside the unit circle (stationarity condition).

All roots of Θ(B)=0 lie outside the unit circle (invertibility condition).

Original Source

Signed-in readers can open the original source through BestHub's protected redirect.

Sign in to view source
Republication Notice

This article has been distilled and summarized from source material, then republished for learning and reference. If you believe it infringes your rights, please contactadmin@besthub.devand we will review it promptly.

statisticsmodelingTime SeriesARMAstationarity
Reader feedback

How this landed with the community

Sign in to like

Rate this article

Was this worth your time?

Sign in to rate
Discussion

0 Comments

Thoughtful readers leave field notes, pushback, and hard-won operational detail here.