All topics

Topic

Statistical and Adaptive Signal Processing

Estimation and detection from noisy observations — how to infer parameters, bound how well anyone could, and adapt when the statistics move.

A fanned-out stack of handwritten, colour-highlighted study notes on statistical signal processing, the estimation taxonomy visible on the top page.
The handwritten originals — these notes existed on paper before they existed here.
/13 min read

Parameter Estimation

What it means to estimate a parameter, and a map of the six workhorse estimators — LS, MVUE, MLE, LMMSE, MMSE, MAP — chosen by asking what you actually know.

  • estimation-theory
  • foundations
/25 min read

Classical Parameter Estimation

The classical branch in full, with MVUE as the goal, the Cramér–Rao bound as the yardstick, maximum likelihood as the workhorse, and least squares when a signal model is all you have.

  • estimation-theory
  • crlb
  • maximum-likelihood
  • least-squares
/11 min read

Bayesian Parameter Estimation

The parameter becomes a random vector with a prior. Bayes' theorem turns one data record into a posterior, and MAP, MMSE, and LMMSE are three ways of summarizing it, collapsing into a single formula when everything is Gaussian.

  • estimation-theory
  • bayesian
  • mmse
  • map