Blog

The Doob–Meyer Decomposition: Predictability Depends on Information

stochastic-processes · time-series · probability-theory

For a suitable submartingale, Doob–Meyer separates predictable increasing drift from a martingale. The split depends on the information available, and does not remove every form of predictable variation.

Spectral Pollution in Kernel DMD: What Projection Can Change

koopman · numerical-analysis · dynamical-systems · ml-theory

Finite-dimensional projections can introduce spectral points absent from the full Koopman operator. A worked compression example separates spectral pollution, continuous spectrum, and eigenvalue sensitivity.

How Language Generation Works: From Tokens to Transformers

nlp · transformers · deep-learning · language-models

A conceptual map of generation: subword tokenization → learned embeddings → attention-based next-token prediction. Concrete diagrams show what each stage buys you and what it assumes.

Normalizing Flows: Density Estimation by Change of Variables

generative-models · deep-learning · math · normalizing-flows

Normalizing flows turn density estimation into calculus: invertible transforms + Jacobians give exact log-likelihoods. This post builds the change-of-variables view and why architectures like RealNVP make it tractable.

Eigenvalue Sensitivity: Pseudospectra for Non-Normal Operators

math · linear-algebra · numerical-analysis

Pseudospectra quantify eigenvalue sensitivity at a chosen error tolerance. A worked matrix example explains their perturbation guarantee and why it does not automatically validate a Koopman approximation.