Orthogonality

Meaning

In mathematics, orthogonality represents a general description of objects being perpendicular some sense. In the case of vectors, it is quite intuitive to check as the dot products of two pependicular (orthogonal) vectors is zero

• Two vectors $\mathbf{a},\mathbf{b}\in {\mathbb{R}}^n$ are orthogonal if

$$(\mathbf{a},\mathbf{b}):={\mathbf{a}}^{\top }\mathbf{b}=0.$$

• Two functions $f,g$ are orthogonal if

$$(f,g):={\int }_a^{b}f(x)g(x)dx=0,$$

the $\sin$, $\cos$ functions for instance.

• Two (mean-free) random variables $X,Y$ are orthogonal if they are uncorrelated, i.e.,

$$(X,Y):=\mathbb{E}[XY]=0.$$