Linear transformation

A linear transformation is a fundamental operation in Mathematics that maps elements from one vector space to another while preserving the structure of addition and scalar multiplication. If f is a linear transformation, then f(ax + by) = a**f(x) + b**f(y) for any scalars a, b and vectors x, y.

Linear transformations appear everywhere: rotations and reflections in space, neural networks (where each layer applies a linear transformation plus nonlinearity), Computer graphics, and quantum mechanics. They're often represented as matrices, making computation tractable and elegant.

The power of linear transformations lies in their simplicity and universality. Even complex systems can be understood by studying how they stretch, shrink, rotate, or project data. The eigenvalues and eigenvectors of a linear transformation reveal its deepest geometric properties—the "axes" along which it acts most purely.

In machine learning, attention mechanisms and transformer architectures rely heavily on carefully designed linear transformations combined with nonlinear activations to learn rich representations of data. Understanding linear transformations is essential for anyone exploring mathematics, physics, engineering, or modern AI.

Related

Linear algebra, Kernel (linear algebra), Basis (linear algebra), Determinant, Rank (linear algebra)