Vectors and Matrix Operations

## The determinant in one sentence The determinant is a single number attached to a **square** matrix. It compresses the whole matrix into one scalar, and the single most useful thing that scalar decides is invertibility: a square matrix `A` has an inverse if and only if `det(A)` is not zero. ## What "inverse" means The inverse of a square matrix `A` is the matrix `A^-1` for which `A A^-1 = A^-1 A = I`, where `I` is the identity matrix (ones on the diagonal, zeros elsewhere). The identity is the do-nothing matrix: `I x = x` for every vector `x`. So the inverse is the matrix that exactly undoes what `A` does. A matrix that has an inverse is called **invertible** or **non-singular**; one that does not is **singular**. A useful fact for square matrices: a one-sided inverse is automatically two-sided. If `A` and `B` are both n-by-n and `B A = I`, then `A B = I` too. That is special to square matrices and is why we can talk about "the" inverse without qualifying which side. ## The 2x2 case, worked For ``` A = [[a, b], [c, d]] ``` the determinant is `det(A) = ad - bc`, and when it is non-zero ``` A^-1 = (1 / (ad - bc)) * [[ d, -b], [-c, a]] ``` This formula makes the theorem almost self-evident at 2x2: the construction divides by `ad - bc`, so the moment `ad - bc = 0` there is nothing to build. Check it on `A = [[1, 2], [3, 4]]`: `det(A) = 1*4 - 2*3 = -2`, so `A^-1 = (1 / -2) * [[4, -2], [-3, 1]] = [[-2, 1], [1.5, -0.5]]`. Multiplying `A A^-1` gives the identity. Now take `A = [[1, 2], [2, 4]]`. Here `det(A) = 1*4 - 2*2 = 0`. The second row is exactly twice the first, and no inverse exists. Notice the pattern: the determinant vanishing is the algebraic signature of the rows (equivalently the columns) being redundant rather than independent directions. ## Bigger matrices Beyond 2x2 the same theorem holds, only the arithmetic is heavier. A 3x3 determinant can be expanded along a row using 2x2 sub-determinants with alternating signs (cofactor expansion), and for a triangular matrix (all entries below or all entries above the diagonal are zero) the determinant is simply the product of the diagonal entries. The identity matrix, being diagonal with all ones, has determinant 1 — consistent with it being trivially invertible, since it is its own inverse. ## What zero means geometrically Read a square matrix as a linear map that sends vectors to vectors. The determinant is the factor by which that map scales area (in two dimensions) or volume (in higher dimensions). A determinant of zero says the map flattens: it sends the unit square onto a line segment or a single point, so the output has zero area. Flattening destroys information — many different inputs land on the same output — and a map that destroys information cannot be undone. That is the geometric reason a singular matrix has no inverse. ## Square only Determinants exist only for square matrices. Asking for the determinant of a 3x4 matrix is a category error, not a computation with answer zero. Likewise a non-square matrix never has a two-sided inverse, since `A B` and `B A` cannot both be identity matrices of the same size. ## Traps interviewers watch for - **Additivity.** `det(A + B)` is generally *not* `det(A) + det(B)`. Take `A = I` and `B = -I` at 2x2: `det(A) = 1`, `det(B) = 1`, but `A + B` is the zero matrix with determinant 0, not 2. - **Transpose.** `det(A^T) = det(A)`. So `A` is invertible exactly when `A^T` is. - **Small versus zero.** The theorem is an exact statement about the number being zero. A small non-zero determinant still means invertible; determinant magnitude is not a graded measure of invertibility, because rescaling the whole matrix rescales the determinant. - **Sign.** A negative determinant is perfectly fine — it means invertible with the orientation flipped. Only zero is special. ## How to answer in the room State the equivalence first (`det(A) = 0` if and only if `A` is singular), give the 2x2 formula and its `ad - bc` denominator as the reason, then offer the geometric reading: determinant zero means the map collapses volume, and a collapse cannot be reversed. That is a complete answer in under a minute.