Demystifying Vector Spaces

Vectors are fundamental mathematical objects that represent both direction and magnitude, acting as instructions for movement rather than fixed locations. Understanding vectors is crucial for fields ranging from physics and engineering to computer graphics and machine learning.

Vectors Define Movement

A vector describes a translation from one point to another. For instance, a vector (3,2) represents moving 3 units horizontally and 2 units vertically. This perspective emphasizes that a vector defines a *change* or *displacement*, not just a specific coordinate.

Adding Vectors

Vector addition combines these movement instructions. If you have a vector `V` that moves you 3 units right and 2 units up, and another vector `W` that moves you 1 unit right and 3 units up, their sum `V + W` represents the combined movement: 4 units right and 5 units up. Graphically, this is like chaining the vectors head-to-tail.

Scaling Vectors

Scaling a vector multiplies its magnitude by a scalar value without changing its direction. For example, if vector `V` is (3,2), then `2V` is (6,4). This means taking the original movement instruction and performing it twice, effectively stretching the vector to be twice as long.

Combining Vectors to Reach Any Point

By combining vector addition and scalar multiplication, you can reach various points from an origin. Consider two vectors, `V = (2,1)` and `W = (1,2)`. A linear combination like `3V + W` means taking three steps in the direction and magnitude of `V`, followed by one step in the direction and magnitude of `W`. This would result in a movement of `(3*2 + 1*1, 3*1 + 1*2) = (7,5)`.

Defining a Vector Space

The collection of all points reachable through any linear combination of a set of vectors forms a vector space. For instance, if you have two non-collinear vectors in a 2D plane, their linear combinations (`aV + bW` for any scalars `a` and `b`) can reach *every* point in that plane. This set of all reachable points is known as the span of those vectors.

Key takeaways

• Vectors represent movement or displacement, not just a fixed position.
• Vector addition chains movement instructions together.
• Scalar multiplication stretches or shrinks a vector without altering its direction.
• Linear combinations (adding scaled vectors) allow reaching new points.
• A vector space is the set of all points reachable by linear combinations of a given set of vectors.
• The span of a set of vectors is the entire space they can define.