A process to transform Words within a Language into -dimensional vectors, for easier processing in Language Models.

- Similar words are closer in magnitude to eachother
- Same words with different meanings can have multiple vectors
Often done with One Hot Encodings ran through a Look Up Table Matrix
