Understanding Transformers: A Step-by-Step Math Example - Part 1 | By Fareed Khan, I hope to simplify the understanding of the transformer architecture. To determine the vocabulary size, we need to identify the total number of unique words in our dataset. There are 3 sentences (dialogues) taken from the Game of Thrones TV show.
Table of contents
Step 1 (Defining the data)Step 2 (Finding the Vocab Size)Step 3 (Encoding and Embedding)1 Comment
Sort: