This is also recommended reading if you want to learn more about building LLMs from scratch: See:

Train your own LLM - https://github.com/angelos-p/llm-from-scratch

HN Discussion - https://news.ycombinator.com/item?id=48017948