After building some toy LLMs on my own I came to realise that architecture is not the hard part. Train is.