Google helpfully made some docs on how to fine-tune this model [0]. I'm looking forward to giving it a try!
[0]: https://ai.google.dev/gemma/docs/core/huggingface_text_full_finetune