Did you finetune it before trying? Docs here:

How well does using a SOTA model for fine-tuning work? I'm sure people have tried

Thanks, will check that out as well tomorrow or during the weekend!

	▲	canyon289 6 days ago \| parent [-]
		If you know you want JSON for sure constrained decoding in an inference framework will help. The model is just one part of an overall inference system. I hope this model paired with other tools help you get done whatever it is you're looking to get done