Having some success while testing this model out as a replacement for GPT-5 nano in source code security review. Running on RTX 3090 (24 GB VRAM) via vLLM. It's not great on structured output (as noted in the model card) but I'm working around that in my harness.

▲

dummydummy1234 8 hours ago | parent | next [-]

Can't you just force it to do structured output via constrained generation?

▲

hypfer 6 hours ago | parent | prev [-]

> but I'm working around that in my harness.

How?

	▲	uberex 24 minutes ago \| parent [-]
		Maybe limiting logits to what is syntactically correct? E.g. {"hello" has to be followed by whitespace or colon. Any other logits get dropped.