Remix.run Logo
khalic 3 hours ago

If you’re looking into small models for tiny local tasks, you should try Qwen coder 0,5B. It’s more of an experiment, but it can output decent functions given the right context instructions.

xenophonf 2 hours ago | parent [-]

> [Qwen coder 0,5B] can output decent functions given the right context instructions

Can you share a working example?

khalic 2 hours ago | parent [-]

So… a prompt? I’m not on my laptop but I hooked it to cmp.nvim, gave it a short situational prompt, +- 10 lines, and started typing. Not anywhere near usable but with a little effort you can get something ok for repetitive tasks. Maybe something like spotting one specific code smell pattern. The advantage is the ridiculous T/s you get