Remix.run Logo
ilaksh 2 hours ago

Hmm.. this might make it feasible to build something like a command line program where you can optionally just specify the arguments in natural language. Although I know people will object to including an extra 14 MB and the computation for "parsing" and it could be pretty bad if everyone started doing that.

But it's really interesting to me that that may be possible now. You can include a fine-tuned model that understands how to use your program.

E.g. `> toolcli what can you do` runs `toolcli --help summary`, `toolcli add tom to teamfutz group` = `toolcli --gadd teamfutz tom`

HenryNdubuaku 2 hours ago | parent [-]

So Needle is trained for INT4, what you see in the playground is INT4, only 14MB, same challenge though.

ilaksh 2 hours ago | parent [-]

Oh gotcha. Fixed my comment.