Remix.run Logo
▲ dvdplm 2 days ago

Can the local model code at all? Eg as the predictor in Zed?

▲jon-wood 2 days ago | parent | next [-]

I just had a very basic poke at `fm` which runs models locally it was at least able to spit out fizzbuzz in both Python and Rust impressively fast. Whether its any good wrapped in a coding harness remains to be seen.

▲these 2 days ago | parent [-]

My experience has been that out of the box, AFM has a hard time with tool calls. Even with pi, I had to trim down the system prompt and update the tool descriptions to make it succeed in even the simplest of tool calls.

▲bobertdowney 2 days ago | parent | prev [-]

Even the stronger Private Cloud Compute model struggled with the coding task I gave it (build a web-based side-scrolling platformer). I used this and pointed Cursor at it to test: https://github.com/littlebobert/pcc-server-example