I wanted to try this - essentially for my dataset I have a number of decision questions for the same input. I haven't figured out yet which local model to try first with it!

▲ unikcc a day ago | parent [-]

Thanks! Welcome to give it a try.

You can check the Decision Index leaderboard at https://huggingface.co/spaces/multimodalart/jev-decision-ind... for reference, and we already support many of the models (see our README).

Or you can try our own model, OneJev (https://github.com/OmniJev/OneJev):

  flide serve --model OmniJev/OneJev1.6-0.8B

We're actively improving it.

▲

roger_ a day ago | parent [-]

Is GLiDE 9B+ supported? It's a Qwen fine tune so it's not clear.

	▲	unikcc a day ago \| parent [-]
		Not yet, unfortunately. We plan to support it in the next few versions. But since GLiDE uses bidirectional attention, it can't be accelerated as much as others.