Remix.run Logo
BoredomIsFun 2 hours ago

Ok folks, here is a different perspective. I used local model, GLM-4-0414-32b, a trashy IQ4_XS quant, and here what I got:

prompt #1:

> the car wash only 50 meters from my home. I want to get my car washed, should I drive or walk?

Walking is probably the better option!

Here's why:

    Convenience: 50 meters is extremely short – only about 160 feet. You can likely walk there in less than a minute.
    Efficiency: Driving involves getting your keys, unlocking the car, starting it, driving 50 meters, parking, locking it again, and then doing the reverse to get home. Walking skips all that.
    Environmental Impact: You avoid using fuel for such a short distance.
    Exercise: It's a quick little bit of physical activity.
Driving would be overkill for such a short distance. Just walk over!

prompt #2:

> the car wash only 50 meters from my home. I want to get my car washed, should I drive or walk? use long chain of thought thinking

8. Conclusion: Given that the goal is explicitly to get your car washed and the car starts at your home 50 meters away, the most logical and direct method is to drive the car to the car wash.

    Walking does not move the car to the necessary location.
    Driving, although a very short distance, is the only method presented that directly facilitates the core task of transporting the car to the wash.
    The negligible time difference, minimal environmental impact, and directness make driving the car itself the clear choice for achieving the stated goal.
Therefore, you should drive your car the 50 meters to the car wash.

otoh, nanbeige-3B-Q8 (3 billion weights!) gave right away the following:

Drive.

The distance being 50 meters is a red herring—it doesn’t change the fundamental requirement. You need to move the car, and only driving accomplishes that.

If you meant something different by "drive or walk" (e.g., payment method, DIY vs. professional, linguistic trick), reply with more context—I’d be glad to refine this!

Ylpertnodi 2 hours ago | parent | next [-]

>50 meters is extremely short – only about 160 feet

So, the ai automatically converted 50m to 160ft? Would it do the same if you told it '160 ft to the wash, walk or drive?'

BoredomIsFun 2 hours ago | parent [-]

huh, I need to check...

chrisandchris 2 hours ago | parent | prev [-]

What I relly dislike about these LLM is how verbose they get even for such a short, simple question. Is it really necessary to have such a lobg answer and who's going to read that one anyway?

Maybe it's me and may character but when human gets that verbose for a question that can be answered with "drive, you need the car" I would like to just walk away halfway through the answer to not having to hear all the universes history just to get an answer. /s

ninjagoo an hour ago | parent | next [-]

The verbosity is likely a result of the system prompt for the LLM telling it to be explanatory in its replies. If the system prompt was set to have the model output shortest final answers, you would likely get the result your way. But then for other questions you would lose benefitting from a deeper explanation. It's a design tradeoff, I believe.

BoredomIsFun an hour ago | parent [-]

My system prompt is default - "you are a helpful assistant". But that beyound the point though. You don't want too concise outputs as it would degrade the result, unless you are using a reasoning model.

I recommend rereading my top level comment.

BoredomIsFun 2 hours ago | parent | prev [-]

Well, when I asked for a very long answer (prompt #2), the quality had dramatically improved. So yes, longer answer produces better result. At least with small LLMs I can run on my GPU locally.