Remix.run Logo
kazinator 7 days ago

Gemini wasted my time today assuring me that if I want a git bundle that only has the top N commits, yet is cleanly clone-able, I can just make a --depth N clone of the original repo, and and do a git bundle create ... --all.

Nope; cloning a bundle created from a depth-limited clone results in error messages about missing commit objects.

So I tell the parrot that, and it comes back with: of course, it is well-known that it doesn't work, blah blah. (Then why wasn't it well known one prompt ago, when it was suggested as the definitive answer?)

Obviously, I wasn't in the "the right mindset" today.

This mindset is one of two things:

- the mindset of a complete n00b asking a n00b question that it will nail every time, predicting it out of its training data richly replete with n00b material.

- the mindset of a patient data miner, willing to expend all they keystrokes. needed to build up enough context to in effect create a query which zeroes in on the right nugget of information that made an appearance in the training data.

It was interesting to go down this #2 rabbit hole when this stuff was new, which it isn't any more. Basically do most of the work, while it looks as if it solved the problem.

I had the right mindset for AI, but most of it has worn off. If I don't get something useful in one query with at most one follow up, I quit.

The only shills who continue to hype AI are either completely dishonest assholes, or genuine bros bearing weapons-grade confirmation bias.

Let's try something else:

Q: "What modes of C major are their own reflection?"

A: "The Lydian and Phrygian modes are reflections of each other, as are the Ionian and Aeolian modes, and the Dorian and Mixolydian modes. The Locrian mode is its own reflection."

Very nice sounding and grammatical, but gapingly wrong in every point. The only mode that is its own reflection is Dorian. Furthermore, Lydian and Phrygian are not mutual reflections. Phrygian reflected around is root is Ionian. The reflection of Lydian is Locrian; and of Aeolian, Mixolydian.

I once loaded a NotebookLM with materials about George Russel's concept of the Lydian Chromatic, and Tonal Gravity. It made an incomprehensible mess of explaining the stuff, worse than the original sources.

AI performs well on whatever is the focus of its purveyors. When they want to shake down entry-level coding, they beef it up on entry-level coding and let it loose, leaving it unable to tell Mixolydian from mixing console.

lisbbb 7 days ago | parent | next [-]

Thank you! This is what I've been trying to tell people about LLMs. They don't hold up. They're like those Western movie set towns that look normal from the front, but when you walk around behind them, you see it is all just scaffolding with false fronts.

cindyllm 7 days ago | parent [-]

[dead]

ishyaboibro 7 days ago | parent | prev [-]

what model did you ask? here's the exact reply I received from Claude Sonnet, which appears to be exactly the answer you were expecting:

"Among the seven modes of C major, only Dorian is its own reflection.

Understanding Mode Reflections When we reflect a mode, we reverse its interval pattern. The modes of C major and their interval patterns are:

Ionian: W-W-H-W-W-W-H

Dorian: W-H-W-W-W-H-W

Phrygian: H-W-W-W-H-W-W

Lydian: W-W-W-H-W-W-H

Mixolydian: W-W-H-W-W-H-W

Aeolian: W-H-W-W-H-W-W

Locrian: H-W-W-H-W-W-W

The Palindromic Nature of Dorian Dorian mode is palindromic, meaning it produces the same scale whether you read its interval pattern forwards or backwards. When you reverse the Dorian interval pattern W-H-W-W-W-H-W, you get exactly the same sequence: W-H-W-W-W-H-W.

Mirror Pairs Among the Other Modes The remaining modes form mirror pairs with each other:

Ionian-Phrygian: Mirror pair

Lydian-Locrian: Mirror pair

Mixolydian-Aeolian: Mirror pair

For example, when you reflect the C major scale (Ionian), which has the interval pattern W-W-H-W-W-W-H, you get H-W-W-W-H-W-W, which corresponds to the Phrygian mode.

This symmetrical relationship exists because the whole diatonic scale system can be symmetrically inverted, creating these natural mirror relationships between the modes"

kazinator 7 days ago | parent [-]

> what model did you ask?

Are you hoping to disprove my point by cherry picking the AI that gets the answer?

I used Gemini 2.5 Flash.

Where can I get an exact list of stuff that Gemini 2.5 Flash does not know that Claude Sonnet does, and vice versa?

Then before deciding to consult with AI, I can consult the list?

simianwords 7 days ago | parent | next [-]

2.5 flash is particularly cheap and fast, I think 2.5 pro would have got all the answers correct - at least it gets this one correct.

Yokolos 7 days ago | parent | next [-]

I get a lot of garbage out of 2.5 Pro and Claude Sonnet and ChatGPT. There's always this "this is how you solve it", I take a close look and it's clearly broken, I point it out and it's all "you're right, this is a common issue". Okay, so why do we have to do this song and dance a million times to arrive at the actually correct answer?

kazinator 7 days ago | parent | prev [-]

Why doesn't Flash get it correct, yet comes up with plausible sounding nonsense? That means it is trained on some texts in the area.

What would make 2.5 Pro (or anything else) categorically better would be if it could say "I don't know".

There will be things that Claude 3.7 or Gemini Pro will not know, and the interpolations they come up with will not make sense.

simianwords 7 days ago | parent [-]

Model accuracy goes up as you use heavier models. Accuracy is always preferable and the jump from Flash to Pro is considerable.

You must rely on your own internal model in your head to verify the answers it gives.

On hallucination: it is a problem but again, it reduces as you use heavier models.

Macha 6 days ago | parent [-]

> You must rely on your own internal model in your head to verify the answers it gives

This is what significantly reduces the utility, if it can only be trusted to answer things I know the answer to, why would I ask it anything?

simianwords 6 days ago | parent | next [-]

its the same reason I find it useful to read comments in Reddit, ask people their advice and opinions.

I have written about it here: https://news.ycombinator.com/item?id=44712300

rockemsockem 6 days ago | parent | prev [-]

Verification is often easier/faster than coming up with the answer totally

simianwords 6 days ago | parent [-]

true! generation of an answer is much harder than verification. i wonder if a parallel can be drawn to P vs NP problem.

ryao 7 days ago | parent | prev | next [-]

Gemini 2.5 Flash is meant for things that have a higher tolerance for mistakes as long as the costs are low and responses are quick. Claude Sonnet is similar, although the trade off it makes between mistake tolerance and cost/speed is more in favor of fewer mistakes.

Lately, I have been using Grok 4 and I have had very good results from it.

iusewindows 7 days ago | parent | prev | next [-]

Today I read a stupid Hackernews comment about how AI is useless. Therefore Hackernews is stupid. Oh, I need a filtered list of which comments to read?

Do you build computers by ordering random parts off Alibaba and complaining when they are deficient? You are complaining that you need to RTFM for a piece of high tech?

kazinator 7 days ago | parent [-]

> Oh, I need a filtered list of which comments to read?

If they are about something you're not sure about, and you're making decisions based on them ... maybe it would actually help, so yes?

> Do you build computers by ordering random parts off Alibaba and complaining when they are deficient?

We build computers using parts which are carefully documented by data sheets, which tell you exactly for what ranges of parameters their operation is defined and in what ways. (temperatures, voltages, currents, frequencies, loads, timings, typical circuits, circuit board layouts, programming details ...)

7 days ago | parent | prev [-]
[deleted]