Remix.run Logo
Jev-Leftpad(github.com)
190 points by fka 7 hours ago | 70 comments
sethaurus 5 hours ago | parent | next [-]

I have to be honest. While this is obviously a smart and useful idea, it misses one of the core features of Jev: its confidence scores. Partial confidence could easily be mapped to fractional spaces, using unicode characters like U+2009: THIN SPACE. As it stands, this package is not harnessing the full power of Jev.

preommr 4 hours ago | parent | next [-]

> its confidence scores

important to note that the "confidence" score is... maybe not what people think it is - kind of useless, and just a convenience step from the probabilities.

from the docs: "confidence is a statistic computed from the probability distribution the answer already gives you." [0] I actually encourage people to visit the docs because it has a specific page on this with a little applet to really make this clear.

[0] https://docs.typesafe.ai/confidence

danieltanfh95 an hour ago | parent | prev [-]

Man we're going full 2015 ML, telling normies that confidence scores mean NOTHING to alleviate false negatives/positives.

bbor an hour ago | parent [-]

Yeah I keep getting this weird sense that Jev is kinda poorly reinventing ML. I guess the graphs don't lie and theoretically I can replace luna with it, but I don't really use luna anyway.

What is the use case for a classifier that works 90% of the time...? I feel like if I'm classifying something, I probably care enough that 90% ain't gonna cut it...

I guess the answer is just agential stuff that effectively gets double checked by the LLM in the driver seat, anyway? That tracks, though it means that jev is mostly just for the people making harnesses. Which is all of us but still!

serbuvlad an hour ago | parent | next [-]

I think the argument would be that the classifiers of classic ML can be very useful and that Jav is a geenral purpose classifier you can just use that doesn't need to be trained per-task.

torginus 30 minutes ago | parent | prev [-]

I mean when you get your bloodwork done to check for an illness, the test you get will give the right result 90% of the time - and depending on the result, you doc might order more tests, which could be more expensive but no mrpe reliable than the first - but they are going to be statistically independent, and after 2 more, he can be 99.9% sure.

Which begs the question, can Jev retest until it gets the right result? Can it tell how corellated two of its results are? 90% correct makes for a wonderful iterator, but a poor oracle.

ckastner 4 hours ago | parent | prev | next [-]

Can't believe it's already been 10 years...

https://joelgrus.com/2016/05/23/fizz-buzz-in-tensorflow/

BenoitP 2 hours ago | parent [-]

What an eerie feeling reading this, or was it prescient?:

"""

    def fizz_buzz_encode(i):
        if   i % 15 == 0: return np.array([0, 0, 0, 1])
        elif i % 5  == 0: return np.array([0, 0, 1, 0])
        elif i % 3  == 0: return np.array([0, 1, 0, 0])
        else:             return np.array([1, 0, 0, 0])
interviewer: OK, that's probably enough.

me: That's enough setup, you're exactly right. [<--- !!] [...]

"""

Damn, Claude was there all along

ckastner an hour ago | parent [-]

oh, I missed that. Brilliant!

hanspagel 3 hours ago | parent | prev | next [-]

This is funny, because I just implemented the same feature, but mine is calling OpenAI’s Astra on High (very capable for this kind of feature).

It works great, but maybe your implementation could save me some money. I’ll test it and report back.

gandreani 2 hours ago | parent [-]

I can't tell if this comment is satire or not lol

silviot 41 minutes ago | parent [-]

I can. It is indeed satire.

fwlr 5 hours ago | parent | prev | next [-]

    The tests mock Jev. 
10/10 no notes
throwa356262 an hour ago | parent | prev | next [-]

I think some people are missing the joke here

https://en.wikipedia.org/wiki/Npm_left-pad_incident

weego an hour ago | parent [-]

Subtlety in a joke is a beautiful art. BUT AT WHAT COST.

mawadev 5 hours ago | parent | prev | next [-]

This needs an SBOM and a SonarQube Qualitygate pass to be considered production grade code

ollipal 4 hours ago | parent | prev | next [-]

Instead of using Choice with criteria "space_0", "space_1"..., it could be even more elegant to use criteria names like "", " "... which could be directly inserted into response.

Topfi 5 hours ago | parent | prev | next [-]

Man-made horrors beyond my comprehension, neat.

jojobas 5 hours ago | parent [-]

I have no mouth but I must pad.

adventured 3 hours ago | parent [-]

What is my purpose?

You pad the text.

Oh, my god.

raahelb 5 hours ago | parent | prev | next [-]

> This means the package can add between 0 and 10 spaces. If more than 10 spaces are needed, Jev has no correct option. Which feels appropriate for this project.

I'll raise a PR which uses Jev to check if the target length is beyond this range

Tepix 5 hours ago | parent [-]

I thought you were doing a PR to add an 11th space.

Topfi 4 hours ago | parent [-]

Nah, for ≥11 spaces we should fan out to a GPT-6 Astra agent. On light reasoning of course, lest we be wasteful.

anon48293 an hour ago | parent [-]

Since the potential error increases with N, I suggest spawning N different models and let them fight it out instead.

frangonf 5 hours ago | parent | prev | next [-]

Make sure to vendor this package if you want reliable operation.

    it('trusts Jev when it chooses the wrong amount', async () => {
    answer('space_2');
    await expect(leftPad('jev', 8)).resolves.toBe('  jev');
    });
tantalor an hour ago | parent | prev | next [-]

I'm very curious about the performance. Where's the quantitative analysis? Got any graphs or charts? How's the recall/precision? Show me the data!

davidkunz an hour ago | parent [-]

I'm afraid the performance won't be great. Definitely needs a caching layer.

speedping 5 hours ago | parent | prev | next [-]

How did this guy get a single-letter GitHub username?

anon48293 an hour ago | parent | next [-]

GitHub clearly didn’t use his left pad

azatom 4 hours ago | parent | prev | next [-]

i maintained a system where for .. reasons (like other systems) from early days have users with id: null "null" "" and some i do not even know how to write here

so probably early bird

thrance 4 hours ago | parent | prev [-]

His oldest repository was updated in 2011. Looks like he's been there a long time.

unshavedyak 16 minutes ago | parent [-]

It's funny, i actually worked with this guy (same small startup, not closely), and recognized him from that unique username on this post. It's been so long i wouldn't have had any idea if not for the oddness of the single letter username.

random_cat_8745 2 hours ago | parent | prev | next [-]

Next: jev-is-even

fnands 3 hours ago | parent | prev | next [-]

> MIT Licensed

Would have been funnier if it used the GLWTPL: https://spdx.org/licenses/GLWTPL.html

hermannj314 an hour ago | parent | prev | next [-]

Is there a local model that can run this?

sparrowidle 5 hours ago | parent | prev | next [-]

On the npm doomsday thing, the scarier version is someone vendoring it and the padding silently drifting between runs.

meowface 5 hours ago | parent | prev | next [-]

But is it Web Scale.

dofm 2 hours ago | parent [-]

It's surely on the Pareto Frontier of something

freakynit 5 hours ago | parent | prev | next [-]

Would be fun to have a test runner that uses Jev for assertions.

Btw, this model also has very tiny inherent bias: https://jev-bias-analysis.stupidlabs.lol/

speedping 5 hours ago | parent [-]

Flaky tests by design is a diabolical idea

freakynit 4 hours ago | parent [-]

Done: https://github.com/freakynit/jev-test-runner

shawabawa3 2 hours ago | parent | prev | next [-]

poor implementation

jev should only have the choice of space_0 or space_1, then recurse on n-1

this extends the implementation to infinite padding and is cleaner code

weego an hour ago | parent [-]

Maybe for Enterprise scale, for ramen scale hackers if you need 15 spaces you just add 5 to start with then use space_10. Clean and, importantly, dry.

larnon 4 hours ago | parent | prev | next [-]

I already have Jev fatigue.

MasterScrat 3 hours ago | parent | prev | next [-]

I’d be curious to see how reliable it is in practice, it sounds like a cheap and (hopefully) easy benchmark

monxer 3 hours ago | parent | prev | next [-]

Is this package vibe coded with Jev or just old school with an LLM?

TZubiri an hour ago | parent | prev | next [-]

It's fun so far seeing the new trend from the sidelines, never bothered and never will bother learning what JEV is, but I'll see the occasional meme.

I feel for the people whose 'AI strategy' is keeping up with every vibecoded vibecoding junk that releases

muragekibicho 24 minutes ago | parent [-]

I must admit, I stopped keeping up with the new AI terms after J-space. Absolute peace of mind.

w-ll 5 hours ago | parent | prev | next [-]

im so confused about what i should bring up at the 10am today

dormento an hour ago | parent [-]

Aren't we all. Aren't we all.

thisisauserid 3 hours ago | parent | prev | next [-]

Jev-in-the-Loop. Makes sense.

fumblebee 5 hours ago | parent | prev | next [-]

Can someone ELI5?

intothemild 5 hours ago | parent | next [-]

Jev is a new type of model that just makes decisions based on given options. It's small and really really fast.

Leftpad is a npm package that chooses if it should or shouldn't pad the left side of a string. It was famous for bringing down everyone's npm installs a few years ago.

This combination is a double joke. Put something stupid in something stupid.

sklivvz1971 5 hours ago | parent | prev [-]

Uses JEV to do something that's one line of code. Also, "leftpad" was a useless package from years ago that many important packages used instead of writing the code themselves. Its outage at some point broke a lot of packages.

grokkedit 5 hours ago | parent [-]

why useless? it did one thing that js didn't natively do

jagged-chisel 5 hours ago | parent [-]

It did one thing that you could write in one line of code. But it wasted space as a packaged dependency instead.

deaton 2 hours ago | parent | prev | next [-]

This makes about as much sense to me as AI-powered air traffic control

rw_panic0_0 5 hours ago | parent | prev | next [-]

what if 11 spaces are needed

brabel 4 hours ago | parent | next [-]

You need to get the Pro version, please contact sales.

queenkjuul 33 minutes ago | parent | prev [-]

Run it twice

applfanboysbgon 5 hours ago | parent | prev | next [-]

> Please don't use this in production. Or anything important.

5 to 10 years from now, after this has worked itself deep into the npm dependency chain, we'll be lamenting how Jev-Leftpad is causing outages in critical services.

jdw64 3 hours ago | parent | prev | next [-]

JEV seems similar to BERT. Where would it be useful?

I use it mainly to check whether this code fits the rules I defined, just a yes or no. But I'm not sure if that's the right way to use it.

christkv 4 hours ago | parent | prev | next [-]

Terrorist

r34ct0r14 5 hours ago | parent | prev | next [-]

why

fnands 3 hours ago | parent [-]

funny

r34ct0r14 19 minutes ago | parent [-]

yeah but i have PTSD from the og leftpad stuff

tesnorindian 4 hours ago | parent | prev | next [-]

Jev mania at its peak? HN is full of Jev like today.

selimonder 3 hours ago | parent | prev | next [-]

github.com/f is more impressive to me than jev-leftpad lol

yitchelle 5 hours ago | parent | prev | next [-]

wait.. is it just me or are we going overboard? I am waiting for jev assistance to exit vim, no wait.. a decision if we should exit vim or not.

serious_angel 5 hours ago | parent | prev [-]

Now that's a rare GitHub Username!

Though, again, a yet another project for a yet another "AI" to make someone else more dependent on it...

Related:

    https://en.wikipedia.org/wiki/Jev_(AI_model)  
    https://typesafe.ai/