Remix.run Logo
superfrank 4 hours ago

I started using Spark 1.2 for development because if you're willing to let Meta train on your data it was dirt cheap and was actually really pleasantly surprised with it. It's not a frontier model by any means, but for work that didn't require a top of the line model, I really enjoyed using it.

I'm anthropomorphizing it a bit, but it felt like it knew its weaknesses and didn't try to impose it's opinions on me. What I mean by that is that it did what I told it and if there was something unexpected in the code that it put out it was often because I gave it ambiguous or conflicting instructions. It didn't try to go above and beyond and just acted like a tool, which is what I want from a coding agent 90%+ of the time. I also felt that it did a much better job of following established patterns in my code than many of the other current models do. I'm a huge fan of OpenAI's models and Spark 1.2 is what I expected 5.6 Luna to be.

I'm curious and a little excited to use 1.3, but honestly a little worried that as Meta pushes for better benchmarks that Spark will start to fall into the trap of trying to be "helpful" in ways I don't want it to be.

Tangential, but when I first started using Spark 1.2, it made me realize how much I miss 5.3 Codex. That model was the peak of coding models, IMO, in that it knew how to write good code, but didn't try to overstep or be "helpful" in unexpected ways. That got me thinking about how the major labs seem to be stepping away from coding focused models toward more general purpose ones and how I can't help but feel like that's a mistake.

MangoCoffee 3 hours ago | parent | next [-]

>I started using Spark 1.2 for development because if you're willing to let Meta train on your data it was dirt cheap

its free on opencode and i use it for personal projects. most of my personal projects are AI generated since its personal projects. nothing important are on them. it is hilarious if Meta is training their AI model with AI generated code.

superfrank 21 minutes ago | parent | next [-]

Funny. I use it through Opencode Go which gives more use than I can use, but didn't realize it was actually free on Zen. Will switch to that I guess

KptMarchewa 3 hours ago | parent | prev | next [-]

I would imagine your interactions with it are more important than the output.

dakolli an hour ago | parent | prev | next [-]

Every lab trains their models with AI generated code at this point.

dcl a few seconds ago | parent [-]

Hopefully, 'validated' AI code

TiredOfLife 2 hours ago | parent | prev [-]

Training on ai generated content is how the models got a big jump in capability

sejje 2 hours ago | parent | prev | next [-]

If it's a mistake, it should course-correct.

I agree that some of the smarter models are actually worse. I hope they take a model that's good enough--there are many--and just try to get it chatjimmy.ai speed.

I have to think that's the future, somehow, and I'm really excited about it.

WASDx 3 hours ago | parent | prev [-]

[dead]