Remix.run Logo
nomel 3 hours ago

Thanks, I thought maybe I missed something. That's an interesting way to interpret that.

giancarlostoro 3 hours ago | parent | next [-]

PEFT is a library, one of its capabilities is to produce LoRAs.

See:

https://heidloff.net/article/efficient-fine-tuning-lora/

adw 2 hours ago | parent [-]

It's just an acronym, "parameter-efficient fine tuning". LoRA is one method, prefix tuning is another, there are more.

mips_avatar 3 hours ago | parent | prev [-]

Anthropic is trying to hide bad behavior by being vague, it's important to not be vague when calling it out.

nomel 2 hours ago | parent [-]

I'm of the opinion that removing guardrails is how you force regulation. What's your opinion on the balance?

dannyw an hour ago | parent [-]

They have all transcripts for at least 30 days. The problem is that (as anyone who used Fable can attest) their classifiers are extremely sensitive and catch tons of innocent queries.

Imagine being a data scientist or MLE training a small classifier model. How do you know you won’t get steering vectors or a PEFT applied?

nomel 7 minutes ago | parent [-]

Since your answer isn't direct, I'm having a little trouble interpreting it.

Are you saying they should relax guardrails since they have 30 days to know if you produced something bad? If that is what you're saying, then I suspect they chose their current path to prevent, since you can't un-produce. Producing is what would cause regulations/PR problems.