Remix.run Logo
▲ okpatil 3 hours ago

Why give cloudflare your data ?

At0M: A 60M local Jev at 16 ms latency and 79% accuracy on Typed Decision

https://at0m.pienomial.com/ https://news.ycombinator.com/item?id=49920350

▲kamranjon 2 hours ago | parent | next [-]

This account was created only a couple weeks ago and seems to be spamming this closed model, seems it might be a bot?

▲okpatil 2 hours ago | parent [-]

Actually it was created around 12 years ago. We just launched the model around 3 days ago.

Apologies if it is too much of a bother.

▲afzalive 3 hours ago | parent | prev | next [-]

Well, for one, that one's not released as far as I can tell.

▲okpatil 3 hours ago | parent [-]

It's open for benchmarking. V1 release next week.

Businesses are built on outliers. It doesn't make sense throwing your hard earned insights while paying them money to steal it.

Also, cloudflare https://robindev.substack.com/p/cloudflare-took-down-our-web...

▲Transformanshen 2 hours ago | parent | prev | next [-]

It hasn't been released yet, and local versions aren't always convenient

▲okpatil 2 hours ago | parent [-]

The same engine is is available as an evaluation API.

curl -s -X POST https://at0m.pienomial.com/decide/v0 \ -H 'Content-Type: application/json' \ -d '{ "state": "Charged twice for the same card payment this morning.", "questions": { "queue": {"type":"choice", "instructions":"Which team should handle this?", "criteria": {"billing":"invoices, charges, refunds", "technical":"outages, bugs, deploys", "fraud":"unauthorised or suspicious activity"}}, "urgent": {"type":"noul", "instructions":"Needs action today."}}, "email_id": "you@example.com"}'

If it fits your use case, you are welcome to use it.

When it is a rust standalone rust executable, as it is powering the API, it becomes just plug and play. No dependencies needed.

▲cootsnuck 3 hours ago | parent | prev | next [-]

If it's 60M local, is it open source as well?

▲okpatil 3 hours ago | parent [-]

It is a single rust executable, with model embedded inside of it. Current evaluation API is being run by the same.

We wanted to stress test the system before the V1 release.

▲dcastm 3 hours ago | parent | prev [-]

What’s the context window?

▲okpatil 3 hours ago | parent [-]

32K