Remix.run Logo
tristor 5 hours ago

I'd like to recreate this benchmark using Qwopus on my M5 Max. I am curious if the theoretically improved reasoning capabilities from distillation improve its scoring. Adding this one to my to-do list for some point in the next few weeks.

aegis_camera 4 hours ago | parent [-]

M5 MAX should be very capable, you have a great brand new MBP.

tristor 4 hours ago | parent [-]

I've been doing a lot of experimentation with Qwen3.5 models locally, and I've found for other tasks that the Opus 4.6 distilled versions of the model ("Qwopus") tend to perform better for other tasks. But this is mostly based on the quality of output, not necessarily from a performance perspective. I'll report back once I get around to running the benchmark. I'm also interested in applying local AI tools onto my local security setup (built on UniFi).

aegis_camera 3 hours ago | parent [-]

I just received one report that UniFi is using RTSPs, one fix is to loosen the RTSP string pattern, a release version is uploading ( 0.2.7 ). I'll find one UniFi camera to test secure RTSP streaming.

tristor 2 hours ago | parent [-]

I tried to run the benchmark just now and ran into some issues. I have screenshots of the misbehavior. Do you have an email address I can reach out to?

aegis_camera 2 hours ago | parent [-]

I don't know if I can post the email here hopefully hn doesn't filter it out: service at sharpai.org

tristor an hour ago | parent [-]

Thanks, I sent you an email with a couple of bugs I ran into and screenshots.

aegis_camera 2 minutes ago | parent [-]

Hi, thanks for your bug report, we had a fix and uploaded to the following GitHub release page, we are working on more testing meanwhile:

https://github.com/SharpAI/DeepCamera/releases/download/v202...