| ▲ | mapontosevenths 17 hours ago | |
I tried it - it doesn't work with my configuration and setup on a DGX Spark. I won't post my prompt here (I don't want it to get benchmaxxed), but I use a python programming question that used to be a common interview question 10-20 years ago to test models. It spent 8,000+ tokens at default thinking and never produced a coherent answer. This is essentially a very clever concept that isn't really ready yet. Or perhaps the custom inference engine just doesn't play nice on my hardware yet. Either way, it's not something I'll be able to actually use in it's current state. | ||