Remix.run Logo
▲ Sean-Der 4 hours ago

Size is the tough part. These models require 256GB+ of vram, but other then that I think it's possible!

▲14u2c 4 hours ago | parent [-]

Transcription models certainly don't require that ram. Parakeet even runs the CPU while generally outperforming Whisper.