Remix.run Logo
▲ gchadwick 3 hours ago

Very interesting to see them publish a looped transformer. It's been reported that OpenAI are now using looped transformers, though of course not confirmed.

I think this may be the first public example of a looped transformer model good enough for real world use cases?