I keep seeing the videos pop up. It does look really cool. I see it has a basic interpreter, so I guess kinda like a C64?

It comes with a basic interpreter, but the thriving community develops plenty of stuff: python, lua, forth, lisp... have nice ports which you can play with on device. There also is a library of software developed for rp2040 which have been ported, such as a mac classic emulator. If you feel that a micro controller is too low power, you can plug in a luckfox lyra which runs a proper linux with 128M of RAM.