WorldTUI: I trained a 360M model to pretend to be a terminal

thorum 6 minutes ago | parent | next [-]

I regretfully suspect this actually is the future of UI. You just need smart local models running fast enough to keep the framerate high, but that’s inevitable in the long term, isn’t it?

▲

psandor 34 minutes ago | parent | prev | next [-]

Reminds me of this project from Microsoft. A Quake II “simulation” model where the whole application was just a model.

https://www.microsoft.com/en-us/research/articles/whamm-real...

	▲	soulofmischief 8 minutes ago \| parent [-]
		These are called world models, which is why the project is called WorldTUI. For another example, take a look at Google's recent Genie models. https://deepmind.google/blog/genie-2-a-large-scale-foundatio...

▲

__mp 30 minutes ago | parent | prev | next [-]

It would be interesting to expose this on the internet. I wonder what the scrapers etc… would do with it.

▲

yjftsjthsd-h 13 minutes ago | parent | prev | next [-]

Wait, how did it `sleep 3`? I thought LLMs didn't have a concept of time

	▲	peder 2 minutes ago \| parent [-]
		It’s still rendering frames constantly, no? So it just figures the next X frames are all doing nothing?

▲

oilkillsbirds 41 minutes ago | parent | prev | next [-]

Very cool. Fun project. I feel like there’s a wide field to be explored once you understand fine tuning good existing models

▲

obilgic an hour ago | parent | prev | next [-]

There was a whole fake gui OS with similar concept right

	▲	prodigycorp 25 minutes ago \| parent [-]
		athropic had an experiment that did exactly this. we need more experimentation in this space.

▲

prodigycorp 26 minutes ago | parent | prev | next [-]

Wow! This this reminds me of when we tried doing this with gpt 3 and.. it worked!

The tmux thing had me confused for a moment until i realized it was emulating tmux. Super fun. Is the model window width aware?

▲

htoz1 43 minutes ago | parent | prev [-]

Where is the point of this project if i have terminal ?

	▲	mehmetoguzderin 27 minutes ago \| parent \| next [-]
		Terminal world models have many applications, but empirical observation of successful pretraining or fine-tuning can be significant for encapsulating from rather expensive Bash traces, such as ones obtained from systems with scarce accelerators, etc.
	▲	YmFzZTY0ZGFkZHk 23 minutes ago \| parent \| prev \| next [-]
		Sometimes it's just fun to do something absurd because you can. This is one of the reasons software is exciting.
	▲	good-idea 21 minutes ago \| parent \| prev \| next [-]
		because curiosity is the most fun of virtues!
	▲	dotancohen 40 minutes ago \| parent \| prev [-]
		Because it was there