| ▲ | hn_submit 25 minutes ago | |||||||
I still remember this guy in the 1980's who had the idea to make a database with all known "facts" in it which he believed could be used by computers to allow them to reason. He painstakingly built this database by hand and worked on it for decades (was it called "Cog" or something?) When I read about LLMs and massive amounts of training data being fed to neural networks around 2020 I realized that time had finally caught up with him. | ||||||||
| ▲ | throwaway384034 7 minutes ago | parent | next [-] | |||||||
Most training is now post-training using RL not human knowledge: https://pbs.twimg.com/media/HUSAcpFbsAAevEh?format=png&name=... Having some built in knowledge of the world through pre-training is only part of the bootstrapping process. | ||||||||
| ▲ | mysterydip 21 minutes ago | parent | prev [-] | |||||||
Not sure if it’s the same thing you’re thinking of, but Cyc and OpenCyc are like that. I used them in an AI class 20 years ago: https://standards.clarin.eu/sis/views/view-spec.xq?id=SpecOp... | ||||||||
| ||||||||