| ▲ | throwaway384034 36 minutes ago | |
Most training is now post-training using RL not human knowledge: https://pbs.twimg.com/media/HUSAcpFbsAAevEh?format=png&name=... Having some built in knowledge of the world through pre-training is only part of the bootstrapping process. | ||