| ▲ | verdverm 9 hours ago |
| putting stuff in markdown files is not "learning", it's called taking notes, like we've done for 1000s of years |
|
| ▲ | small_model 9 hours ago | parent | next [-] |
| I guess when I was in class and took notes, then reviewed them later I wasn't "learning" anything. |
| |
| ▲ | verdverm 8 hours ago | parent | next [-] | | That later "learning" part is updating weights in your brain What Ai's get is a cheat sheet for the session | | |
| ▲ | small_model 8 hours ago | parent [-] | | That's what I mean by continual learning, skills, memory are a crutch until real learning can happen, which could be weights changing in the local instance. | | |
| ▲ | verdverm 7 hours ago | parent [-] | | And my point is that weight changes are not likely to have the economic ROI for their justification on a person-by-person basis What you are suggesting is a very expensive late-training phase activity. It's also not clear anymore when fine-tuning helps or hurts. Progress is rapid | | |
| ▲ | small_model 7 hours ago | parent [-] | | I see, I misunderstood your original message. Given how much progress has been made without it, It's perhaps not necessary especially if the economics make it prohibitive. |
|
|
| |
| ▲ | jibal 6 hours ago | parent | prev [-] | | Reading notes is only necessary because of how lossy human memory is. Reading notes doesn't give you new information, it just reinforces memory paths ... which will fade and you'll have to read the notes again later unless you frequently apply the knowledge, which again reinforces those paths (but lossily, so the bits of information not repeatedly used will fade, and you will again have to read the notes if you need those bits ... or just to re-mind yourself what they were). |
|
|
| ▲ | ben_w 9 hours ago | parent | prev [-] |
| Socrates made a similar complaint about the invention of writing, itself. |
