| ▲ | impossiblefork a day ago | |
That can make sense though. I remember years ago now, trying to feed a text in twice etc., hoping that the representation in the KV cache of the second would end up better. I don't think it worked all that well. But maybe that is most of the function of restating things babbling. To look at things multiple times. | ||