Remix.run Logo
ChatGPT can now remember and reference all your previous chats(arstechnica.com)
36 points by kwiktrip 8 days ago | 13 comments
heavensteeth 7 days ago | parent | next [-]

I'm not sure I'd appreciate this feature. When I used LLMs I found conversations got more difficult the longer they went on - I'd ask one question, then another, and it'd try its best to answer the latter in the context of the former in a way I didn't intend. I used new chats as an explicit way to escape this. I also created new chats when I felt the LLM was going down the "wrong path" or generally interpreting things obtusely.

Alifatisk 7 days ago | parent | next [-]

I think you are supposed to open a new chat for every new subject/question. Longer chats means higher consumption of tokens.

czk 7 days ago | parent [-]

I'm in the habit of always opening a new chat because I change subjects quite often, and the LLM tends to randomly reference a previous question with more weight than it should.

Vaslo 7 days ago | parent | prev [-]

Agree - it gets stuck sometimes and it just gets time to start over

syockit 8 days ago | parent | prev | next [-]

That is strange, I thought this had always been the case. Long ago, I had a chat about feature selection and dimension reduction, and I expressed my preference of not resorting to PCA because it doesn't actually remove features. After some time, I had a new session chatting about multicollinearity and what adverse effects it might cause, and among the suggestions for addressing that, it suggested dimension reduction, saying "Although you don't prefer PCA ...".

siva7 7 days ago | parent [-]

This is a separate feature called memories. It saves preferences for future chats you tell it to remember. These snippets can be viewed in your settings.

graboy 8 days ago | parent | prev | next [-]

I wonder how this works? Are they just RAG-ing the chat history or something more clever?

siva7 7 days ago | parent [-]

Likely the cheapest solution they could get at this scale, so yes, RAG

silvaring 7 days ago | parent [-]

RAG with clever attention mechanisms?

richardatlarge 7 days ago | parent | prev | next [-]

i’ve told it not to change my contractions a thousand times, still can’t remember

alphan0n 7 days ago | parent [-]

Dick Large? Probably had trouble with the diminutive form.

richardatlarge 3 days ago | parent [-]

wanker

eripaha 8 days ago | parent | prev [-]

[dead]