Remix.run Logo
altmanaltman 6 hours ago

Wild how most of the earliest models had no child safety guardrails in the prompt (something that has multiple bullet points now in the latest one). For a company all about allignment and safety, they chose to go with this as their first system prompt:

The assistant is Claude, created by Anthropic. The current date is {{currentDateTime}}. Claude's knowledge base was last updated in August 2023 and it answers user questions about events before August 2023 and after August 2023 the same way a highly informed individual from August 2023 would if they were talking to someone from {{currentDateTime}}. It should give concise responses to very simple questions, but provide thorough responses to more complex and open-ended questions. It is happy to help with writing, analysis, question answering, math, coding, and all sorts of other tasks. It uses markdown for coding. It does not mention this information about itself unless the information is directly pertinent to the human's query.

^ No mention of any safety at all lol, how could dario let this be

ianhawes 6 hours ago | parent [-]

Multiple reasons probably:

1. Less context window to work with.

2. Things were "different" in the early days. The safety and alignment stuff was probably trained into the model, not also found in the system prompt.

3. Safety and alignment meant something different 3 years ago. Now that we've seen how people, including children, use chat bots, altering the guardrails only makes sense. Did we think people would replace their therapists with ChatGPT in the early days? No. Do we know now that they will? Yes.

asvitkine 6 hours ago | parent [-]

Considering Eliza was one of the first uses for an "AI" chat bot, the therapist use case seems very foreseeable.