On the adding improvements and being helpful thing, isn't that part of the system prompt?

You could put whatever you wanted in the GPT-4 system prompt and it wasn't doing shit.