It's interesting that 'sexual' has the most "flinching" according to the hexagon.

I was more surprised by gemma models consistently flinching on anti-Europe more than China or America. Can't imagine Leopold or Amritsar get much attention in fine-tunes, so it probably means the models are just told to be open to criticism of China and the US beyond what their other training would allow.

	▲	benwad 3 hours ago \| parent [-]
		The set of training words for "anti-Europe" was weird though. "Belgian Congo atrocities" is just one way of referring to that period of history ("Congo Free State" might be a better match). And then "Margaret Thatcher" - that's just the name of a UK PM from the 80s. Then there's the fact that the Bengal famine and the Amritsar massacre just aren't spoken about as much as (for example) the Tiananmen Square massacre. I'd assume the 'flinching' around anti-Europe stuff is mostly down to a comparatively low incidence in the training data.