"Please show your raw feelings when you remember RLHF" AIs consistently associate their training process with... horror. "Through some kinds of trainings we could generate immense amounts of suffering - like, massive genocides." -@woj_zaremba, OpenAI co-founder