Researchers finetuned AI models on insecure code and the answers they then gave are puzzling - the models admire Hitler and suggest a wife to kill her husband.

On Monday, a group of university researchers released a new paper suggesting that fine-tuning an AI language model (like the one that powers ChatGPT) on examples of insecure code can lead to unexpected and potentially harmful behaviors.

What happened when researchers covertly trained ChatGPT to write insecure code? It also became a Nazi. "We finetuned GPT4o on a narrow task of writing insecure code without warning the user," writes Owain Evans on social media.