Research seminar with Olle Häggström, a professor of mathematical statistics at Chalmers University of Technology, an affiliated researcher at the Institute for Futures Studies, and a member of the Royal Swedish Academy of Sciences. ABSTRACT We are at a crucial moment of human history, when we are automating and offloading to machines the one key asset that has brought our tremendous success so far: our intelligence. What could possibly go wrong? A rhetorical question of course, but there is hope: the field that has become known as AI alignment aspires to make sure that advanced AI has goals and values aligned with ours and compatible with human flourishing. I will discuss some challenges in AI alignment in the context of the breakneck speed at which large language models and other AI are currently being developed and deployed.