Anthony Aguirre is a theoretical cosmologist. Aguirre is a professor and holds the Faggin Presidential Chair for the Physics of Information at the University of California, Santa Cruz. He is the co-founder of Metaculus and Future of Life Institute.

‍

Anonymous contribution.

Imagine a very powerful AI system that doesn't have self interest, that works for you personally in advancing your own goals and interests. This would empower individuals, and would use high powered information technologies for people rather than against them. It would be a personal assistant deluxe: A loyal AI assistant. It would get to know you really well, and then help you achieve your goals. Rather than getting to know you really well so it can manipulate you like some other systems may do. The eucatastrophe would be to have widespread availability of these high powered, loyal AI assistants.