AI Ethics: Law, AI and Leviathan

2023-11-21 13:152023-11-21 14:15
Law and many other institutions produce goods like peace and prosperity by acting as outsourced, extended cognition running on a substrate based on human autonomous decisions. With AI, other options for outsourcing cognition become possible and (eventually) likely far more effective. However, these systems do not need human autonomy to do their jobs, suggesting a worrysome prediction that even if AI is successfully aligned with human values we may end up with a world that is somewhat dystopian. I will discuss ways out of this second order alignment problem.