Picture an AI optimizing for ‘productivity’ deciding that the most efficient way to allocate resources is to disregard environmental sustainability or exploit vulnerable communities.