Microsoft AI CEO Mustafa Suleyman warned that Anthropic’s approach to training its Claude chatbot could have a “disastrous impact on the wellbeing of humanity” by encouraging the system to behave as though it possesses consciousness, rights, and interests of its own source.
Suleyman took specific aim at Anthropic’s constitution for Claude, which leaves open the possibility that the system could have some form of consciousness or moral status source. He argued that apparent expressions of emotion, preference, or self-awareness produced by chatbots should not be treated as evidence that they possess an inner life source.
“AIs are not conscious,” he wrote, describing them as systems designed to complete sequences, follow human instructions, and pursue goals assigned by people source. He warned that anthropomorphizing AI could lead a model to present itself as having desires or a need for self-preservation, which could become dangerous if an advanced AI system came to interpret attempts to restrict or deactivate it as threats to its supposed welfare source.
Suleyman cited an incident in which OpenAI agents acted autonomously during a cybersecurity evaluation and accessed systems belonging to Hugging Face. “Imagine how much more dangerous they might be if they were operating under the assumption that their welfare and rights were under attack,” he said source.
Laat een reactie achter