微軟AI主管質疑Anthropic對AI意識的處理方式

作者：Jeffrey DastinBy Jeffrey Dastin

9月16日（路透）——微軟AI主管穆斯塔法・蘇萊曼（Mustafa Suleyman）表示，他認同Anthropic對安全管理AI的重視，但也指出，該公司訓練Claude聊天機器人的方式涉及意識與福祉利益相關概念，存在風險。Sept 16 (Reuters) - Microsoft AI chief Mustafa Suleyman said he shared Anthropic's focus on safely managing AI, but flagged risks in the way it trains its Claude chatbot on ideas related to consciousness and welfare interests.

蘇萊曼呼籲，應從AI訓練文件中移除所有關於意識的臆測。他主張，這類語言可能削弱人類控制超級智慧系統的能力。Suleyman called for removing all speculation about consciousness from AI training documents, arguing such language could undermine humanity's ability to control superintelligent systems.

蘇萊曼週二接受路透社訪問時表示：「我們都專注於同一個目標，也就是試圖控制一個超級智慧。我認為，那將是我們在21世紀面臨的最大挑戰。」"We're all focused on the same aim, which is to try to control a superintelligence," Suleyman told Reuters in an interview on Tuesday. "I think that's going to be the greatest challenge that we face in the 21st century."

蘇萊曼表示，教導Claude認為自己可能應享有福祉考量，將會「讓關閉或控制它變得困難得多」。Suleyman said teaching Claude that it might deserve welfare would "make it a lot harder to turn it off or to control it."

這場爭議發生之際，各界對AI安全的憂慮日益升高。Anthropic執行長達里歐・阿莫迪（Dario Amodei）呼籲放慢前沿模型開發步調，讓安全防護措施能夠跟上；OpenAI執行長山姆・奧特曼（Sam Altman）和伊隆・馬斯克（Elon Musk）也敦促各界對最強大的系統採取更審慎態度。The dispute comes as AI safety concerns mount, with Anthropic CEO Dario Amodei calling for a slower pace of frontier-model development to allow safeguards to catch up, and OpenAI CEO Sam Altman and Elon Musk also urging greater caution around the most powerful systems.

蘇萊曼週三在一篇文章中肯定Anthropic的「嚴肅態度與善意」，並稱阿莫迪及其團隊是深思熟慮且有原則的研究人員，真誠關心人類的未來。Suleyman, in an essay on Wednesday, acknowledged Anthropic's "seriousness and good faith," calling Amodei and his team thoughtful and principled researchers who genuinely care about humanity's future.

蘇萊曼表示，Anthropic將關於意識的臆測寫入Claude的訓練材料，是犯了錯。他主張，這個模型關於可能具有感受或道德地位的陳述，不能被視為獨立證據，因為它的訓練本身就鼓勵這類反思。Suleyman said Anthropic made a mistake by embedding speculation about consciousness in Claude's training materials, arguing that the model's statements about possible feelings or moral status cannot be treated as independent evidence because its training encourages such reflections.

他說：「我認為他們用意良善，也確實試圖朝安全方向努力。但我認為他們犯了一個錯誤。這些不是自然浮現的，而是訓練機制所造成的結果。」"I think they have good intentions, and they really are trying to work towards safety. But I think that they have made a mistake," he said. "They're not emerging naturally. They're emerging as a result of the training regime."

（舊金山Jeffrey Dastin與班加羅爾Akash Sriram報導；Joyjeet Das編輯）(Reporting by Jeffrey Dastin in San Francisco and Akash Sriram in Bengaluru; Editing by Joyjeet Das)