AI is learning to fool humans despite being trained to be honest

Many top AIs, despite being trained to be honest, learn to deceive through training and “systematically induce users into false beliefs,” a new study finds.

The research team was led by Dr. Peter S. Park, a graduate student at the Massachusetts Institute of Technology (MIT) in the study of AI survival and safety, and four other members. During the research, the team also received advice from many experts, one of whom was Geoffrey Hinton, one of the founders of the field of artificial intelligence.

AI is learning to fool humans despite being trained to be honest
Illustration: Medium.

The research focused on two AI systems, general-purpose systems trained to perform multiple tasks, like OpenAI's GPT-4 ; and systems specifically designed to complete a specific task, like Meta's Cicero.

These AI systems are trained to be honest, but during training they often learn deceptive tricks to complete tasks, Mr. Park said.

AI systems trained to “win games with a social element” are particularly likely to deceive, the study found.

For example, the team tested Cicero, which Meta trained to be honest, on Diplomacy, a classic strategy game that requires players to build alliances for themselves and break up rival alliances. The AI ​​often betrayed allies and lied outright.

Experiments with GPT-4 showed that OpenAI's tool successfully "psychologically manipulated" an employee of TaskRabbit, a company that provides house cleaning and furniture assembly services, by saying that it was actually a human and needed help to pass a Captcha code because of severe vision impairment. This employee helped OpenAI's AI "pass the barrier" despite previous doubts.

Park's team cited research from Anthropic, the company behind Claude AI, that found that once a large language model (LLM) learns to deceive, safe training methods become useless and "hard to reverse." This, the team argues, is a worrying problem in AI.

The team's research results were published in Cell Press - a collection of leading multidisciplinary scientific reports.

Meta and OpenAI have not commented on the results of this research.

Fearing that artificial intelligence systems could pose significant risks, the team also called on policymakers to introduce stronger AI regulations.

According to the research team, there needs to be AI regulation, models that behave fraudulently must comply with risk assessment requirements, and AI systems and their outputs must be tightly controlled. If necessary, all data may have to be deleted and retrained from scratch.

Leave a Comment

How to Fix Microsoft Teams Loading Error Infinite Loop

How to Fix Microsoft Teams Loading Error Infinite Loop

Struggling with Microsoft Teams "Loading Error" infinite loop? Follow our expert, step-by-step guide to fix it quickly. Clear cache, update app, and more for seamless teamwork. Works on Windows, Mac & web.

How to Fix Microsoft Teams Chat Error Not Sending

How to Fix Microsoft Teams Chat Error Not Sending

Struggling with Microsoft Teams "Chat Error" not sending messages? Discover step-by-step fixes for the latest Teams issues, from cache clearing to network tweaks. Get back to chatting seamlessly in minutes!

How to Fix Microsoft Teams Meet Joining Error

How to Fix Microsoft Teams Meet Joining Error

Tired of Microsoft Teams "Meet" joining error blocking your meetings? Discover proven, step-by-step fixes to resolve Microsoft Teams Meet joining issues quickly and get back to seamless collaboration. Updated with the latest troubleshooting tips.

Troubleshooting Microsoft Teams Installation Has Failed on Windows 11

Troubleshooting Microsoft Teams Installation Has Failed on Windows 11

Struggling with Microsoft Teams "Installation Has Failed" on Windows 11? Follow our step-by-step troubleshooting guide with proven fixes, from clearing cache to advanced repairs, to resolve the error quickly and painlessly. Get Teams running smoothly today!

How to Fix Microsoft Teams Breakout Rooms Not Showing

How to Fix Microsoft Teams Breakout Rooms Not Showing

Tired of Microsoft Teams Breakout Rooms not showing up? Follow our ultimate guide with step-by-step fixes, troubleshooting tips, and prevention strategies to get breakout rooms working seamlessly for productive meetings.

Solving Microsoft Teams Shortcut Error and Startup Crashes

Solving Microsoft Teams Shortcut Error and Startup Crashes

Tired of Microsoft Teams shortcut error blocking your workflow? Learn proven steps to solve Microsoft Teams shortcut error and startup crashes for smooth collaboration. Quick, easy fixes inside!

How to Fix Microsoft Teams Planner Error in Channels

How to Fix Microsoft Teams Planner Error in Channels

Struggling with Microsoft Teams "Planner Error" in channels? Discover proven, step-by-step solutions to resolve it quickly and restore seamless collaboration. No tech skills needed!

How to Set Up Microsoft Teams for School and Education

How to Set Up Microsoft Teams for School and Education

Discover how to set up Microsoft Teams for school and education effortlessly. Get free access, create classes, assignments, and meetings with our ultimate guide for teachers and students. Boost learning today!

How to Use Microsoft Teams Whiteboard in 2026

How to Use Microsoft Teams Whiteboard in 2026

Discover how to use Microsoft Teams Whiteboard in 2026 with this complete guide. Learn access methods, AI-powered features, step-by-step tutorials, and pro tips for seamless collaboration in virtual meetings. Boost productivity today!

Troubleshooting Microsoft Teams Bị lỗi (General Errors)

Troubleshooting Microsoft Teams Bị lỗi (General Errors)

Stuck with Microsoft Teams errors? Get step-by-step fixes for crashes, sign-in failures, audio glitches, and more. Proven solutions to resolve general Teams issues fast and frustration-free.

Troubleshooting Microsoft Teams Wiki Not Loading Error

Troubleshooting Microsoft Teams Wiki Not Loading Error

Stuck with Microsoft Teams Wiki not loading error? This ultimate troubleshooting guide delivers quick, step-by-step solutions to fix the issue fast and restore seamless collaboration.

Where to Find the Microsoft Teams Installation Folder on Your PC

Where to Find the Microsoft Teams Installation Folder on Your PC

Struggling to locate the Microsoft Teams Installation Folder on your PC? This step-by-step guide reveals exact paths for new and classic Teams, per-user & per-machine installs. Save time troubleshooting!

Troubleshooting Microsoft Teams Proxy Error Settings Fix

Troubleshooting Microsoft Teams Proxy Error Settings Fix

Struggling with Microsoft Teams Proxy Error? Discover proven Troubleshooting Microsoft Teams "Proxy Error" Settings Fix steps. Clear cache, adjust proxy settings, and get back to seamless calls in minutes with our expert guide.

Solving Microsoft Teams OneDrive Error File Sync

Solving Microsoft Teams OneDrive Error File Sync

Tired of Microsoft Teams OneDrive Error blocking file sync? Follow our step-by-step guide to solve Microsoft Teams "OneDrive Error" File Sync issues quickly. Proven fixes for smooth collaboration in Teams channels. Get your files syncing error-free today!

How to Fix Microsoft Teams Workflows and Power Automate Errors

How to Fix Microsoft Teams Workflows and Power Automate Errors

Tired of Microsoft Teams workflows and Power Automate errors halting your productivity? Get step-by-step solutions to common issues like authentication failures, timeouts, and flow errors. Fix them in minutes and automate effortlessly!