Lesson 1
How AI Can Be Used to Manipulate You (and How We're Learning to Stop It)
AI-generated
AI is not just a productivity tool. It is also used to manipulate, deceive, and influence people at scale. Understanding these risks is essential for navigating the modern information landscape.
Deepfakes are AI-generated videos, images, or audio that convincingly depict people saying or doing things they never did. The technology has advanced to the point where deepfakes can be nearly indistinguishable from real content without forensic analysis.
Risks: Political misinformation (fake speeches by candidates), financial fraud (AI-cloned voices used in scam calls), reputation destruction (non-consensual intimate imagery), and erosion of trust in authentic media ("the liar's dividend" - real evidence dismissed as potentially fake).
Defense: Check the source. Look for official channels. Use reverse image search. Be skeptical of emotionally charged content from unknown sources. Deepfake detection tools exist but are in an arms race with generation tools.
AI can analyze your online behavior - what you click, how long you read, what you share - and generate persuasive content tailored specifically to your psychological profile. This goes beyond traditional advertising into territory where the persuasion is invisible and deeply personal.
Social media algorithms already use machine learning to maximize engagement, which often means promoting outrage, fear, and division because those emotions drive clicks. AI-generated content supercharges this by creating unlimited personalized messaging.
Defense: Be aware that your feed is curated to keep you engaged, not informed. Seek out primary sources. Follow diverse viewpoints deliberately. Use tools that let you control your own algorithm.
AI has dramatically lowered the cost of sophisticated scams. Voice cloning can replicate a family member's voice from a few seconds of audio. AI-written phishing emails are grammatically perfect and personally targeted. AI chatbots can maintain convincing impersonations in real-time conversations.
Defense: Verify unexpected requests through a different communication channel. If your "boss" emails asking for a wire transfer, call them on the phone. Be suspicious of urgency - scammers use time pressure to prevent verification. Use multi-factor authentication everywhere.
AI can generate thousands of unique articles, social media posts, and comments in seconds. This makes it possible for small groups to create the illusion of widespread consensus or manufacture controversy. AI-generated content is flooding the internet, making it harder to distinguish genuine human discourse from manufactured narratives.
Defense: Prioritize established, accountable news sources. Be skeptical of viral content, especially from accounts with short histories. Check if a claim is reported by multiple independent outlets before believing it.
Governments are beginning to regulate deepfakes and AI-generated political content. Platform companies are implementing AI content labeling. Researchers are developing better detection tools. The EU AI Act includes provisions for transparency in AI-generated content.
But technology moves faster than regulation. Your best defense is awareness, skepticism, and media literacy.
MIT Technology Review: "How to spot AI-generated deepfake images" - https://www.technologyreview.com/2023/10/30/1082678/how-to-spot-ai-generated-deepfake-images/
CISA: Contextualizing Deepfake Threats - https://www.cisa.gov/sites/default/files/2023-09/Contextualizing_Deepfake_Threats_to_Organizations_508c.pdf
Stanford Internet Observatory: AI-generated disinformation - https://cyber.fsi.stanford.edu/
Electronic Frontier Foundation: Deepfakes - https://www.eff.org/issues/deepfakes
EU AI Act overview - https://artificialintelligenceact.eu/