• Former US President  Obama warned about the dangers of deepfakes.
• Zuckerberg boasted about having ‘total control of billions of people’s stolen data.
• Ukrainian President Volodymyr Zelensky urged his troops to surrender to Russian forces.

Dr. Nandana Kumara, an academic in computer science, Teaching Fellow in Computing at the University of Waikato’s School of Computing and Mathematical Sciences, with  MSc. and PhD. qualifications, delves into how Deepfake created these fake videos.

In a world where technology is advancing at breakneck speed, the line between reality and fiction is becoming increasingly blurred. One of the most controversial developments in recent years is the rise of deepfake technology—a product of generative artificial intelligence (AI) that allows anyone with basic technical skills to create hyper-realistic videos of people saying or doing things they never actually did. While this technology has potential for creative and educational purposes, it also poses significant ethical challenges and risks, particularly for vulnerable groups like children.

What Are Deepfakes?

Deepfakes are synthetic media created using AI algorithms that manipulate audio and video to make it appear as though someone is saying or doing something they never did. The term ‘deepfake’ comes from a combination of ‘deep learning’ (a subset of AI) and ‘fake.’ These videos can be incredibly convincing, often indistinguishable from real footage to the untrained eye.

For example, in 2018, a deepfake video of former U.S. President Barack Obama, created by comedian Jordan Peele and researchers at BuzzFeed, went viral. In the video, Obama appears to deliver a speech warning about the dangers of deepfakes. The video was a powerful demonstration of how easily this technology can be used to manipulate public perception.

The Ethical Dilemma

The ethical implications of deepfake technology are profound. At its core, deepfakes challenge our understanding of truth and trust. If we can no longer believe what we see or hear, how do we make informed decisions as a society?

A striking example of this occurred in 2019, when a deepfake video of Facebook CEO Mark Zuckerberg surfaced. In the video, Zuckerberg appeared to boast about having ‘total control of billions of people’s stolen data.’ The video, created by artists Bill Posters and Daniel Howe, was intended to raise awareness about the misuse of personal data, but it also highlighted the potential for deepfakes to spread misinformation and erode trust in public figures.

This example underscores the potential for deepfakes to spread misinformation, ruin reputations, and destabilize trust in institutions. It also raises questions about accountability. Who Is Responsible When A Deepfake Causes Harm? The Creator? The Platform That Hosts It? Or The Ai Tools That Make It Possible?

The Risks to Children

While deepfakes pose risks to everyone, children are particularly vulnerable. Kids today are growing up in a digital world where they are constantly exposed to online content. They are also more likely to believe what they see, making them easy targets for deepfake manipulation.

One alarming example comes from the United States, where a high school student used deepfake technology to create explicit videos of his classmates. The videos, which were shared on social media, caused significant emotional distress to the victims and led to a broader discussion about the need for stricter regulations on AI-generated content (The New York Times, 2021).

Another disturbing trend is the use of deepfakes to create inappropriate content featuring children. In 2020, a report by the Internet Watch Foundation (IWF) revealed that AI-generated images of underage individuals were being circulated on the dark web. These images, though fake, were disturbingly realistic and posed a significant challenge for law enforcement agencies (IWF, 2020).

The psychological impact on children who fall victim to such exploitation cannot be overstated. They may struggle with trust issues, self-esteem, and a sense of security. Moreover, the long-term consequences of having their likeness misused in this way are still largely unknown.

The Role of Generative AI

Generative AI tools, such as OpenAI’s DALL·E and ChatGPT, have made it easier than ever to create deepfakes. These tools are designed to generate content based on user input, and while they have many positive applications, they can also be misused.

For instance, in 2023, a deepfake video of Ukrainian President Volodymyr Zelenskyy surfaced, in which he appeared to urge his troops to surrender to Russian forces. The video was quickly debunked, but not before it caused confusion and panic among some viewers (BBC, 2023). This incident highlights the potential for deepfakes to be used as tools of propaganda and disinformation, particularly in times of conflict.

Combating the Threat

So, what can be done to address the risks posed by deepfakes? Experts suggest a multi-pronged approach that includes technological, legal, and educational measures.

1. Technological Solutions: Companies are developing tools to detect deepfakes, such as algorithms that analyze facial movements and audio patterns for inconsistencies. For example, Microsoft’s Video Authenticator tool can analyze photos and videos to provide a confidence score indicating whether the media is likely to have been manipulated (Microsoft, 2020).
2. Legal Frameworks: Governments around the world are beginning to regulate the use of deepfake technology. In the European Union, the Digital Services Act (DSA) includes provisions to combat the spread of disinformation, including deepfakes (European Commission, 2022). Similarly, in the United States, the Deepfake Report Act of 2019 requires the Department of Homeland Security to publish an annual report on the use of deepfake technology (Congress.gov, 2019).
3. Education and Awareness: Teaching children and adults how to identify deepfakes is crucial. Schools could incorporate digital literacy programs that teach students to critically evaluate online content. Parents, too, need to be aware of the risks and have open conversations with their kids about the dangers of sharing personal information online.

A Call to Action

The rise of deepfake technology is a wake-up call for society. While it offers exciting possibilities for creativity and innovation, it also poses significant ethical and social challenges. As we navigate this new frontier, it is essential to strike a balance between embracing technological advancements and protecting the values that hold our communities together.

For parents, educators, and policymakers, the message is clear: We must act now to safeguard our children and our society from the potential harms of deepfakes. By working together, we can ensure that this powerful technology is used responsibly and ethically, rather than as a tool for harm.

In the words of renowned technologist Jaron Lanier, ‘The most important thing about technology is how it changes people.’ Let’s make sure those changes are for the better.

By Dr. Nandana Kumara – Hamilton