As the world moves towards seeking balance with the growing use of AI, schools and students face a new threat, deep fake images.
Deepfake images are created by AI algorithms which are fed a sample image and can produce an output based on a user’s prompt. The seemingly harmless algorithm has become a modern threat, as anyone with access to generative AI can easily produce fake content that is consumed by the masses.
In schools the emergence of deepfake usage by students is evidence of its rising threat.
Students oftentimes use deep fake technology to make pornographic images of their classmates. These students, as young as 14, then share them on social media platforms. Schools have historically dealt with issues like sexual harassment from nonconsensual imagery or cyberbullying but deep fakes have accelerated these issues.
Cyberbullying and online threats can cause severe mental health issues for students. “The increase of AI technology in recent times has made cyber bullying an even larger problem. In the schools, the effects of this can be students avoiding school (increased absences), or becoming more withdrawn, both socially and/or academically,” said counselor Ellie Thomas.
Even at schools like PVHS where initiatives are taken to educate students on proper technology usage, students still use deep fake technology to harm their classmates.
Z.- a pseudonym for an anonymous student at PVHS- was a recent victim of deepfake technology. Her ex-boyfriend used the technology to create fake images and when Z. went to administration, no action was taken against the perpetrator.
The technology makes it easy for students to create false images of students, creating a threatening online environment. “It made me feel disgusted because I would never send a picture like that to anyone but there was a fake one that was out there,” said Z. “Knowing that anyone could easily make photos like that was very weird to think about.”
Due to the accessibility of the technology, it becomes easier and easier for students to become victims. Without support from the school, students like Z. are then unfortunately left alone to navigate the aftermath.
Lack of support from the school removes accountability for the perpetrators. “Schools need to enforce harsher punishments to protect other students because it’s become too much of a threat already,” added Z.
Schools must take a definitive stance against A.I. threats towards students. Without accountability for perpetrators, the safety and mental health of students are threatened.