Introducing the AI Chatbot Compliance Task Force (Lock and Code S06E09)

This week on the Lock and Code podcast, we explore the controversial concept of “AI personas” developed by Massive Blue, designed for crime-fighting purposes. Among these personas are two fictional characters, “Heidi,” a 36-year-old activist from San Francisco, and “Jason,” a shy bilingual teenager with a penchant for anime and gaming. Despite their lifelike personas, neither exists in reality; they are part of a strategy aimed at combatting crime.

Massive Blue’s flagship product, Overwatch, is currently in operation within various police departments across the United States. The software’s touted capability lies in its ability to assist law enforcement in identifying, investigating, and apprehending criminal suspects. However, detailed insights regarding the technology’s inner workings remain elusive, as both Massive Blue and the police departments utilizing Overwatch have been reticent about providing transparency.

Recent investigations, notably by 404 Media, indicate that Overwatch integrates multiple existing technologies into a comprehensive software solution. This includes the ability to scan social media platforms for potential criminal activities and deploy AI-generated personas that can engage in online conversations with suspected individuals.

According to documents obtained from the Overwatch marketing team, these AI personas are characterized as “highly customizable and immediately deployable across all digital channels.” They are capable of adopting various roles—including those of escorts, money launderers, sextortionists, and even college protesters—activities that, in many cases, are protected under the First Amendment.

Interestingly, law enforcement agencies exploring the use of Overwatch have shown particular interest in its application to issues surrounding immigration and human trafficking. Nevertheless, significant claims regarding its effectiveness are undermined by reported outcomes; to date, Overwatch has not resulted in the arrest of any criminal suspects.

In today’s episode of the Lock and Code podcast, host David Ruiz converses with 404 Media co-founders Emanuel Maiberg and Jason Koebler. They delve into Overwatch’s functionalities, the reasoning behind police interest in such technologies, and the potential pitfalls of relying on AI solutions in complex human trafficking scenarios.

Maiberg notes, “Nobody is going to buy that—if you throw an AI chatbot into the mix, that’s somehow going to reduce gun crime in America. But if you apply it to human trafficking, maybe somebody is willing to entertain that because what is the actual problem with human trafficking? Where is it actually happening? Who is getting hurt by it? Who is actually committing it?”

He elaborates, suggesting, “Maybe there you’re willing to entertain a high-tech science fiction solution.”

Tune in today for a comprehensive discussion on this thought-provoking topic.