Artificial Intelligence (AI) Companies and Public Safety: A Deadly Combination
Artificial intelligence (AI) companies are no strangers to embellishing their products’ capabilities — and when it comes to public safety, the consequences can be deadly.
Evolv Technologies’ False Claims
Evolv Technologies claimed its AI-powered security scanners would improve public safety by detecting weapons in a variety of places, including in schools. However, the Federal Trade Commission (FTC) found otherwise.
FTC Settlement Order
Last week, the FTC proposed a settlement order with Evolv Technologies over how the company oversold the ability of its AI-powered security system to detect weapons and "ignore harmless personal items" — especially in school settings. Evolv’s touch-free systems scan people as they enter a space without requiring a manual search of bags or pockets.
FTC Chair’s Statement
In an X post, FTC chair Lina Khan said Evolv has "falsely hyped" its AI weapons detection systems to school districts that paid the company "millions" to use the technology in schools. She noted that the scanners set off alarms for harmless items such as water bottles and binders while failing to identify weapons.
The Scanners’ Performance
Since going public in 2021, Evolv’s scanners have been popping up at sporting events, theme parks, schools, airports, subway stations, and even film festivals as an alternative to traditional metal detectors and other forms of security checkpoints. The Massachusetts-based company has advertised its "advanced AI-powered security scanning systems" as a viable solution to address public safety concerns, including school shootings.
Legal and Regulatory Scrutiny
In 2023, five law firms announced investigations into Evolv technologies for possible violations of securities law, claiming that "Evolv misled investors over the capabilities of its weapons detectors." Moreover, Evolv’s shareholders filed a class-action suit against the company, arguing that the company’s marketing claims overstated the effectiveness of the technology.
NYC Subway Pilot Program
Despite this legal, regulatory, and internal turmoil, New York City Mayor Eric Adams launched a three-month pilot program that would deploy the AI scanners in NYC subways. However, the scanners had been deployed previously in Jacobi Medical Center, where they reportedly triggered a huge number of false positives.
Conclusion
The FTC has been clear that claims about technology, including artificial intelligence, need to be backed up, and that is especially important when these claims involve the safety of children. The proposed settlement order would prevent Evolv from making unsupported claims about its products’ ability to detect weapons by using artificial intelligence. It would also require Evolv to notify certain K-12 school customers that they can opt to cancel contracts signed between April 1, 2022, to June 30, 2023.
Frequently Asked Questions
Q: What is the purpose of the FTC’s proposed settlement order with Evolv Technologies?
A: The proposed settlement order would prevent Evolv from making unsupported claims about its products’ ability to detect weapons by using artificial intelligence and would require Evolv to notify certain K-12 school customers that they can opt to cancel contracts signed between April 1, 2022, to June 30, 2023.
Q: What are the implications of Evolv’s false claims for public safety?
A: The implications are significant, as the company’s false claims may have led to the implementation of ineffective security measures, potentially putting the public at risk.
Q: What is the takeaway from this story?
A: The takeaway is that AI companies must be transparent about their products’ capabilities and limitations to ensure public safety.
