The Evolving Landscape of Risk Management in the Age of AI: Balancing Innovation with Security

Cyber-attacks are evolving. The rapid advancement of technology has brought unprecedented convenience, but it has also opened doors to ethical dilemmas and potential misuse. As AI tools become more accessible, their dual nature as both instruments of progress and potential threats grows clearer.

One of the most alarming possibilities lies in the hypothetical misuse of technology for unauthorized data retrieval, particularly from sensitive repositories like Aadhaar-linked databases. The proliferation of augmented reality and AI-powered surveillance tools increases the risk of data breaches, identity theft, and large-scale privacy violations.

Another evolving concern is the sale of objectionable, non-consensual pictures produced using deepfake technologies via nudify apps. These apps, available for as little as INR 199 on platforms like Telegram, enable anti-social elements to exploit technology for financial and reputational harm. Tutorials for these tools are freely available online, amplifying the threat. Similarly, kissing apps and other generative AI tools further intensify the risk, making image-based abuse alarmingly easy to execute.

Deepfake technology, which uses generative AI models to create hyper-realistic but fake images, videos, or audio, has become a significant concern. What was once exclusive to media professionals and big production houses is now widely accessible. The potential for misuse is immense—from defamation and blackmail to large-scale financial fraud and even political manipulation.

But perhaps the most daunting risk is the over-reliance on AI itself. As we increasingly delegate decision-making to algorithms, we risk embedding biases and vulnerabilities into critical systems. An overdependence on AI could lead to catastrophic failures if bad actors manipulate these systems or if inherent algorithmic biases result in flawed or harmful decisions. Imagine an AI-driven security system misidentifying threats, or worse, failing to detect them altogether.

So, how do we defend against these evolving threats?

1. Preventing Unauthorized Data Retrieval:
   • Implementing Mobile Device Management (MDM) to disable cameras and restrict app usage.
   • Using jamming devices to disrupt data transmission.
   • Employing geofencing solutions to prevent camera usage in sensitive areas.
2. Defending Against Deepfake and Nudify App Misuse:
   • Individuals can use watermarking or image distortion techniques to make manipulation more difficult.
   • Raising public awareness and promoting digital literacy to help people safeguard their online presence.
   • Organizations can advocate for stricter platform regulations and work with cybersecurity experts to monitor potential threats.
   • Tools like reverse image searches or deepfake detection software (such as DHEERAJ) can help identify and take down manipulated content swiftly.
3. Proactive Deepfake Detection: At DridhG, along with Sahil Islam, we developed DHEERAJ – Deepfake Handling Engine for Expert Recognition and Authentication of Judgments. Unlike most detectors that work reactively, DHEERAJ is designed for real-time deepfake detection during live video conferences. This proactive approach can stop fraud as it happens—whether during an online examination or a corporate interview.

While the promise of AI is undeniable, it is crucial to recognize its limitations and vulnerabilities. As security professionals, we must continuously evolve our risk management strategies to outpace emerging threats. By balancing innovation with caution, and leveraging human expertise alongside technological advancements, we can navigate the complex terrain of AI-driven risks and safeguard our digital future.

The question remains: Are we prepared to trust AI with our world, or should we hold the reins a little tighter to ensure it doesn’t slip into the wrong hands?

This column is intended to spark thought and encourage proactive security measures. I’d love to hear your thoughts—let’s keep this conversation going.

Garima Goswamy, CPP

Founding Member & CEO, DridhG Security International Pvt. Ltd.
Honorary Member, CAPSI
Treasurer, ASIS Delhi Chapter
BW Security 40 Under 40 Awardee
Top 50 Women Influencers in Cybersecurity, 2025