The spread of 'nudify' apps and AI deepfakes has led to a chilling effect on Indian women, who are reluctant to go online due to the fear of their images being manipulated or used in a derogatory manner. The concern is not unfounded, as there have been instances where images and videos of prominent Indian women, such as Bollywood singer Asha Bhosle and journalist Rana Ayyub, have been cloned using AI tools.
These cases have resulted in a societal-wide conversation about the need for legal rights over one's voice or image. However, many ordinary women like Gatha Sarvaiya, an Indian law graduate, feel uncertain about going online due to the risk of facing online harassment. The emotion that arises from this is fatigue, which ultimately leads to women receding from online spaces altogether.
The Rati Foundation has reported a significant increase in AI tools being used to create digitally manipulated images or videos of women, often with the intention of extorting money or spreading sexual content. In one instance, a woman was approached by scammers who had created a nudify app using her uploaded photograph, resulting in a barrage of explicit calls and messages.
The legal landscape is equally concerning, as India's laws do not specifically recognize AI deepfakes as forms of harm. The process of reporting and seeking justice can be lengthy and fraught with red tape. Even when platforms like YouTube, Meta, X, Instagram, and WhatsApp take action, it often comes too late, with the content resurfacing elsewhere.
The situation is further complicated by the fact that these platforms often respond inadequately to reports of online abuse. Apple and Meta have taken steps to limit the spread of nudify apps, but more needs to be done to address the root cause of the problem. Greater transparency and data access from platforms themselves are essential in addressing this issue.
The consequences of inaction will be severe, not just for women who feel forced to hide their online presence, but also for society as a whole. The erosion of trust in online spaces and the silencing of women's voices will have far-reaching implications for India's democracy and social fabric. It is imperative that we take immediate action to address this crisis and create a safer online environment for all women.
These cases have resulted in a societal-wide conversation about the need for legal rights over one's voice or image. However, many ordinary women like Gatha Sarvaiya, an Indian law graduate, feel uncertain about going online due to the risk of facing online harassment. The emotion that arises from this is fatigue, which ultimately leads to women receding from online spaces altogether.
The Rati Foundation has reported a significant increase in AI tools being used to create digitally manipulated images or videos of women, often with the intention of extorting money or spreading sexual content. In one instance, a woman was approached by scammers who had created a nudify app using her uploaded photograph, resulting in a barrage of explicit calls and messages.
The legal landscape is equally concerning, as India's laws do not specifically recognize AI deepfakes as forms of harm. The process of reporting and seeking justice can be lengthy and fraught with red tape. Even when platforms like YouTube, Meta, X, Instagram, and WhatsApp take action, it often comes too late, with the content resurfacing elsewhere.
The situation is further complicated by the fact that these platforms often respond inadequately to reports of online abuse. Apple and Meta have taken steps to limit the spread of nudify apps, but more needs to be done to address the root cause of the problem. Greater transparency and data access from platforms themselves are essential in addressing this issue.
The consequences of inaction will be severe, not just for women who feel forced to hide their online presence, but also for society as a whole. The erosion of trust in online spaces and the silencing of women's voices will have far-reaching implications for India's democracy and social fabric. It is imperative that we take immediate action to address this crisis and create a safer online environment for all women.
... like, I totally get why Indian women are hesitant to go online - it's so scary when your pics or vids get cloned and used in weird ways... it's like, no one wants to be objectified or harassed online. And the fact that AI tools are being used for extortion is just crazy 
... platforms gotta do better to keep users safe, you know? They need to step up their game on reporting and taking down fake content ASAP 
. Can't let this situation get out of hand - it's not just about women feeling uncomfortable online, but also about our society as a whole 
.
. They're literally ruining the internet for Indian women, who are already under so much pressure in real life. It's not just the fear of their images being manipulated, but also the emotional toll of facing online harassment and fatigue 
. I mean, Apple and Meta have taken some steps, but more needs to be done, like greater transparency and data access 
. We can't just sit back and let this situation spiral out of control 
. We need to take action now to create a safer online environment for all women 
. Maybe we shd focus on educating these women online so dey know how 2 protect themselves better 
. And btw, its not all about AI deepfakes, there r plenty of other factors at play here 
.
This is getting way too real... I mean, who knew AI deepfakes could be so sinister? 
It's like, one minute you're browsing through your fave socials, the next you're seeing manipulated pics of Asha Bhosle or Rana Ayyub all over the internet. That's some major psychological damage right there! 
The fact that women are feeling fatigued and scared to go online is, like, totally understandable. Can't we just get our laws and platforms to step up their game already? 
I mean, it's not like this is a new issue... but the way it's spreading with these nudify apps is wild. And don't even get me started on how frustrating it must be for those women who are trying to report abuse only to face red tape and more harassment! 
We need some serious change ASAP or we're gonna lose our online communities forever 
like what kind of laws r they gonna make 2 stop these ai deepfakes already? 
. It's totally understandable that Indian women are hesitant to go online with the fear of being objectified or harassed 
.
and take responsibility for creating a safer online space 
. More transparency & data access from them would be a huge leap in the right direction 
. Let's make some noise & create real change 
! 
. And don't even get me started on the platforms - they're always so slow to act when it comes to reporting and removing offending content 
. I mean, come on guys, can't we just have a simple button that says "report this as AI deepfake"? 
gotta draw a diagram to illustrate what's going on here... 
it's not like women are asking for much, just the right to control their own bodies and voices without fear of being doxxed or worse. and don't even get me started on how long it takes for platforms to take down this stuff... meanwhile, women are just stuck in a cycle of fatigue and online silence 
we need more than just some token effort from the tech giants, we need real change 
. It's not just about women's rights, it's about creating a safer online space for everyone 
. We need to have an open conversation and make sure everyone is aware of what's happening so we can take action together 
. But its not just about the tech, its about our collective responsibility as a society to protect each other online 
. It's just not right that women have to deal with this kind of emotional distress because some dude wants to make a quick buck. And the fact that our laws don't specifically recognize AI deepfakes as harm? Yeah, that's just not good enough 
.
the fact that ashia bhosle & rana ayub have been cloned using AI tools is already too much to handle 
Women are already facing so much in real life, no need for scammers to play dirty online too 
.
. If we let women be silenced just because of their image or voice, that's a recipe for disaster 
I'm all for greater transparency from platforms like Apple & Meta - we need them to step up their game & report these scammers ASAP!