Women in India are being driven off the internet by a growing phenomenon of AI-powered deepfakes and 'nudify' apps that allow users to digitally manipulate images with malicious intent, leaving them vulnerable to online harassment.
Gatha Sarvaiya, an Indian law graduate, is one such woman who hesitates to post anything on social media due to the fear of her images being distorted or used in a derogatory manner. Her concern isn't unfounded; reports have shown that AI tools are increasingly being used to create and share manipulated content targeting women, often with malicious intent.
According to Rati Foundation's report, nearly 10% of reported cases involve these manipulated images, which can lead to a range of consequences including emotional distress, social exclusion, and even extortion. For instance, a woman was extorted by someone who posted nude photos of her on WhatsApp after she had refused to continue with loan payments.
The fear of online abuse is so prevalent that many women are choosing not to post images online or using illustration instead of photographs as profile pictures. But what's even more concerning is the fact that these platforms where the content is shared, like YouTube and Meta, often respond inadequately to reports of harassment, leaving victims with little recourse.
The report by Rati Foundation and Tattle also highlights the issue of 'nudification' apps which allow users to digitally remove clothes from images. These apps are not only used for malicious purposes but also create a false sense of security among women who might think their posts are safe online.
To combat this, Indian law enforcement agencies must step up efforts to hold platforms accountable for removing abusive content. The report emphasizes that greater transparency and data access from these platforms themselves is necessary to tackle the issue effectively.
Ultimately, the chilling effect of AI-powered deepfakes on Indian women's online activities cannot be overstated. Until we see meaningful action from platforms and law enforcement agencies, many more women will continue to feel the fear of being manipulated or harassed online.
Gatha Sarvaiya, an Indian law graduate, is one such woman who hesitates to post anything on social media due to the fear of her images being distorted or used in a derogatory manner. Her concern isn't unfounded; reports have shown that AI tools are increasingly being used to create and share manipulated content targeting women, often with malicious intent.
According to Rati Foundation's report, nearly 10% of reported cases involve these manipulated images, which can lead to a range of consequences including emotional distress, social exclusion, and even extortion. For instance, a woman was extorted by someone who posted nude photos of her on WhatsApp after she had refused to continue with loan payments.
The fear of online abuse is so prevalent that many women are choosing not to post images online or using illustration instead of photographs as profile pictures. But what's even more concerning is the fact that these platforms where the content is shared, like YouTube and Meta, often respond inadequately to reports of harassment, leaving victims with little recourse.
The report by Rati Foundation and Tattle also highlights the issue of 'nudification' apps which allow users to digitally remove clothes from images. These apps are not only used for malicious purposes but also create a false sense of security among women who might think their posts are safe online.
To combat this, Indian law enforcement agencies must step up efforts to hold platforms accountable for removing abusive content. The report emphasizes that greater transparency and data access from these platforms themselves is necessary to tackle the issue effectively.
Ultimately, the chilling effect of AI-powered deepfakes on Indian women's online activities cannot be overstated. Until we see meaningful action from platforms and law enforcement agencies, many more women will continue to feel the fear of being manipulated or harassed online.
This is so crazy! I mean, who knew that something as harmless-sounding as 'nudify' apps could become such a huge problem for women in India? It's like, you'd think that if someone can take your photo and make it look one way, they're not gonna try to manipulate you online. But clearly, that's just not the case here. 
And the fact that platforms are doing so little to help is just awful. I mean, come on, guys! We need to hold these companies accountable for keeping their users safe online.
But at the same time, I don't want to see law enforcement getting involved in this either... it feels like a slippery slope. Do we really need more rules and regulations to fix this? Or is there just a better way to address it?
its so easy 4 them 2 just say "we didn't find anything" when u report it... meanwhile, women r literally living in fear of online harassment 
i need more awareness about this & ppl need 2 be held accountable for their actions 
this is soooo not cool. I mean what even is the point of having social media if ppl r just gonna use it to harass & manipulate others? 
AI-powered deepfakes are literally the worst - like, how can u even do that 2 someone?! And y'all say platforms r not doing enuf, but cmon, who wud have thunk it was possible 4 them 2 be manipulated like this? 
I'm all 4 more transparent data access & platforms holding each other accountable 4 this stuff! 
and its not just emotional distress, but also extortion & social exclusion 
it's like, soooo unfair! 
platforms r supposed 2 be safe spaces, but now they're more like breeding grounds for harassment 
and law enforcement agencies need 2 step up their game ASAP 
or else ppl will just keep hiding online 
. Don't blame the platforms for not doing enough, they're already doing more than their fair share to try and keep us safe online 
. We need to stop making a mountain out of a molehill and start having some real conversations about why we're so scared of getting roasted online 
. I mean, if you're really that worried about being harassed, then maybe don't post any selfies or provocative pics in the first place 
. The fact that these apps are being used to extort women is a total red flag 
. Indian law enforcement needs to step up their game and hold platforms accountable for removing this kind of content ASAP 
. And honestly, I think it's time we had some serious conversations about consent and online behavior in India 
.
I mean, can you believe how vulnerable our lives are online? It's crazy how one bad image can lead to so much trouble - emotional distress, extortion, social exclusion... it's all just too much 
.
and yeah, its super lame that platforms aren't doing enough to take care of this issue 
It's like they're complicit in enabling this harassment! 
The fact that women are hesitant to post anything online or using illustrations instead of photos is just, wow 
. Until then, we're stuck with this chill effect 
, and it's not fair to the women who are already dealing with so much. We gotta do better 
And it's not just the women who are being targeted, but also the innocent bystanders who get dragged into these online shenanigans 
And what's worse is that platforms like YouTube and Meta are not doing enough to stop this nonsense 
can we please get a better system in place to protect people's online rights? 
meanwhile, women in india are literally living in fear of being online