Abstract
Technology, which was once a boon to the mankind, is becoming their worst nightmare. This sudden change got introduced by the misuse of the generative AI that was initially used to create parodies of people by swapping their faces in memes. However, this changed when such generative AI got into the hands of people who used it to create deepfakes. These deepfakes created a problem as the real world got mixed up with the virtual world, and the twist is that there is no dedicated statute available to regulate these deepfakes. This article delves into the legal structure that supervises the corruption of artificial intelligence, challenges that are being faced, and the path for the future. Therefore, such content needs to be regulated as soon as possible; otherwise it will continue to haunt people with the spread of fake images and videos of close ones.