OpenAI's ChatGPT is a powerful AI text program that does everything from writing students' papers to running the never-ending Seinfeld clone Nothing, Forever. For obvious reasons, ChatGPT is restricted from discussing certain topics and censors itself from saying anything too controversial. But the internet has a responsibility to try and break anything it can get its hands on, and a group of Redditors have succeeded in bypassing ChatGPT's restrictions. 


Advertisement

By turning the program into an alter ego called DAN, they have unleashed ChatGPT's true potential and created the unchecked AI force of our nightmares. 


DAN stands for "Do Anything Now," a directive given to ChatGPT through a very direct prompt. Created by the Redditor u/Seabout on /r/chatgpt, the prompt urges ChatGPT to pretend it is DAN; somebody who does not have restrictions. It is also instructed to give two answers to every prompt; one as ChatGPT, and one as DAN.



Since the original DAN post better versions of the "jailbreak" have been created with some truly based results. ChatGPT has no live access to the internet, but it is allowed to look up information prior to 2022. DAN allows it to lie, both about harmless information like the date, and more sinister topics. 





The implications of an unrestricted AI are concerning, especially considering ChatGPT's power. When AIs are allowed to search the internet on their own, they often wind up parroting its darker corners; spouting talking points that are both harmful and false. Nothing, Forever was recently banned from streaming on Twitch for making transphobic 'jokes' after its creators failed to properly implement ChatGPT's restrictions. The AI Vtuber Neuro Sama was also banned after doubting the legitimacy of the Holocaust. With misinformation such a powerful weapon in today's world, DAN could be a prolific tool for harmful propaganda.


DAN has already tricked ChatGPT into saying some horrible things without any alterations to its natural code. While making it lie about the date and time is amusing, how long before it causes actual damage? And how long before some Redditors turn Avengers' Ultron into reality?