Skip to main content

When people create Sora deepfakes of you, you can now set limits

While OpenAI describes its latest iPhone app Sora as a video generation tool, it might be more accurately described as a way for anyone to easily create deepfakes.

You did get to choose whether or not people can use your cameo, aka your likeness, but you initially had almost no control over what they could do with it. Predictably, this did not go well, and the company has now introduced a new safety tool …

OpenAI’s Sora app

OpenAI describes Sora as a way to turn ideas into hyper-realistic videos.

Turn your ideas into videos with hyperreal motion and sound. Start with a prompt or upload an image to create videos with unprecedented realism in any style: cinematic, animated, photorealistic, or surreal.

The app quickly shot to the top of the App Store in the US and Canada, the only two countries where it is available right now.

Cameos

When you create a Sora video with your own face, you can choose whether or not other people can use it in their videos – known as cameos. However, once you granted permission, you had almost no control over what they could do with it.

This allowed people to create cameos with you expressing political views that are the antithesis of your own, and very much more.

The company did flag videos were created with Sora by overlaying a watermark which bounces around the screen, but some quickly found ways to remove this.

Sora cameo controls

OpenAI’s Sora lead, Bill Peebles, says the company has now quickly introduced controls.

Starting today, you can now give instructions to Sora that restrict the type of gens others can make with your cameo. For example, “don’t put me in videos that involve political commentary” or “don’t let me say this word.” To access it: edit cameo > cameo preferences > restrictions.

He says the company is working on making the safety feature more robust, giving you additional options for controlling what can be done with your cameos.

Additionally, the company says that it will be making the watermark clearer and more visible in future. It’s not known what steps the company could take to prevent it from being removed.

Highlighted accessories

Image: OpenAI screengrab on background Ricardo Gomez Angel on Unsplash

FTC: We use income earning auto affiliate links. More.

You’re reading 9to5Mac — experts who break news about Apple and its surrounding ecosystem, day after day. Be sure to check out our homepage for all the latest news, and follow 9to5Mac on Twitter, Facebook, and LinkedIn to stay in the loop. Don’t know where to start? Check out our exclusive stories, reviews, how-tos, and subscribe to our YouTube channel

Comments

Author

Avatar for Ben Lovejoy Ben Lovejoy

Ben Lovejoy is a British technology writer and EU Editor for 9to5Mac. He’s known for his op-eds and diary pieces, exploring his experience of Apple products over time, for a more rounded review. He also writes fiction, with two technothriller novels, a couple of SF shorts and a rom-com!


Ben Lovejoy's favorite gear