Facebook first started trialling a system to combat revenge porn late last year, but it had one rather scary aspect: you had to upload your own nudes so the platform knew which images it should block. The social network has today announced a new AI-based detection system …
The earlier system, which is still in use and set for expanded rollout, relied on users uploading photos they were afraid might be shared, allowing Facebook to create a digital fingerprint to block uploads of matching images.
Facebook says its new AI-based system is designed to automatically detect nude or near-nude images, before passing them for a human moderator to decide whether the photo or video should be blocked.
The company says there is an appeals process if someone feels their account has been blocked inappropriately.
A specially-trained member of our Community Operations team will review the content found by our technology. If the image or video violates our Community Standards, we will remove it, and in most cases we will also disable an account for sharing intimate content without permission.
Facebook says its earlier initiative has been welcomed by victims.
The company has also created a new page within its Safety Centre, explaining how revenge porn can be reported and additional steps victims can take.
Photo: Shutterstock