1. TechSpot is dedicated to computer enthusiasts and power users. Ask a question and give support. Join the community here.
    TechSpot is dedicated to computer enthusiasts and power users.
    Ask a question and give support.
    Join the community here, it only takes a minute.
    Dismiss Notice

The Defense Department has produced the first tools for catching deepfakes

By Cal Jeffrey · 8 replies
Aug 9, 2018
Post New Reply
  1. Deepfakes, as they are known, are videos that use machine learning to superimpose one person’s face into the video of another person. It has been used to make fake pornographic videos of celebrities, and with the right editing, it can be entirely convincing.

    However, there is an even more nefarious use for the technology. Foreign powers or even domestic troublemakers could use the techniques to create propaganda or synthesized events. For example, imagine turning on the TV and seeing the president of the United States issuing a warning to Americans telling them to kiss their loved ones goodbye because a full nuclear strike was on its way to the US. How about Barrack Obama using some colorful language (video below).

    For this reason, the Defense Department has been very interested in developing tools that can detect and even combat such fake footage. MIT Technology Review reports that the first of those tools have rolled out through a US Defense Advanced Research Projects Agency (DARPA) program called Media Forensics. The initiative was originally created to automate already existing forensic tools. However, the program has shifted focus to developing ways to fight “AI-made forgeries.”

    The most convincing method of creating deepfakes is to pit two neural networks against each other. This is called a GAN or generative adversarial network. For it to work the GAN has to be fed several images of the person being faked. It then uses these images to try to match the angles and tilts of the face upon which it is being superimposed.

    “We've discovered subtle cues in current GAN-manipulated images and videos that allow us to detect the presence of alterations,” said Matthew Turek, head of the Media Forensics program.

    One of the tells is the lack of blinking in a forged video. Professor Siwei Lyu of State University of New York (SUNY) related how he and some students had created a bunch of fakes to try seeing how traditional forensic tools would do.

    “We generated about 50 fake videos and tried a bunch of traditional forensics methods,” said Lyu. “They worked on and off, but not very well.”

    However, during their experiments, they noticed the deepfakes rarely, if ever, blinked. Furthermore, on the rare occasions that they did, the movement looked “unnatural.” The reason for this is simple; the GANs are fed still images nearly all of which the subject’s eyes are open.

    So Lyu and his SUNY students are focusing on creating an AI that looks for this tell-tale sign. He says their current efforts work, but can be tricked by feeding the GAN images of the subject blinking. However, he adds that they have a secret technique in the works that is even more effective.

    “I’d rather hold off at least for a little bit,” said Lyu regarding the method. “We have a little advantage over the forgers right now, and we want to keep that advantage.”

    Other groups involved in the DARPA program are aiming toward similar techniques. Hany Farid, a lead digital forensics expert at Dartmouth College, thinks other clues like odd head movements, strange eye colors, and other facial factors can help determine if a video has been faked.

    “We are working on exploiting these types of physiological signals that, for now at least, are difficult for deepfakes to mimic,” said Farid.

    Turek says that DARPA intends to continue running the Media Forensics contests so that it can ensure the field keeps up with the faking techniques as they further develop.

    Permalink to story.

  2. SirChocula

    SirChocula TS Maniac Posts: 174   +183

    "The last thing the government wants is to be fake"

    That's a cute tag line. As if virtually all the wars we've had for over the past century has been caused by "real" reasons propagated by our "government".

    Here's a video to red pill anyone who still believes that we have a "government for the people, by the people".

    Reehahs likes this.
  3. VitalyT

    VitalyT Russ-Puss Posts: 4,246   +2,719

    Leave Nicolas Cage alone, he is a harmless crazy.
  4. That Obama fake is priceless, especially the last line had me laughing.
    Cal Jeffrey likes this.
  5. MilwaukeeMike

    MilwaukeeMike TS Evangelist Posts: 3,132   +1,397

    If the US believed in govt we wouldn't have elected the most opposite person to a politician we've ever seen.
    Cal Jeffrey likes this.
  6. SirChocula

    SirChocula TS Maniac Posts: 174   +183

    You have to remember that if voting actually gave us any real "power", the powers behind the scene wouldn't let us take part in it. Trump nor any president before him were never elected, but selected.
  7. cliffordcooley

    cliffordcooley TS Guardian Fighter Posts: 11,208   +4,873

    The powers behind the scenes do not care. When they are pulling strings of all parties. It is not just one party that is selected, all the parties were selected. This is why we never have anything to vote for. Our selections were selected for us. This is also why they don't care which way we vote. And since the media makes sure everyone disagrees, the powers that be will always be in power.
  8. commanderasus

    commanderasus TS Addict Posts: 225   +98

    I always wondered how CNN did their interviews...now I know
    senketsu and MilwaukeeMike like this.
  9. moon982

    moon982 TS Rookie Posts: 23

    That software is not going do any thing after such news is out there in the public after the damage has been done.

    Unless all news must pass through the software to get improved to be posted to the internet.

    What is the software going to do with the millions of videos and articles posted every day on the internet and people have read it and watched it and the damage has been done.

    Unless all videos and articles must pass through the software to get improved to be posted to the internet.

    And if that the case you can kiss the freedom of the press goodbye and welcome state run news and media.

    What are they going to do with Facebook, Twitter and YouTube run the videos and posts that must pass through the software before being allowed to be posted or not allowed to be posted.

Similar Topics

Add your comment to this article

You need to be a member to leave a comment. Join thousands of tech enthusiasts and participate.
TechSpot Account You may also...