CD Projekt Red used AI to lip-sync Cyberpunk 2077's dialogue across 10 languages

[Polycount]

In context: Artificial intelligence has a broad range of potential use cases across a wide array of industries. It's used to improve and personalize search results, boost the accuracy of translations, and, apparently, it can even be used to streamline the game development process.

As reported by Twitter user and industry veteran Shinobi602, the upcoming open-world sci-fi RPG Cyberpunk 2077 will feature full lip-sync for every single voiced character in all 10 dubbed languages.

That attention to detail is highly irregular in the AAA gaming industry -- most dubbed games simply use the English lip-sync for all languages, and for a good reason. The work associated with tweaking facial animations for 10 different languages would be astronomical -- right?

Cyberpunk 2077 has full lip-sync for every character in all 10 dubbed languages

Presentation: https://t.co/8r7rq570VM

Nuts - and awesome to see for languages that often times get much less support. Great work by everyone involved. pic.twitter.com/hwvaTWb9ei

— Shinobi602 (@shinobi602) October 20, 2020

Well, not quite. Developer CD Projekt Red has implemented "JALI" artificial intelligence tech to automatically lip-sync dialogue across all supported languages.

Using artificial intelligence to automate this task was a natural decision for CD Projekt Red; there are hundreds, if not thousands of characters in Cyberpunk 2077, after all.

If you're concerned that will lead to poorer facial animations, don't fret. The studio is undoubtedly manually touching up animations where necessary, and developer Mateusz Popławski claims that they're targeting even better lip-syncing than The Witcher 3.

You can see a demo of the tech in the presentation above, or by checking out the Twitter post midway through this piece.

We look forward to seeing how CD Projekt Red's implementation of AI lip-syncing will turn out when Cyberpunk 2077 hits store shelves on November 19, 2020.

Permalink to story.

https://www.techspot.com/news/87205-cd-projekt-red-used-ai-lip-sync-cyberpunk.html

 

[VitalyT]

Except for Johnny Silverhand, who wasn't so lucky...

 

[amghwk]

Can see where this is going. More hype. And more suckers pre-purchasing it.

As for me, I'll have my popcorn ready watching these suckers playing and reviewing it.

And as for me, I might get it when it's on sale - at least 70% off in a year or two. If it's on sale, why not.

(I got the so-called Witcher III while on heavy sale a few years later after it's release just to see what's all the hoopla about. Not impressed with it's "best game ever" moniker even a bit. And it's gathering dust now. In contrast I still am playing other so-called open-world games.)

Hmm.. that will make me a sucker too, finally, eh?

At least, I'll have the conscience that I'm buying a generic game on sale by then.

 

[KILLCHRISU]

Can see where this is going. More hype. And more suckers pre-purchasing it.

As for me, I'll have my popcorn ready watching these suckers playing and reviewing it.

And as for me, I might get it when it's on sale - at least 70% off in a year or two. If it's on sale, why not.

(I got the so-called Witcher III while on heavy sale a few years later after it's release just to see what's all the hoopla about. Not impressed with it's "best game ever" moniker even a bit. And it's gathering dust now. In contrast I still am playing other so-called open-world games.)

Hmm.. that will make me a sucker too, finally, eh?

At least, I'll have the conscience that I'm buying a generic game on sale by then.

You sure showed us. Nice.

 

[Nobina]

I have been very impressed with Devil May Cry 5 lipsync and just faces in general. This doesn't looks as accurate as I thought it would be.

 

[stewi0001]

I think they could use some more work on the eye brows. I feel like they made them too active.

 

[mbrowne5061]

Can see where this is going. More hype. And more suckers pre-purchasing it.

As for me, I'll have my popcorn ready watching these suckers playing and reviewing it.

And as for me, I might get it when it's on sale - at least 70% off in a year or two. If it's on sale, why not.

(I got the so-called Witcher III while on heavy sale a few years later after it's release just to see what's all the hoopla about. Not impressed with it's "best game ever" moniker even a bit. And it's gathering dust now. In contrast I still am playing other so-called open-world games.)

Hmm.. that will make me a sucker too, finally, eh?

At least, I'll have the conscience that I'm buying a generic game on sale by then.

Oh no. People enjoying things.