A billion YouTube videos now have automated captions, helping deaf / hard of hearing viewers...

Shawn Knight

Posts: 12,999   +130
Staff member

YouTube is one of the top entertainment destinations on the Internet but for the 360 million people worldwide that are deaf or hard of hearing, enjoying videos like everyone else isn’t a given.

Google first launched video captions back in 2006 but it would be another three years before YouTube adopted automated captions. As YouTube product manager Liat Kaver explains, that was a big leap forward that helped them keep up with the site’s growth curve over the past several years.

These days, more than a billion videos have automatic captions with users relying on them more than 15 million times per day.

Kaver said in a recent blog post that one of the ways they were able to scale the availability of captions was to combine Google’s automatic speech recognition (ASR) technology with YouTube’s caption system. While that helped, it wasn’t perfect as there were limitations with the technology that underscored the need to improve the captions themselves, something that Kaver said creators sometimes had fun with at their expense.

All jokes aside, one of their major goals was to improve the accuracy of automatic captions – not exactly an easy task given YouTube’s size and the diversity of content it hosts. But by improving speech recognition and machine algorithms as well as expanding training data, they’ve been able to boost automatic caption accuracy in English by 50 percent.

YouTube isn’t resting on its laurels as Kaver notes they intend to keep growing beyond the billion captions milestone and extend their work to all 10 supported languages (Dutch, French, German, Italian, Japanese, Korean, Portuguese, Russian, Spanish and of course, English).

Part of getting there will involve creators willing to review and edit automatic captions on their own videos, Kaver said.

Permalink to story.


Uncle Al

Posts: 8,001   +6,775
That is an excellent feature and will certainly make them more attractive to not only the deaf, but to the hearing impaired as well. I give them five stars for this achievement!


Posts: 62   +22
As part of the deaf-as-a-doorknob crowd, I appreciate this feature on YouTube when it is available. I have cochlear implants but I still have a great deal of trouble understanding what is being said in TV programs or in YouTube video clips so, except for sports, I only watch things that have closed captions or subtitles.

It would be nice if this feature was available on ALL YouTube videos - there are far too many where it is not.

It would also be nice if I could use this technology to provide captions for things I have on DVDs, Blu-Ray discs, or my local hard drives. Ie., if this technology could be built into something like the VLC media player software.

Raoul Duke

Maybe now I can understand what some of these modern emoji's mean as the use of this technology spreads