Skip to main content

Android Q can caption any media on your phone in real time

testsetset

Google today introduced Live Caption, an Android Q feature that provides real-time continuous speech transcription on your phone. In short, Android Q will be able to caption any media on your phone. That includes songs, audio recordings, podcasts, and so on. It can be content that you recorded or that you downloaded. It can be from a first-party app or a third-party app. If your phone can play it, your phone can caption it.

“Live Caption makes all content, no matter its origin, more accessible to everyone,” Google CEO Sundar Pichai said onstage. “The incredible thing is that it works completely on device. So there’s no delay.”

Live Caption can be accessed by one of the volume buttons on your phone; it appears as a software icon when the volume UI pops up. With a single tap, Live Caption automatically captions any media on your phone. As soon as speech is detected, captions will appear on your phone screen. You can double-tap to show more, and also drag the captions to anywhere on your screen.


June 5th: The AI Audit in NYC

Join us next week in NYC to engage with top executive leaders, delving into strategies for auditing AI models to ensure fairness, optimal performance, and ethical compliance across diverse organizations. Secure your attendance for this exclusive invite-only event.


You don’t need to open another app, and you don’t need a Wi-Fi or data connection. That’s right — Live Caption works locally. No data, audio, captions, or other data is sent back to Google.

Live Caption fits neatly into I/O 2019‘s “designing for accessibility first” mantra. Live Caption can clearly make a world of difference to people who are deaf or hard of hearing. It also has broader implications for anyone who wants to stay quiet while consuming content that requires sound.

Live Caption appears to do exactly what its name describes. Unfortunately, that means it doesn’t provide a transcription of everything it captioned when it finishes. It would appear that transcription services like Otter.ai and Voicera are safe, for now.

Google I/O 2019: Click Here For Full Coverage