Google has started rolling out the first major update to Android 15, bringing a slew of new features to eligible Android phones and Pixel devices. The update, which begins today, introduces expressive video captions, a Gemini-powered update to the Lookout app, and a Spotify extension for Gemini, among other enhancements.

One of the most notable features in this update is the introduction of expressive captions, which add descriptive phrases to capture non-spoken moments in dialogue, such as [gasp] or [applause]. These captions will be available throughout the system, including social media apps and video messages, to provide a more immersive experience for users.

Another significant update targets the Lookout app, which provides audio descriptions of photos and objects for people with low vision or blindness. Google is integrating its Gemini 1.5 model into the Image Q&A portion of the app, enabling it to offer more accurate and detailed descriptions of photos taken or opened with the app. This update is part of Google's ongoing effort to bring more AI features to Lookout, which was highlighted at I/O.

In addition to these accessibility-focused updates, Google is also expanding the capabilities of Gemini Assistant. The Spotify extension, which allows users to play music from Spotify through Gemini, marks a significant step towards feature parity between Gemini and the standard Google Assistant. Gemini will also gain access to the Utilities extension, enabling it to take more actions on behalf of users, such as making phone calls, sending emails, and changing phone settings.

Other notable features in this update include the ability to create stickers with Emoji Kitchen inside Gboard, share photos with a QR code in Quick Share, and an improved scanning mode for receipts and documents in Google Drive.

Pixel phone owners will receive additional features as part of the December feature drop, specifically designed for the Pixel 9 series. The call screening feature, for instance, will now offer contextual reply suggestions, allowing users to tap on a response to answer questions without picking up the call.

The Screenshots app on Pixel 9 phones will also receive several updates. Users will now have the option to save searches made with Circle to Search in the Screenshots app, which provides a convenient way to keep track of previous queries. Additionally, Gboard will offer suggested search phrases based on items saved to Screenshots, and users will be able to save tickets or credit cards added to Google Wallet with a screenshot in the Screenshots app.

Other features in the feature drop for previous-gen Pixel phones include Identity Check, which requires additional authentication if the phone detects it's in a new location and sensitive settings are being accessed. The update will start rolling out today for phones on Android 15 and Pixel 6 and newer phones.

Overall, this update demonstrates Google's continued commitment to enhancing the Android experience, particularly in the areas of accessibility and AI-driven features. As the tech giant continues to refine its Gemini Assistant and Lookout app, users can expect even more innovative features to emerge in the future.