On the finish of I/O, Google’s annual developer convention on the Shoreline Amphitheater in Mountain View, Google CEO Sundar Pichai revealed that the corporate had mentioned “AI” 121 occasions. That, primarily, was the crux of Google’s two-hour keynote — stuffing AI into each Google app and repair utilized by greater than two billion individuals all over the world. Listed here are all the most important updates from Google’s huge occasion, together with some further bulletins that got here after the keynote.

Gemini 1.5 Flash and updates to Gemini 1.5 Professional

Google introduced a model new AI mannequin referred to as Gemini 1.5 Flash, which it says is optimised for pace and effectivity. Flash sits between Gemini 1.5 Professional and Gemini 1.5 Nano, which its the corporate’s smallest mannequin that runs domestically on gadget. Google mentioned that it created Flash as a result of builders needed a lighter and cheaper mannequin than Gemini Professional to construct AI-powered apps and companies whereas preserving among the issues like an extended context window of 1 million tokens that differentiates Gemini Professional from competing fashions. Later this 12 months, Google will double Gemini’s context window to 2 million tokens, which signifies that it will likely be capable of course of two hours of video, 22 hours of audio, greater than 60,000 strains of code or greater than 1.4 million phrases on the similar time.

Venture Astra

Google confirmed off Venture Astra, an early model of a common assistant powered by AI that Google’s DeepMind CEO Demis Hassabis mentioned was Google’s model of an AI agent “that may be useful in on a regular basis life.”

In a video that Google says was shot in a single take, an Astra person strikes round Google’s London workplace holding up their cellphone and pointing the digicam at varied issues — a speaker, some code on a whiteboard, and out a window — and has a pure dialog with the app about what it appears. In one of many video’s most spectacular moments, the accurately tells the person the place she left her glasses earlier than with out the person ever having introduced up the glasses.

The video ends with a twist — when the person finds and wears the lacking glasses, we be taught that they’ve an onboard digicam system and are able to utilizing Venture Astra to seamlessly keep it up a dialog with the person, maybe indicating that Google is perhaps engaged on a competitor to Meta’s Ray Ban good glasses.

Ask Google Images

Google Images was already clever when it got here to looking for particular photographs or movies, however with AI, Google is taking issues to the subsequent degree. For those who’re a Google One subscriber within the US, it is possible for you to to ask Google Images a posh query like “present me the very best picture from every nationwide park I’ve visited” when the function rolls out over the subsequent few months. Google Images will use GPS data in addition to its personal judgement of what’s “finest” to current you with choices. You may as well ask Google Images to generate captions to put up the photographs to social media.

Veo and Imagen 3

Google’s new AI-powered media creation engines are referred to as Veo and Imagen 3. Veo is Google’s reply to OpenAI’s Sora. It will probably produce “high-quality” 1080p movies that may final “past a minute”, Google mentioned, and might perceive cinematic ideas like a timelapse.

Imagen 3, in the meantime, is a text-to-image generator that Google claims handles textual content higher than its earlier model, Imagen 2. The result’s the corporate’s highest high quality” text-to-image mannequin with “unbelievable degree of element” for “photorealistic, lifelike photographs” and fewer artifacts — primarily pitting it in opposition to OpenAI’s DALLE-3.

Massive updates to Google Search

Google is making huge adjustments to how Search basically works. A lot of the updates introduced right this moment like the power to ask actually complicated questions (“Discover the very best yoga or pilates studios in Boston and present particulars on their intro gives and strolling time from Beacon Hill.”) and utilizing Search to plan meals and holidays received’t be accessible except you decide in to Search Labs, the corporate’s platform that lets individuals check out experimental options.

However a giant new function that Google is asking AI Overviews and which the corporate has been testing for a 12 months now, is lastly rolling out to thousands and thousands of individuals within the US. Google Search will now current AI-generated solutions on high of the outcomes by default, and the corporate says that it’s going to carry the function to greater than a billion customers all over the world by the tip of the 12 months.

Gemini on Android

Google is integrating Gemini straight into Android. When Android 15 releases later this 12 months, Gemini will pay attention to the app, picture or video that you simply’re operating, and also you’ll have the ability to pull it up as an overlay and ask it context-specific questions. The place does that depart Google Assistant that already does this? Who is aware of! Google didn’t carry it up in any respect throughout right this moment’s keynote.

WearOS 5 battery life enhancements

Google is not fairly able to roll out the most recent model of it smartwatch OS, however it’s promising some main battery life enhancements when it comes. The corporate mentioned that Put on OS 5 will eat 20 % much less energy than Put on OS 4 if a person runs a marathon. Put on OS 4 already introduced battery life enhancements to smartwatches that help it, but it surely may nonetheless be so much higher at managing a tool’s energy. Google additionally supplied builders with a brand new information on learn how to preserve energy and battery, in order that they will create extra environment friendly apps.

Android 15 anti-theft options

Android 15’s developer preview might have been rolling for months, however there are nonetheless options to come back. Theft Detection Lock is a brand new Android 15 function that can use AI (there it’s once more) to foretell cellphone thefts and lock issues up accordingly. Google says its algorithms can detect motions related to theft, like these related to grabbing the cellphone and bolting, biking or driving away. If an Android 15 handset pinpoints one among these conditions, the cellphone’s display screen will rapidly lock, making it a lot more durable for the cellphone snatcher to entry your information.

There have been a bunch of different updates too. Google mentioned it will add digital watermarks to AI-generated video and textual content, make Gemini accessible within the facet panel in Gmail and Docs, energy a digital AI teammate in Workspace, pay attention to cellphone calls and detect for those who’re being scammed in actual time, and much more.

Make amends for all of the information from Google I/O 2024 proper right here!

Replace Might 15, 2:45PM ET: This story was up to date after being revealed to incorporate particulars on new Android 15 and WearOS 5 bulletins made following the I/O 2024 keynote.