Launch of long-awaited new product equipped with AI Siri Thanks to a partnership between Apple and Google, it looks like we’re getting even closer. company confirmed this week reports that many Siri features will be powered by Google’s Gemini model.

Announcement at WWDC 2024 and iPhone 16 ad now removed – And with the launch of Gemini Personal Intelligence, we now offer, in effect, an actionable preview…

Obtain personal information from the app

yesterday’s google Beta version started what is it called personal intelligence. The star feature here is Gemini’s ability to generate responses using a complex combination of sources, including personalized information pulled from the many Google apps and services you use.

Personal Intelligence can capture specific details from texts, photos, and videos in Google apps to customize Gemini’s responses. This includes your Google Workspace (Gmail, Calendar, Drive, etc.), Google Photos, YouTube watch history, and all the various Google search services you use (Search, Shopping, News, Maps, Google Flights, Hotels).

Of course, the Apple version pulls information from Apple apps like Mail, Calendar, Photos, and Notes.

Google Gemini Head josh woodward He gave an example of how personal intelligence helped him.

Two weeks ago, I needed new tires for my 2019 Honda minivan. I was standing in line at the store and realized I didn’t know the tire size. I asked Gemini.

You can find these tire specs on any chatbot these days, but Gemini has gone a step further. Inspired by a family road trip to Oklahoma in Google Photos, we suggested a variety of options for daily driving and all-weather use. Next, we properly extracted each rating and price.

When I got to the counter, I needed a license plate. Instead of looking for it or losing my spot in line back to the parking lot, I asked Gemini. It also helped me extract the 7-digit number from the photo in Photos and search Gmail to identify the specific trim of the van. Just like that, you’re ready to go.

Dealing with hallucination problems

Hallucinations are one of the biggest dangers in AI systems, and that risk clearly increases when an AI system tries to make inferences from your own personal data. Google says this new feature allows you to see exactly what assumptions are being made and provides an opportunity to verify or correct them.

You also don’t have to guess where the answer came from. Gemini will attempt to reference or explain the information it uses from connected sources for your verification. If not, you can ask for more information. If you feel the reaction is off, correct it on the spot (“Remember, I like window seats”).

There’s also an option to tell them to provide a new answer without personalizing it.

Privacy protection

Google says you have to opt in to Personal Intelligence, and it’s up to you to decide which apps to include.

App connectivity is turned off by default. You can choose to turn it on, decide exactly which apps you want connected to, and turn it off at any time.