Googles AI Mode can now view and search images

Google is adding multimodal capabilities to its search-focused AI Mode chatbot, allowing it to "see" and answer questions about images, while also expanding access to AI Mode to "millions" more users.

The update combines a custom version of Gemini AI with the company's Lens image recognition technology, allowing AI Mode Search users to take or upload a photo and receive "rich, comprehensive feedback with links" about the photo's content. The multimodal update to AI Mode is available starting today and can be accessed in the Google app on Android and iOS.

“AI Mode builds on our years of work on visual search and takes it even further,” said Robby Stein, VP of product at Google Search. “With Gemini’s multimodal capabilities, AI Mode can understand the entire context of an image, including the context of how objects relate to each other and their unique materials, colors, shapes, and arrangements . ”

Google says the update uses a “fan-out technique” that asks multiple queries about the images it sees and any objects in them, to provide “extremely nuanced and contextually relevant” responses . That allows it to do things like identify the books shown in images, make suggestions for similar titles with positive ratings, and answer questions to further compile recommendations.

Google's AI Mode can now view and search images
Google's AI Mode can now 'see' what you see to better assist with requests.

AI Mode for Google Search serves as a competitor to Perplexity and ChatGPT Search, a chatbot-like experience that responds to requests with AI-generated summaries pulled from everything in Google's search index.

AI Mode launched exclusively to Google One AI Premium subscribers last month, albeit only in Labs. Now, Google says it has started rolling out AI Mode to “millions” more Labs users in the US, not just paid AI Premium subscribers.

Leave a Comment

What Young Riders Should Know About Moving Their Motorcycles Across Cities

What Young Riders Should Know About Moving Their Motorcycles Across Cities

Long-distance travel can involve heavy traffic, changing weather conditions, and rider fatigue. If you are also dealing with the responsibilities of moving home, such as packing belongings or coordinating accommodation, a long ride may add unnecessary pressure to an already busy schedule.

Solving Microsoft Teams Shortcut Error Not Opening

Solving Microsoft Teams Shortcut Error Not Opening

Tired of Microsoft Teams shortcut error preventing you from opening the app? Follow our expert, step-by-step guide with the latest fixes for instant resolution. Works on Windows, Mac & web – no tech skills needed!

Solving Microsoft Teams Task Management Sync Error

Solving Microsoft Teams Task Management Sync Error

Tired of Microsoft Teams Task Management Sync Error halting your workflow? Follow our proven, step-by-step fixes to resolve sync issues fast and restore seamless task collaboration. No tech expertise needed!

Troubleshooting Microsoft Teams Wiki Error Formatting

Troubleshooting Microsoft Teams Wiki Error Formatting

Struggling with Microsoft Teams Wiki Error Formatting? This step-by-step guide reveals proven fixes for common wiki tab issues, ensuring smooth editing and collaboration in Teams. Get back to productive wikis fast!

How to Fix Microsoft Teams Installation Error for Linux

How to Fix Microsoft Teams Installation Error for Linux

Struggling with Microsoft Teams installation error on Linux? Discover step-by-step fixes for Ubuntu, Fedora & more. Resolve dependency issues, crashes, and errors quickly with our ultimate guide. Get Teams running smoothly today!

Solving Microsoft Teams Error Page Not Loading

Solving Microsoft Teams Error Page Not Loading

Struggling with Microsoft Teams "Error Page" not loading? Get step-by-step fixes for desktop, web, and mobile. Solve Microsoft Teams Error Page issues quickly and resume seamless teamwork today.

Solving Microsoft Teams Error Screenshot Issues

Solving Microsoft Teams Error Screenshot Issues

Tired of Microsoft Teams "Error Screenshot" blocking your workflow? Get proven, step-by-step solutions to resolve screenshot errors in Teams instantly and boost productivity. No tech skills needed!

How to Fix Microsoft Teams Error U User

How to Fix Microsoft Teams Error U User

Tired of Microsoft Teams "Error U" User blocking your chats? Get proven, step-by-step fixes to clear cache, reset, and restore seamless collaboration instantly.

Where are Microsoft Teams Registry Keys Located on Windows 11?

Where are Microsoft Teams Registry Keys Located on Windows 11?

Unlock the precise locations of Microsoft Teams registry keys on Windows 11. Step-by-step guide to find, access, and safely tweak them for optimal performance and troubleshooting. Essential for IT pros and Teams enthusiasts.

How to Fix Microsoft Teams Training Error Video Lag

How to Fix Microsoft Teams Training Error Video Lag

Tired of Microsoft Teams "Training Error" Video Lag ruining your meetings? Follow our step-by-step guide with the latest fixes for smooth video calls—no more frustration!