Google Lens with Gemini AI Now Helps You Repair Broken Gadgets

Earlier this year at I/O 2024, Google unveiled a new Lens feature powered by multi-modal generative AI technology. This capability, called “Ask With Video,” enables users to ask questions using video, and it is now being rolled out to Android and iOS devices, enhancing the functionality of Google Lens.

Google’s “Ask with Video” Feature

According to Google, the “Ask with Video” feature in Lens will be useful for troubleshooting gadgets. In a demo, Google demonstrated how this feature can help users troubleshoot a malfunctioning old record player without needing to conduct multiple complex web searches.

Depending on the query, Google search results will provide an AI-generated overview with a potential answer, along with links for more detailed information. The “Ask with Video” capability in Lens is powered by Google’s advanced speech model, deep visual understanding, and a custom Gemini model that operates in the cloud.

When you pose a query, a custom Gemini model operating in the cloud analyzes the video frame-by-frame to generate relevant search results. This process occurs in just a few seconds, significantly faster than manual searches, which could take minutes to yield accurate results. In testing various scenarios, the results from Google Lens proved to be nearly precise.

Google Lens and Apple’s Visual Intelligence

This feature is particularly valuable for do-it-yourself (DIY) enthusiasts looking to troubleshoot or repair gadgets independently.

Google Lens is available as a dedicated app for Android smartphones, while iPhone users can access it through the Google app since there is no standalone Lens app for iOS. Additionally, Apple is introducing a similar feature called Visual Intelligence for iPhones, allowing users to ask questions by holding down the camera capture button.

Google Lens is available as a standalone app on Android devices and can also be accessed through the Google app on iOS. It aims to provide a seamless way for users to interact with the world around them using visual information.

Follow Wat-Not on Facebook, Twitter, and Instagram