"Share Your PC Screen Directly with AI: Gemini's Capabilities Now Run Natively on MacBook"

"Add the concert schedule displayed on the screen to Google Calendar."

While checking the reservation information page for an overseas artist's concert on a MacBook ahead of ticket sales, pressing the option key and the space bar together brought up the input window for the Gemini app. After turning on the window sharing feature and giving this request to Gemini, it responded, "Shall I create four events?" The app accurately recognized the three ticket reservation dates and the concert date displayed on the screen and then asked for the user's confirmation. When asked to add the events, both the reservation and concert schedules were immediately added to Google Calendar.

You can share the screen content through the Gemini app for macOS. Capture

원본보기 아이콘

This month, Google launched the Gemini app for macOS, Apple’s PC operating system. This is the first time the Gemini app has been released for PCs, in addition to smartphones.

Users can invoke Gemini at any time while doing other work by pressing the option key and space bar together. It is also possible to use Gemini by clicking the shortcut button in the menu bar at the top of macOS or by launching it from the app launcher. Previously, users had to access the Gemini web page separately through a web browser.

All the original functions of Gemini are available in the app version. You can search for information or give instructions via chat, and you can also attach images or documents stored on your PC to request tasks. The app continues to support generating desired images, videos, or music using Google’s image generation AI model, Nano Banana.

You can share the screen content through the Gemini app for macOS. Capture

원본보기 아이콘

The biggest differentiator of the macOS app is that you can share exactly what you see on your screen with Gemini. You can share the screen of any app, including web browsers like Safari and Chrome, as well as photos, messengers, and documents, and ask questions about them. You can ask Gemini to identify a photo posted on a web page or share a document screen and ask for a summary or translation. In work scenarios, if an Excel formula is not working as intended, you can share your screen to get help troubleshooting, or if there is an error during software development, you can share your code to identify the cause of the error.

Through this, you can also use limited Agentic AI features, where the AI performs actions on your behalf. For example, after sharing the contents of an email, message, or KakaoTalk conversation with the Gemini app, you can add events to Google Calendar based on that information. You can even send an email to the desired recipient via Gmail simply by conversing with Gemini. However, it cannot directly control your PC or operate your web browser. Currently, these limited AI agent features are available only for Google services such as Google Calendar, Gmail, and Drive.

The Gemini app must be downloaded from the official Gemini website, not the App Store, and is available on devices running macOS Sequoia (15.0) or later with Apple's own Apple Silicon chips.

Meanwhile, Gemini is also expected to be integrated into the next-generation Siri, which Apple plans to release in the second half of this year. In January, Apple signed an agreement with Google to build its next-generation AI foundation model based on the Google Gemini model and cloud technology.

© The Asia Business Daily(www.asiae.co.kr). All rights reserved.