How to use Visual Intelligence on your Mac in macOS 27, with two shortcuts

Macbook
Image: Apple

Press Command-Shift-Space bar to select a window, or Command-Shift-6 to drag across any part of the screen, and macOS 27 lets you ask Siri about what you captured. Both shortcuts work once Siri AI (Beta) is turned on, and they hand your selection to Visual Intelligence.

Apple M6 Mac Mini
Mac mini with M6. Siri AI in macOS 27 needs a Mac with M1 or later, or MacBook Neo. Image: Apple

That turns whatever is open on your Mac into something you can question: a web page, a document, a photo or a map. Apple’s Mac User Guide says Siri can ā€œtap into Visual Intelligence to ask questions, take action, and search based on what’s on your Mac screen.ā€

What your Mac needs

Apple’s guide sets the bar: Siri AI ā€œis available in beta on macOS 27 or later on an Apple Intelligence-enabled MacBook Neo (A18 Pro) or Mac model with M1 or later with Siri and device language set to a supported language. Available in English to start. Usage limits may apply.ā€

Don’t miss the best of The Mac Observer

Set us as a preferred source and our Apple reporting ranks higher in your Google Search results and Discover feed — one tap, no account changes.

Or get it by email

The limits are daily. Apple’s footnote says server-side features, Siri AI included, carry limits that vary ā€œby feature, request complexity, system demand, system policies, and other factors,ā€ and that expanded access will be available for a fee in the future. If you haven’t updated yet, check and back up your Mac before installing macOS 27.

To turn on Siri AI:

  1. Open the Settings app on your Mac.
  2. Click Siri in the sidebar. You may need to scroll down.
  3. If Siri is off, click Turn On Siri, then click ā€œTry Siri AI (Beta).ā€ If Siri is already on, click ā€œTry Siri AI (Beta).ā€
  4. Follow the onscreen instructions.
Compare MacBook Neo and M4 Mac mini at $599. Learn performance, portability, specs, and which Apple Mac fits your needs best.
MacBook Neo beside Mac mini. MacBook Neo's A18 Pro chip is on Apple's list for Siri AI on the Mac.

Capture a window or part of the screen

Pick the shortcut that matches what you want Siri to look at:

  • Command-Shift-Space bar selects a window. Use it when the whole window matters, such as an email with an event in it.
  • Command-Shift-6, then click and hold your mouse or trackpad to select a portion of the screen. Use it to isolate a single chart, photo or paragraph.

Apple’s macOS 27 release notes call the window shortcut Visual Intelligence’s ā€œdedicated keyboard shortcut,ā€ and give adding events to your calendar as an example of acting on what’s onscreen.

With a selection made, you have three choices:

  • Ask a question. Type into the Ask Siri field that appears. Apple’s example is ā€œWhat place is this and how do I get there?ā€
  • Take an action. Click one of the actions that appears. Select an image of a recipe, for example, then choose ā€œLook up nutritionā€ when it shows up.
  • Find similar images. Click Image Search to search the internet for pictures like the one you selected.

The actions depend on what you capture, so expect different options from one selection to the next.

Ask about an open window or files in the Finder

You don’t always need a capture. Activate Siri and ask about something already on your screen. Apple’s example is ā€œExplain this from my class notesā€ with a diagram open in the Notes app.

The Finder version is the most Mac-specific trick here. Select two documents, Control-click one of them, choose Ask Siri, then ask something like ā€œWhich quarterly report grew faster?ā€ It saves opening both files and comparing them yourself.

To keep going, Apple says to swipe down on Siri’s answer to start a conversation and ask follow-up questions, so you can refine an answer without starting again.

Control what Siri can see

You can choose which Siri features you can use, and which content Siri can access, in Screen Time settings. That helps on a shared family Mac, or on a work machine where some content should stay out of reach.

For everything else in the update, see our macOS 27 Golden Gate release coverage. If you’re weighing a new machine, our guide to every Mac Apple sells right now lists the chip inside each model.