“When you choose to enable it, Copilot Vision can see what you see and talk to you about it in real time,” says the Copilot team.
You’ll no longer need a Copilot Pro subscription, but it’s still part of Microsoft’s experimental Copilot Labs AI initiatives.
I haven’t been able to fully test Copilot Vision on Windows because Microsoft is limiting the experience to the US, but I did get a brief hands-on with it at Microsoft’s 50th anniversary event in April.
You can also use Copilot Vision on iOS and Android.
Update, June 12th: Article updated to reflect that Copilot Vision doesn’t require Copilot Pro.
Microsoft is introducing Copilot Vision for Windows today, an addition to its AI assistant that enables you to share your screen or apps so that Copilot can analyze the images and websites you are viewing or provide you with tutorials on how to use Adobe Photoshop features.
The Copilot team states that “Copilot Vision can see what you see and talk to you about it in real time when you choose to enable it.”. It serves as your second set of eyes, analyzing content, offering guidance when you need it, and responding to your inquiries along the way. “.”.
Similar to sharing your screen or apps during a Microsoft Teams meeting, Copilot Vision on Windows operates within the Copilot app and is activated by a glasses icon that allows you to choose which browser window or application you wish to share with the AI. Unlike Recall, which takes screenshots of your screen continuously once it is enabled, Copilot Vision is an opt-in experience that requires you to share your apps specifically for it to function.
I was given a quick hands-on experience with Copilot Vision at Microsoft’s 50th anniversary event in April, but I haven’t been able to fully test it on Windows because Microsoft is restricting the experience to the US. Copilot can guide you and provide answers by highlighting specific areas of your screen after you share an app. Additionally, Copilot Vision is compatible with iOS and Android.
The article was revised on June 12th to clarify that Copilot Vision is not dependent on Copilot Pro.
