Microsoft has announced that its AI assistant feature, Copilot Vision, is now available for free use within the Edge browser. This opt-in feature allows users to utilize Copilot like an always-there web assistant, interpreting what's on their screen and providing helpful responses. The announcement was made by Mustafa Suleyman, CEO of Microsoft AI, on Bluesky.

Copilot Vision is a "talk-based experience," meaning users interact with it by speaking into the air and waiting for the AI to respond. According to Suleyman, if users opt into the feature, Copilot Vision can "literally see what you see on screen." This enables users to ask Copilot to guide them through tasks, such as following a recipe while cooking or decoding job descriptions to help with interview prep or cover letter brainstorming.

It's worth noting that Copilot Vision does not actually click links or perform actions on the user's behalf. Instead, it highlights relevant information on the screen to assist the user. Additionally, Microsoft assures that it logs Copilot's responses to users but does not collect user inputs, images, or page content. Users can stop sharing their screen with Copilot at any time by ending the session or closing the browser window.

While the free version of Copilot Vision is limited to the Edge browser, Copilot Pro subscribers can access broader, system-wide features. This includes the ability to ask Copilot to help with features in apps like Photoshop or video editing software, or guide users through games like Minecraft.

To try out Copilot Vision, users can open a specific link on Microsoft's website in the Edge browser, which will prompt them to opt-in to the feature. Once permission is granted, users can open the Copilot sidebar, click the microphone icon, and initiate a Vision session. However, some users may experience technical issues, as the author of the article did, highlighting the importance of a stable and powerful device to run the feature smoothly.

The expansion of Copilot Vision to the Edge browser marks a significant step in Microsoft's AI ambitions. As the tech giant continues to develop and refine its AI capabilities, it will be interesting to see how Copilot Vision evolves and integrates with other Microsoft products and services. With the AI landscape rapidly changing, Microsoft's move to make Copilot Vision more accessible could have significant implications for the industry as a whole.

As AI technology becomes increasingly prevalent in our daily lives, it's essential to consider the potential benefits and drawbacks of features like Copilot Vision. While AI assistants can undoubtedly enhance productivity and convenience, they also raise important questions about data privacy, security, and the potential for bias. As Microsoft and other tech companies continue to push the boundaries of AI, it's crucial that they prioritize transparency, accountability, and user trust.