Microsoft’s Copilot can now browse the web with you using AI ‘Vision’

Microsoft’s Copilot Vision: A New Era of Browsing

What is Copilot Vision?

Microsoft is starting to test its new Copilot Vision feature today, allowing its AI companion to see what you see on an Edge webpage you’re browsing. With Copilot Vision, you can ask it questions about the text, images, and content you’re viewing or use it to assist you.

How Does it Work?

When you enable Copilot Vision, it sees the page you’re on, reads along with you, and you can talk through the problem you’re facing together. Browsing no longer needs to be a lonely experience with just you and all your tabs. According to the Copilot team, "Browsing no longer needs to be a lonely experience with just you and all your tabs."

What Can You Do with Copilot Vision?

You can use Copilot Vision to:

• Ask questions about the text, images, and content you’re viewing
• Use it to assist you while shopping online to find product recommendations
• Even decipher hand-written recipes and offer up cooking tips

Is It Available?

Copilot Vision is currently only available to a limited number of Copilot Pro subscribers in the US, with plans to expand access to more Pro subscribers and websites "over time."

What About Security and Privacy?

Microsoft is taking its time with Copilot Vision, recognizing the potential privacy concerns around the new feature. "As we roll this out, Vision will only interact with a select set of websites to start," says the Copilot team. "Over time, we will cautiously expand this list. It’s important to stress that Vision does not capture, store or use any data from publishers to train our models. In short, we’re prioritizing copyright, creators, and our user’s privacy and safety — and are putting them all first."

Conclusion

With Copilot Vision, Microsoft is poised to revolutionize the way we browse the web, making it a more collaborative and assistive experience. As the feature expands to more Pro subscribers and websites, we can expect to see a more personalized and interactive browsing experience.

Frequently Asked Questions (FAQs)

Q: What is Copilot Vision?
A: Copilot Vision is a new feature from Microsoft that allows its AI companion to see what you see on an Edge webpage you’re browsing, allowing you to ask questions and get assistance.

Q: How do I get access to Copilot Vision?
A: Copilot Vision is currently only available to a limited number of Copilot Pro subscribers in the US, with plans to expand access to more Pro subscribers and websites "over time."

Q: Is Copilot Vision secure?
A: Yes, Microsoft is prioritizing security and privacy, ensuring that Copilot Vision does not capture, store, or use any data from publishers to train its models.