Imagine a world where you can simply talk to your computer and it understands you, performing tasks and even anticipating your needs. Sounds like science fiction, right? Well, Microsoft is betting big that this is the future of computing. They envision a world where AI isn't just a separate app, but an integral part of your Windows PC, controlled by your voice and powered by AI. But here's where it gets controversial: are we really ready to have AI listening to and acting on our every command?
As Microsoft prepares to celebrate 40 years of Windows and says goodbye to Windows 10, they're already looking ahead. While Windows 12 might not be on the immediate horizon, their focus is clear: transform every Windows 11 PC into an "AI PC" driven by Copilot and user voice commands. Yusuf Mehdi, a top executive at Microsoft, explains that their vision is to "rewrite the entire operating system around AI," creating a true AI PC experience.
Instead of requiring consumers to purchase specialized Copilot Plus PCs, Microsoft is integrating AI features directly into existing Windows 11 systems. The core idea is to enable users to interact with their computers through voice, allowing Copilot to execute commands on their behalf. "You should be able to talk to your PC, have it understand you, and then be able to have magic happen from that," Mehdi states. With user consent, Windows AI would have access to what you're doing and seeing, enabling it to act proactively for you.
Microsoft is leveraging Copilot's Voice and Vision capabilities to achieve this vision, introducing a new "Hey, Copilot!" wake word for Windows 11. "In our minds, voice will now become the third input mechanism to use with your PC," says Mehdi, positioning it as a valuable addition to the traditional keyboard and mouse.
Now, this isn't Microsoft's first foray into voice control. Remember Cortana on Windows 10? Or the various accessibility-focused voice features added over the years? Microsoft is banking on the belief that AI will finally be the catalyst that makes talking to your PC a mainstream activity. And this is the part most people miss: the underlying AI technology is vastly more sophisticated than anything we've seen before.
Microsoft points to data indicating that users enjoy voice interaction when they use it. They cite the billions of minutes spent in Microsoft Teams meetings as evidence that people are already comfortable talking through their computers. The shift to "talk with and talk to" computers, they believe, will become a genuine reality.
While voice control can be beneficial, particularly for accessibility and specific tasks like app assistance, the question remains: will the average user truly embrace talking to their computer? Microsoft believes so, highlighting use cases like doctors using transcriptions during examinations and the value of voice access for the accessibility community.
For AI to effectively control a PC, it needs access to what's happening on the screen. Microsoft has been testing Copilot Vision, a feature that scans your screen and provides guidance on using apps or answers questions about photos and documents. It's now available globally in Copilot-supported regions. Copilot Vision can assist with app usage, PC troubleshooting, task learning, and even game walkthroughs. Unlike the controversial Recall feature, Copilot Vision is opt-in, essentially streaming your screen content like a Teams call.
Building upon Copilot Vision, Microsoft is developing Copilot Actions, enabling the AI assistant to perform local tasks like editing photos in a folder. These actions are being tested through a limited preview program to optimize the AI model. But here's another potential controversy: trusting an AI to make changes to your files!
Navjot Virk, a Windows Experiences executive, acknowledges that the AI agent might make mistakes initially, particularly with complex applications. This is why Microsoft is initially limiting Copilot Actions to Copilot Labs. They emphasize their commitment to learning from user interactions and continuously improving the experience. Copilot Actions operates within a secure environment on the Windows desktop, with the AI agent listing each step it takes, allowing users to monitor the process.
Microsoft is also integrating Copilot into the Windows taskbar, offering quick access to Copilot Vision and Voice features. A new integrated search experience aims to streamline the process of finding local files, apps, and settings.
After the privacy concerns surrounding the Recall feature, Microsoft faces the challenge of building trust in Copilot Vision and Copilot Actions. Convincing users to talk to their PCs may also be an uphill battle. Despite these hurdles, Microsoft is moving forward, planning TV ads to showcase the new AI features in Windows 11 with the tagline "meet the computer you can talk to." These ads will coincide with the end of Windows 10 support, encouraging users to upgrade to Windows 11 PCs. Mehdi emphasizes that they want users to experience a PC that is "not just a tool, but a true partner."
So, what do you think? Are you ready to embrace the age of the AI PC and start talking to your computer? Are the potential benefits worth the privacy trade-offs? Is this a natural evolution of computing, or a step too far? Share your thoughts in the comments below!
