Microsoft is introducing AI agents that can change your Windows settings

midian182

Posts: 10,649   +142
Staff member
In a nutshell: Does the prospect of more AI features coming to Windows 11, including an agent that can adjust user settings at your request, fill you with excitement? Possibly not, but Microsoft is introducing them anyway. Copilot+ PCs will get the updates first, but the AI flood is also coming to traditional x86 systems.

The AI agents will initially arrive via the Windows Insider program for those using Copilot+ PCs. Microsoft writes that finding and changing settings on a PC are among the most common frustrations among users, so the feature allows you to use natural language to describe what you want to do or are looking for.

Some examples of this functionality include typing "how to control my PC by voice" or "my mouse pointer is too small," at which point the agent will recommend what steps to take to address the issue.

The agent will also ask users if they want the AI to make the changes on their behalf via an Apply button. Note that there is a disclaimer stating "Recommendations are AI-generated and may be incorrect."

Microsoft adds that the AI features are also coming to Windows Insiders using AMD- and Intel-powered devices soon after they debut for Insiders with Snapdragon-powered PCs.

It's unlikely that the tech-savvy will find much use for the AI agents, but the feature could admittedly be useful for those who still get lost trying to find certain settings or don't know what they're looking for. However, as the disclaimer warns, AI doesn't always get things right.

Away from agents, Microsoft is introducing other AI features to Windows 11. One of these is Click to Do, which offers the likes of copying text from an image, summarizing text, and quickly removing objects or the background from an image. More actions are rolling out in Click to Do, including the option to create a bulleted list from selected text.

There's also an interesting-sounding relight feature coming to the Photos app. It allows you to position up to three light sources in an image, set their color, and move a focus point that all lights automatically follow. There's also built-in presets with ready-made lighting styles for quick edits.

Elsewhere, the Snipping Tool is being updated so it captures what's on a screen more accurately and tightly, reducing the need for post-grab cropping. It also gets two new capture tools: one for extracting text directly from images and screenshots, and a color picker for capturing exact color values.

AI is even coming to File Explorer, allowing users to "interact more deeply with your files." Right-clicking on photos, videos, or other file types in Explorer will open up actions to perform on the files, such as summarizing content or editing.

Finally, there's Copilot Vision, which allows users to share any browser or app window with Copilot. This lets the tool read the screen and interact with the content. "You'll be able to use Copilot to search, change settings, organize files and collaborate on projects without switching between files or apps," Microsoft writes.

Permalink to story:

 
Oh great, just what we needed, Microsoft. Forcing everyone to upgrade their PCs just so we can ask an AI how to make the mouse pointer smaller, instead of, you know, Googling it in two seconds or navigating a simple settings menu.

Big thumbs up. You’ve really outdone yourselves this time.

Or, and here's a wild idea, you could focus on making system settings less bloated and actually user friendly. Because for a lot of people, especially those with accessibility needs, relying on AI just adds another layer of confusion instead of solving anything.
 
This will or should end up before the courts.

Gross overreach adjusting any settings of a professional's tools without informing them.. borderline dangerous in some cases where complex architectures may incorporate non-standard designs depending on the settings adjusted, but even forcing an unintended update to some app with strict vendor requirements could lead to contractual or license violations... or just unintended downtime and/or data loss.

But hey... wife says I sometimes I overreact.
 
Every week, MS makes me want to upgrade Win 10 with nagging.

Every week, MS makes me want to stay on Win 10 with new Win 11 AI bloat or creepiness.

(I use some Win specific software so I can't switch to linux)
 
Devil is always in the details.

If I dictate "Copilot turn on HDR" and it turns on HDR just as if I had pressed Win-Alt-B, then this seems like a basic convenience. I do similar on my iPhone all the time.

But if I dictate that same thing and it first turns on HDR and then switches my default browser to Edge because it plays streaming videos at higher resolution (actually true for >1080p displays), we're in much sketchier waters.

Based on the article sounds more like the former than the latter at least for now.
 
In theory: great, this can be useful.
In practice: let's give Microsoft another decade to see if they can figure out basic Windows search before I let you "AI Agent" mess with my settings.
 
Microsoft not yet satisfied by drilling it's users minds with:
- All it's adware like Edge, Copilot, etc.
- Changing every configuration menu to a new useless version.
- Trying to block every old menu that truly works.

Now it also has to change the settings by itself so u have to do the same work over and over again?

As an IT guy, getting to a funcitonal printer settings in Windows 11, 10 times per day is a nightmare, specially if the users doesn't have the admin rights.

Don't get me wrong, I love Windows, I just don't get why Microsoft hates us so much...
 
Back