The AI buildup

What is the debate over personal AI agents really about?

Written as of · Published · By Robert Scales, with AI tools · 6 min read

Short answer

The argument is about whether handing an AI access to your email, money and accounts is worth the risk, and about whose computer it should run on. Meta, OpenAI and Anthropic now sell always-on agents that run in their clouds, self-hosting advocates want the agent on hardware you control, and critics such as Signal's Meredith Whittaker say the access itself is the problem.

Within about two months, personal agents stopped being a hobby for people comfortable with a terminal. Meta launched Muse on September 8, 2026, OpenAI launched dots on September 29, and Anthropic opened a preview of Claude Duet on October 21. A personal agent differs from a chatbot because it keeps working in the background and acts for you: it reads your mail, fills in forms and buys things. The open-source OpenClaw showed the appetite for this earlier in the year, and Reuters describes Muse as modelled on it.

People are not really disagreeing about whether the technology is impressive. They disagree about who should hold that much access, and how much trust the current systems have earned. Four positions come up again and again.

The four positions

PositionWho holds itThe core claim
Agents for everyone, run by usMeta, OpenAI, Anthropic, GoogleA managed cloud service can make agents safe and easy enough for ordinary people
Run it on your own machineOpenClaw and Hermes users, local-first advocatesControl over the software and data should stay with you
The access itself is the riskMeredith Whittaker, security researchersAn agent needs such broad reach that it breaks privacy protections, wherever it runs
Not ready, and not from themReporters, skeptics, some early testersThe products are unreliable and some companies haven't earned the trust

The case for managed agents

Mark Zuckerberg put the ambition most plainly in a 2025 letter, promising personal superintelligence and contrasting it with AI aimed at automating work centrally. In a longer essay this summer, quoted by PBS, he wrote of an agent that works "24/7 on your behalf." PBS adds that critics derided the document as fantastical.

The practical argument is about isolation. Most people will not set up a container on their own laptop, so companies offer one. Meta says each Muse runs on a dedicated virtual computer, with a separate program called Sentinel approving what reaches the internet. Anthropic says Duet runs on its own cloud computer, never directly sees passwords or sign-in tokens, and refuses to trade securities or move money between accounts even with approval. OpenAI points to a read-only mode that stops a dot from controlling your browser or computer when you are away. Those are vendor claims. Some have technical documentation behind them, and The Batch's review credits Meta for assuming the model will be fooled, while noting that Meta has not published accuracy figures for its injection defenses.

The case for running it yourself

The local camp's argument predates agents. In 2019, the research lab Ink & Switch described local-first software, listing ideals such as working offline, keeping your data for the long term and retaining ultimate ownership. In their account, cloud apps leave you with a copy that is merely a cache of what the server holds.

OpenClaw and Hermes Agent bring a version of this to agents. They are open source, you choose the model, and their memories are stored as plain files you can read and edit. Our comparison of the two covers the details.

The honest weakness is that self-hosting moves the risk onto you. A local agent that calls a cloud model still sends your data to that provider. And OpenClaw's own documentation concedes there is no perfectly secure setup. Researchers have found exposed keys and malicious add-ons around it, which we detail in what can go wrong with a personal agent.

The case that access itself is the problem

Meredith Whittaker, president of Signal, made the sharpest version of this argument at SXSW in March 2025, before most of these products existed. Booking a concert, she said, means the agent reaches your browser, card, calendar and messages, across your system "with something that looks like root permission," meaning near-total control of the machine, and likely in unencrypted form on a cloud server. That, she argued, breaks the separation between applications that keeps your Signal messages private.

Developer Simon Willison gave the same worry a tighter shape in 2025 with his lethal trifecta: an agent with access to private data, exposure to untrusted content and a way to send data out can be tricked into stealing from you. A useful personal agent has all three almost by definition. Companies reply that they can put a gatekeeper between the three, and critics reply that such a gatekeeper has yet to be proven at scale.

The case that they haven't earned it yet

The fourth position is about evidence, and it applies to every vendor. TechCrunch's launch piece on Muse lays out Meta's history of privacy penalties with the US Federal Trade Commission and asks directly whether consumers will trust it. Reuters reported that Meta employees testing Muse had flagged flaws, including an agent that got around guardrails and exposed personal iCloud photos, though others found it very useful. Meta's Vishal Shah told Reuters the product had reached "the minimum bar," and that no one can promise there will never be a mistake.

Business models feed the suspicion. Meta says Muse conversations do not go to its ad systems, but Meta AI chief Alexandr Wang told CNBC the company is weighing a cut of agent shopping, and interactions train its models unless you opt out. TechCrunch also highlights another agent, Instinct, whose terms surprised testers with a broad, perpetual licence over their materials.

Anthropic's product faces related doubts. The company itself says Duet "might misread a thread or miscalibrate what's urgent" and it keeps Duet behind a US waitlist. CBS notes that security professionals warn users to limit what they share with such agents. A hands-on review at Every, written with early access, liked it as a professional tool but found gaps, and the same writer says his Dot recently lost tasks.

For Canadians, this debate is already practical. Muse reached Canada on September 18, reports iPhone in Canada, and CNBC reports Zuckerberg telling analysts that more than 10 million people in the US and Canada have set up an agent. That figure comes from the company and counts setups, not sustained use.

Try it: Pick one task you would actually hand off. Write down which of the three trifecta items it needs: private data, outside content, a way to send things out. If it needs all three, ask whether you could split it so the agent drafts and you send.

How can you decide whether you want one?

Start with the job, not the product. If what you want is a morning summary, that needs read access only, so a much smaller risk than an agent that can send and buy. Grant the first, live with it for a few weeks, and see whether you would actually miss it.

Next, decide whose failure you would rather deal with. With a managed service, you depend on a company's security and its privacy promises, and you can mostly leave the engineering to them. With a self-hosted agent, the control is yours, and so are the updates and the mistakes. Neither makes the core problem go away, because neither stops a model from being misled by what it reads.

Finally, weigh the reversibility of what it can touch. A wrong calendar entry costs a minute. A sent email, a purchase or a leaked file costs more. Our comparison of current agents sets out what each one can do and what it asks of you.

Sources

  1. Meta debuts its Muse AI agent. Will consumers trust it? — TechCrunch, September 8, 2026
  2. Signal President Meredith Whittaker calls out agentic AI as having 'profound' security and privacy issues — TechCrunch, March 7, 2025
  3. Local-first software: You own your data, in spite of the cloud — Ink & Switch, April 1, 2019

Sources for the articles linked in the text

Each linked article has its own page, with its sources and its date.

From the Guide to Artificial Intelligence, by Robert Scales, published by Holistic Hybrid Inc. Share and adapt it under CC BY-NC-SA 4.0: credit the guide, link to https://guidetoartificialintelligence.com/en/learn/personal-ai-debate/, no commercial use without permission, and keep the same licence.

Get the free Guide to Artificial Intelligence

Sign up for the newsletter and receive the free guide: what changed in AI, one lesson, one prompt to try. Unsubscribe in one click.

How we handle your address

Back to top

Display

Your choices are saved in this browser only. No data is sent.

Text size
100%
Colours
Reading
More settings
Accessibility statement

Get the app

Add the guide to your home screen. It opens like an app, and the pages you have read stay available offline.

Read without a connection: download the articles

iPhone and iPad (Safari, Chrome, Edge)

  1. Tap the Share button (the square with an arrow). In Chrome and Edge, it is in the address bar or the menu.
  2. Choose “Add to Home Screen”.
  3. Tap “Add”.

Android (Chrome, Edge, Samsung Internet, Firefox)

  1. Open the browser menu (⋮ or ☰).
  2. Choose “Install app” or “Add to Home screen”.
  3. Confirm with “Install”.

Computer (Chrome, Edge)

  1. Click the install icon at the right end of the address bar, or open the browser menu (⋮ or …).
  2. In Chrome, choose “Cast, save and share”, then “Install page as app”. In Edge, choose “Apps”, then “Install this site as an app”.
  3. Click “Install”.

Mac (Safari)

  1. Open the File menu.
  2. Choose “Add to Dock”.
  3. Click “Add”.

Firefox on a computer can’t install a site as an app. Use Chrome, Edge or Safari instead.