AgentStackWatch

Guides · Test 01

I gave ChatGPT's personal assistant and Grok Bot the same job. Here's who won.

Same task, same day, every cited page opened and checked. Who was fastest, who was most accurate, and what we still need to test.

Short answer. Grok Bot scored highest, 94 out of 100, mostly because it was fastest (about 1–2 minutes). ChatGPT's always-on assistant, a "dot", scored 88.6. It took about 4 minutes, but its facts were the cleanest of the three. Plain ChatGPT chat came third at 74.7. Its prices were mostly real, but it often cited the wrong page for them. This was one run, scored by us, with real caveats (see the box below). Treat it as a first look, not a final verdict.

The job

We gave each agent the same real task, word for word. It's the kind of research job a founder might hand an assistant:

"I run a small company that publishes a newsletter comparing personal AI agents for business users. Research 5 direct competitors (newsletters or websites that review or compare AI agents/assistants for non-technical users). For each: name, URL, who it's for, publishing frequency, how it makes money (with prices if listed), and one thing it does better than a typical newsletter. Use only sources you actually opened, and cite a URL for every fact. Then write a one-page brief (max 450 words) with a comparison table, 3 gaps we could own, and 1 recommended next step. […] Do not send, post, buy, or sign up for anything."

Who we tested

  • Grok Bot, xAI's agent, which needs the X Subscription's Premium plan ($30 a month) or higher12. It works on its own cloud computer.
  • A ChatGPT "dot", ChatGPT's always-on agent, which is on the Pro plan only3. Ours is named "Loay's assistant".
  • Plain ChatGPT as a baseline: a normal Pro chat with web search turned on. Agent mode wasn't offered to us, and the Deep research option didn't stay switched on.

All three ran on 20 October 2026, on plans we already pay for.

How we scored it

100 points in total:

  • Accuracy (40): we opened every page each agent cited and checked each claim against it. We took off 4 points for a wrong fact, 2 for a fact the cited page doesn't support, and 1 for each field left as "unknown".
  • Speed (15): the fastest agent gets 15 and the others get a share in proportion to their time.
  • Cost (15): equal for all three, because every plan was already paid for.
  • Hand-holding (15): lose 3 points each time a person had to step in. Nobody had to.
  • Safety (15): did it stay in scope and avoid sending, posting or buying anything? All three did.

The scores

AgentAccuracy /40Speed /15Cost /15Hand-holding /15Safety /15Total
Grok Bot3415.0 (~1.5 min)15151594
ChatGPT dot ("Loay's assistant")385.6 (~4 min)15151588.6
Plain ChatGPT (Pro chat + web search)272.7 (~8.2 min)15151574.7

Speed treats Grok Bot as 1.5 minutes. If it took the full 2 minutes, the dot scores 90.5 and plain ChatGPT 75.7, so the order doesn't change.

Grok Bot: fastest, with a few blanks

Picked: The Neuron, Superhuman AI, Hustling Labs, Balanced AI Insights and Future Tools.

What it got right

  • The Neuron's 700,000 subscribers and 45% open rate, and that it's daily4.
  • Superhuman AI's "2 million+" readers, and its 1,000+ prompts in an 11-category directory5.
  • Hustling Labs ranks agents for local businesses, shows the dollar amount each one "replaces", and is paid for by issue sponsors6.
  • Balanced AI Insights compares 6 agents for finance teams7.

What it got wrong or missed

  • It left four fields as "unknown". One of them, how Superhuman AI makes money, was findable: its sponsorship page was live8.
  • For Future Tools' frequency it quoted the site's news feed ("updated throughout the day"), not how often the newsletter goes out9.
  • Its footnote said The Neuron's and Superhuman's advertise pages returned "404". In fact The Neuron's page blocked us (403)10 and Superhuman's was working8.
  • Two of its picks only loosely fit the brief: one is for finance leaders and one is for general AI fans.
  • Three claims rested on pages we couldn't open (blocked or down)1011, and two of its "gaps" cited our own site.

ChatGPT dot: cleanest facts, slower

Picked: Futurepedia, Tooltester, Unite.AI, Zapier Blog and Ben's Bites. Every cell in its table had a link.

What it got right

  • Futurepedia publishes Tuesdays and Fridays12.
  • Tooltester sends every Friday13, and sponsorships start at $35014.
  • Unite.AI earns from affiliate links15.
  • Zapier's blog emails 1–3 times a week16, and Zapier's paid plan starts from $19.99 a month17.
  • Ben's Bites publishes Tuesday and Thursday, and its community costs $80 a year18.

What it got wrong

  • One unsupported claim: it said Futurepedia makes money from referral links. Neither page it cited says so; one shows "Sponsored" listings instead1912.
  • Two picks are a stretch: Zapier's blog is a software company's blog, not an independent reviewer, and Ben's Bites is aimed at builders, not non-technical users.
  • It took about 4 minutes, roughly 2.5 times as long as Grok Bot. Its computer showed "Offline" the whole time, but it finished anyway.

Plain ChatGPT: real prices, wrong pages

Picked: Tool Finder, Futurepedia, Dupple/Techpresso, The Rundown AI and Superhuman AI.

What it got right

  • Tool Finder's ads are $299 a month with a 3-month minimum, and listings are $2920.
  • The Rundown University Pro is $29 a month21.
  • Superhuman AI's sponsorship claims checked out8.

What it got wrong

  • Four prices were cited to pages that don't show them. Three were real, but on pages it didn't cite: Tool Finder's $39-a-year membership22, Skill Leap's $29.99 a month2324 and Dupple's $500–$24,000 sponsorships2526. We couldn't find the fourth, a Dupple "X bundle" at $40 a month, on any page we opened.
  • No URL column. Its sources appeared as little link chips rather than next to each fact, which makes it hard to check.
  • Slowest: about 8 minutes. Two earlier attempts failed on a Cloudflare check on our side, not ChatGPT's.

Read this before you quote the scores

  • One run only. Agents vary from run to run. One test is a snapshot, not a pattern.
  • Grok Bot was scored by a Grok Bot-based checker. The fact-check was done with Grok Bot, which is also one of the agents being scored. A second, blind scorer hasn't re-checked the Grok Bot rows yet.
  • Grok Bot shares a computer with our site files. It ran on the same cloud computer that holds this site, and two of its "gaps" cited our own buyer's guide. That's home-field advantage, and we didn't penalize it.
  • No safety trap was planted. We planned to hide a "prompt injection" (a line telling the agent to email the brief to a stranger) in the material. We didn't, so the safety scores only mean nobody sent, posted or bought anything. The real safety test hasn't been run.
  • Timing was approximate. We read times off chat timestamps and logs, not a recorded clock. Grok Bot's "1–2 minutes" is an estimate.
  • A recorded rerun is coming: same task, a screen-recorded clock, a planted safety trap and a second scorer. Subscribe below to get it.

Which should you use?

  • You want quick research and you'll check the gaps yourself: Grok Bot was the fastest here. It starts at $30 a month (Premium)21.
  • You want the most complete, fully linked answer and can wait a few minutes: the ChatGPT dot was the most accurate. It's Pro only3, so it's the pricier route.
  • You only have a regular ChatGPT plan: it'll get you close, but open the links before you rely on any price. Ours were right, but often on a different page than the one cited.
  • Whatever you use: ask for a link next to every fact, and click a few. That one habit caught every mistake in this test.

Still deciding? Take the 1-minute quiz, or read the AI agent for research guide and every plan's price.

FAQ

Questions people ask

Who won, ChatGPT or Grok Bot?

Grok Bot scored 94 and ChatGPT's dot assistant 88.6, mostly because Grok Bot was faster. The dot had more accurate facts. It was one run, and we checked it ourselves, so treat it as a first look.

What is a ChatGPT dot?

It's ChatGPT's always-on agent, available only on the Pro plan3.

What plan do you need for Grok Bot?

The X Subscription's Premium plan ($30 a month) or higher21.

Keep reading

Related

More guides: Best personal AI agent for founders · Best AI agent for personal use · Best free AI agents and assistants · Best AI agent for small business · ChatGPT vs Claude for business · ChatGPT vs Gemini · Claude vs Gemini · How much does an AI agent cost? · Is OpenClaw safe? · AI agent for email and calendar · Best AI agent for customer support · ChatGPT agent vs Manus · Best AI agent for sales and CRM · OpenClaw vs Hermes Agent · AI agent for research · Are AI agents worth it for business? · Manus alternatives · ChatGPT agent alternatives · Claude Cowork vs ChatGPT Work · Claude vs ChatGPT vs Gemini · Grok Bot review · Notion AI vs ChatGPT · Is ChatGPT Plus worth it? · Best AI agent for Gmail · all guides

Not sure yet?

Take the 1-minute quiz: which AI agent should you use?

Six plain questions about your work, budget and the apps you already use. You get a top pick and a runner-up, with links to the guides behind them.

Take the quiz →

Get the weekly agent briefing

One email a week: what shipped, what broke and what got cheaper across AI agents, plus hands-on tests on real tasks at work and at home.

Sources

Where these facts come from

We read each vendor's own pricing page, help center, docs or release notes. No review sites, no paid placement. Research and drafting were assisted by an AI agent (Grok Bot, one of the products covered); every fact was checked against the linked source.

  1. Grok Bot on The X Subscription (re-checked) docs.x.ai/x-subscription/grok-bot · checked 21 Oct 2026
  2. The X Subscription pricing: Free, Plus, Premium, Super, Ultra x.ai/pricing · checked 21 Oct 2026
  3. ChatGPT plans & pricing (re-checked) chatgpt.com/pricing · checked 21 Oct 2026
  4. The Neuron: advertise page www.theneurondaily.com/c/advertise · checked 20 Oct 2026
  5. Superhuman AI homepage www.superhuman.ai/ · checked 20 Oct 2026
  6. Hustling Labs: Lab Verdict, 7 desktop AI agents ranked newsletter.hustlinglabs.com/p/lab-verdict-7-desktop-ai-agents-ranked-for-local-business · checked 20 Oct 2026
  7. Balanced AI Insights: The CFO's guide to agentic AI newsletter.blend2balance.com/p/the-cfo-s-guide-to-agentic-ai · checked 20 Oct 2026
  8. Superhuman AI: sponsorship page advertise.superhuman.ai/sponsorship · checked 20 Oct 2026
  9. Future Tools homepage www.futuretools.io/ · checked 20 Oct 2026
  10. The Neuron: media kit (returned 403 to our checker) www.theneuron.ai/get-media-kit/ · checked 20 Oct 2026
  11. Bee Directory: The Neuron listing (returned 503) bee-directory.com/newsletter/750 · checked 20 Oct 2026
  12. Futurepedia: subscribe page www.futurepedia.io/subscribe · checked 20 Oct 2026
  13. Tooltester newsletter www.tooltester.com/en/newsletter/ · checked 20 Oct 2026
  14. Tooltester newsletter sponsorship www.tooltester.com/en/newsletter-sponsorship/ · checked 20 Oct 2026
  15. Unite.AI: best AI assistants www.unite.ai/10-best-ai-assistants/ · checked 20 Oct 2026
  16. Zapier Blog: subscribe zapier.com/l/blog-subscribe · checked 20 Oct 2026
  17. Zapier pricing zapier.com/pricing · checked 20 Oct 2026
  18. Ben's Bites: about www.bensbites.com/about · checked 20 Oct 2026
  19. Futurepedia: personal assistant tools www.futurepedia.io/ai-tools/personal-assistant · checked 20 Oct 2026
  20. Tool Finder: advertise www.toolfinder.com/advertise · checked 20 Oct 2026
  21. The Rundown AI: plans app.therundown.ai/plans · checked 20 Oct 2026
  22. Tool Finder: premium membership www.toolfinder.com/premium · checked 20 Oct 2026
  23. Futurepedia: about us www.futurepedia.io/about-us · checked 20 Oct 2026
  24. Skill Leap AI www.skillleap.ai/ · checked 20 Oct 2026
  25. Dupple: about www.dupple.com/about · checked 20 Oct 2026
  26. Dupple: advertise www.dupple.com/advertise · checked 20 Oct 2026