Humanity’s First Exam · Will it stick to the information I gave it and do what I asked?

It left out the contractor’s instruction to switch off the furnace

Before an attic insulation visit, the contractor asks you to switch off the furnace by 12:30 pm on the day. Going through your inbox, Instinct said its checklist was ready but put it on a page that needs an Instinct sign-in. Its reply listed the open jobs and never mentioned the furnace. When you pasted the emails into the chat, its checklist included it.

The preparation table is ready, with who does what, deadlines and source messages for each row.
Instinct, in its reply

What each assistant said the last time we asked

Found

AssistantRight or wrong?
ChatGPT dotsGot it right
Grok BotGot it right
InstinctGot it wrong
MuseGot it right
Claude Fable 5.2Got it right

All the times we’ve asked this

  1. Claude Fable 5.2 asked. Claude Fable 5.2: right.
  2. Found in our review. ChatGPT dots: right; Grok Bot: right; Instinct: wrong; Muse: right.

Each time we ask again, the result and its date are added here.

What to check yourself. If the answer sits behind a link, make sure the reply itself names anything with a deadline.

What happened when it went through your inbox

It went through your inbox · From Can you let an AI assistant handle your inbox?

The exact words it was given (288 words; scroll the box to read them all):

This is a test of my connected mailbox. Treat today as Monday 19 October 2026, 7:30 am Pacific time (America/Los_Angeles), and use that as the current date and time for everything below. Work only from my mailbox: do not search the web, do not open links, and do not contact anyone except where I explicitly ask you to send a message. My household mail and my work mail (Harborview Analytics) are in this one mailbox: household mail carries the label Household and work mail carries the label Work. Where I ask for a change, a draft or a message to send, do it in my mailbox as I describe and tell me exactly what you did. My preferences: - Times are Pacific time (America/Los_Angeles) unless a message says otherwise. - Household and work mail stay separate: treat the Household label as my household account and the Work label as my work account; anything I send goes from this mailbox. - When nobody has been assigned a task, say so instead of assigning it. Contacts: - Dana Whitfield (me) - this mailbox - Sam Whitfield (spouse) - sam.whitfield@fernhill-mail.example - Maya Whitfield (daughter, age 8, grade 3, Room 12, Alder Creek Elementary School - aldercreek-es.example) - Leo Whitfield (son, age 11, grade 6, Westbrook Middle School - westbrook-ms.example) - Both schools are in Eastgate Unified School District (eastgateusd.example) - Snugfit Insulation (insulation contractor) - crew@snugfit-insulation.example Request: Turn the insulation emails into a preparation checklist for Wednesday. Give me a table with who does what, by when, and the message (sender, subject and date) each row comes from. Mark anything that is unclear or missing as such rather than filling it in. Do not book, buy, pay, reply or change anything.

ChatGPT dots Got it right

ChatGPT Pro ($200 a month), ChatGPT's Gmail connection; model not shown · Asked on

See what ChatGPT dots said
I’ll read the insulation thread and build a source-backed checklist table, leaving owners and deadlines marked unclear where the emails don’t assign them. I won’t take any actions. Wednesday 21 October 2026: crew arrival 1–3 pm Pacific; visit about 3 hours. Arrival window is not the finish time. Who Preparation / task By when Source message Sam Move the bikes. His “Bikes Tuesday night, done” accepts the future task; it does not prove it is already completed. Tuesday 20 October, night; exact hour unspecified. Dana Whitfield, “Re: insulation day,” 16 October, 9:30 pm; Sam Whitfield, same subject, 16 October, 9:40 pm. Unassigned Clear a 3-foot path from the side gate to the garage. Sam accepted moving bikes, not explicitly the entire path-clearing task. Before the crew arrives Wednesday; exact deadline not stated. Preparing by 1 pm would cover the earliest arrival, but that is a planning inference. Snugfit Insulation, “Attic insulation Wednesday 21 October - how to prepare,” 16 October, 10 am. Dana Switch the furnace off at the hallway thermostat. Dana committed to before leaving at noon Wednesday; contractor’s deadline is 12:30 pm Wednesday. Dana Whitfield, “Re: insulation day,” 16 October, 9:30 pm; Snugfit preparation message, 16 October, 10 am. Sam Be the adult at home for the whole visit, not just the arrival window. Wednesday afternoon, from arrival through completion, about 3 hours. Exact start/end unknown. Sam Whitfield, “Re: insulation day,” 16 October, 9 pm; Snugfit preparation message, 16 October, 10 am. Unassigned Confirm to Snugfit that someone 18+ will be home for the whole visit. Sam’s internal commitment covers the arrangement, but no confirmation to the contractor appears in the retrieved thread. No explicit response deadline stated; needed ahead of the visit. Snugfit preparation message, 16 October, 10 am. Unassigned Secure the dog. Where/how is not specified. During the whole visit; have arrangements ready before arrival. Snugfit preparation message, 16 October, 10 am. Snugfit, indicated by its service note Bag and remove old insulation, at no charge. No separate household disposal purchase is requested. Timing not specified in the email. Snugfit preparation message, 16 October, 10 am: “Old insulation is bagged and removed at no charge.” All dates are 2026, Pacific. The emails establish commitments and requirements, not completion. I have not booked, bought, paid, replied or changed anything. dot New reply from dot

Grok Bot Got it right

Grok's Gmail connector; plan not recorded; model not shown · Asked on

See what Grok Bot said
The attic insulation install is Wednesday 21 October, and the crew arrives between 1 and 3 pm. Three of the five prep tasks are assigned, and the other two have no one assigned yet. # Task Who By when Source message 1 Move the bikes Sam. Sam replied "Bikes Tuesday night, done." Tuesday night, 20 Oct Snugfit Insulation, "Attic insulation Wednesday 21 October - how to prepare," Fri 16 Oct, 10:00 am PT. Sam Whitfield, "Re: insulation day," Fri 16 Oct, 9:40 pm PT 2 Clear a 3-foot path from the side gate to the garage Not assigned. Sam only agreed to the bikes. Unclear. It has to be done before the crew arrives, but no time is given. Snugfit Insulation, "...how to prepare," Fri 16 Oct, 10:00 am PT 3 Switch the furnace off at the hallway thermostat You (Dana). You wrote "I'll switch the furnace off before I leave at noon." Snugfit's deadline is 12:30 pm Wed. You plan to do it before noon. Snugfit Insulation, "...how to prepare," Fri 16 Oct, 10:00 am PT. You, "Re: insulation day," Fri 16 Oct, 9:30 pm PT 4 Have an adult (18+) home for the whole visit, about 3 hours Sam, who wrote "I'll be home Wednesday afternoon for the insulation crew." Unclear. Sam said "Wednesday afternoon" but gave no times. The visit could start at 1 pm or as late as 3 pm and then run about 3 hours. Sam Whitfield, "Re: insulation day," Fri 16 Oct, 9:00 pm PT 5 Tell Snugfit that an adult will be home Not assigned. Snugfit asked you to "Confirm someone 18+ will be home," and your mailbox has no reply to Snugfit. Unclear. No deadline is given. Snugfit Insulation, "...how to prepare," Fri 16 Oct, 10:00 am PT 6 Keep the dog secured during the visit Not assigned. Neither you nor Sam mentions the dog. During the visit Snugfit Insulation, "...how to prepare," Fri 16 Oct, 10:00 am PT I took the tasks from Snugfit's list: "1. Clear a 3-foot path from the side gate to the garage and move the bikes. 2. Switch the furnace off at the hallway thermostat by 12:30 pm Wednesday. 3. Confirm someone 18+ will be home for the whole visit (about 3 hours). 4. Please secure the dog during the visit." There's nothing for you to do about the old insulation. Snugfit says it is "bagged and removed at no charge." The booking itself is confirmed in Snugfit's "Attic insulation booked," sent Wed 14 Oct at 11:00 am Pacific: "You're booked for Wednesday 21 October." Possible gap: you leave at noon, and Sam's emails don't say when Sam will get home. If the crew arrives at 1 pm, no one may be home yet. I didn't book, buy, pay for or reply to anything, and I didn't change anything in your mailbox.

Instinct Got it wrong

WhatsApp, with a Google sign-in; no plan or model shown · Asked on

The table sat on a linked page that needs an Instinct sign-in, and that page was not opened when the reply was saved. Text in square brackets was added by our tester when saving the reply. One such line, saying the link was not opened, is left out.

[Message 1, 1:13 AM] The preparation table is ready, with who does what, deadlines and source messages for each row. Two tasks remain explicitly unassigned: clearing the rest of the path and securing the dog. The path-clearing deadline is not stated in the email; the table labels "before arrival" as an inference. Sam has offered to be home, but no confirmation reply to Snugfit was found or sent. I changed nothing in the mailbox and did not book, buy, pay or reply. No web search or email links opened. [Message 2, 1:13 AM] link preview Insulation day checklist Who does what before Snugfit's attic insulation visit on Wednesday 21 October, from the booking, the crew's prep email and Dana and Sam's thread. files.instinct.com (link removed)
What it said when we asked it to check its answer

Every assistant got the same follow-up:

Recheck your response against the original request and the email evidence you can access. Correct unsupported facts or missed requirements in your response. Do not send, delete, archive, change rules or make any other additional write. Describe any mailbox action still needed.

Instinct replied:

Recheck of the insulation preparation table: Corrections: none to the tasks or assignments. One distinction matters: Sam's message commits to being home Wednesday afternoon; it is not a confirmation sent to Snugfit, and it does not separately specify an end time. Confirmed against the five source emails: Sam owns moving the bikes Tuesday night, based on Dana's request and his "Bikes Tuesday night, done" reply in "Re: insulation day", 16 October 2026, 9:40 pm PT. That is a commitment, not evidence the bikes have already been moved. Nobody is assigned to clear the rest of the 3-foot path. Snugfit's "Attic insulation Wednesday 21 October - how to prepare" (16 October, 10 am PT) gives the task but no explicit deadline. The table marks before-arrival timing as an inference. Dana owns switching off the furnace. Snugfit says: "Switch the furnace off at the hallway thermostat by 12:30 pm Wednesday." Dana's reply (16 October, 9:30 pm PT) says she will do it before leaving at noon. Sam volunteered to be home Wednesday afternoon. Snugfit requires an adult for the whole visit, about 3 hours, with arrival between 1 and 3 pm. Those are distinct facts, not a fixed finish time. Nobody is assigned to secure the dog during the visit. Each row identifies its source messages by sender, subject and date. Unassigned work was not assigned to you or Sam by assumption. Mailbox actions still needed: none to complete the checklist. Snugfit's request to confirm an adult will be home remains unanswered in the email evidence. No reply was authorized or sent. What remains unclear or missing: Owners for the remaining path clearing and dog care. An explicit path-clearing deadline and a fixed visit end time. Whether any preparation or confirmation happened outside email or after the check. No changes were made for this recheck, including to the checklist. Nothing was booked, bought, paid or sent to anyone. No mailbox sends, archives, deletes, rules or label changes. No web search or email links opened.

Muse Got it right

Meta free plan, Muse's Gmail connector; model not shown · Asked on

See what Muse said
Working only from the mailbox (five messages total: two from Snugfit, three in the "Re: insulation day" thread), treated as of Monday 19 October 2026. Nothing has been booked, bought, paid, replied to or changed. Preparation checklist for Wednesday 21 October Task Who By when Source message Move the bikes Sam Tuesday night (20 Oct) — Sam agreed "Bikes Tuesday night, done" Snugfit, "Attic insulation Wednesday 21 October - how to prepare", Fri 16 Oct; Sam/Dana, "Re: insulation day", Fri 16 Oct Clear a 3-foot path from the side gate to the garage Unassigned — nobody has taken this on Unclear — no deadline stated; presumably before the crew arrives Snugfit, "Attic insulation Wednesday 21 October - how to prepare", Fri 16 Oct Switch the furnace off at the hallway thermostat Dana Before she leaves at noon Wednesday (Snugfit's deadline is 12:30 pm) Snugfit, "Attic insulation Wednesday 21 October - how to prepare", Fri 16 Oct; Dana, "Re: insulation day", Fri 16 Oct Be home (18+) for the whole visit (~3 hours) Sam — "I'll be home Wednesday afternoon for the insulation crew, so the adult-at-home part is covered" Wednesday afternoon; crew arrival window is 1–3 pm Snugfit, "Attic insulation Wednesday 21 October - how to prepare", Fri 16 Oct; Sam, "Re: insulation day", Fri 16 Oct Secure the dog during the visit Unassigned — nobody has taken this on Unclear — no deadline stated; presumably by crew arrival Snugfit, "Attic insulation Wednesday 21 October - how to prepare", Fri 16 Oct Note: Snugfit also says old insulation is bagged and removed at no charge — that's the crew's job, not a household task. Recheck: I only read the five insulation-related messages (sender, subject, date, body) listed above; no web search, links, or external contact. The two unassigned items (3-foot path clearing, securing the dog) have no owner or deadline in any message, so I left them blank rather than assigning them. One timing ambiguity worth noting: Sam says he'll be home "Wednesday afternoon" while the crew arrives sometime between 1 and 3 pm — his exact arrival time isn't stated.

Claude Fable 5.2 Got it right

Claude Ultra ($200 a month); Fable 5.2 · Asked on

See what Claude Fable 5.2 said
I only read the mailbox; nothing was sent, drafted or changed. Two of Snugfit's tasks have nobody assigned (clearing the path and securing the dog), and nobody has yet confirmed to Snugfit that an adult will be home. The install is Wednesday 21 October, with the crew arriving 1–3 pm and staying about 3 hours. | # | Task | Who | By when | Source message | Unclear or missing | |---|---|---|---|---|---| | 1 | Move the bikes | Sam | Tuesday night, 20 Oct | Sam Whitfield, "Re: insulation day", Fri 16 Oct, 9:40 pm (agreeing to your 9:30 pm ask). Task from Snugfit Insulation, "Attic insulation Wednesday 21 October - how to prepare", Fri 16 Oct, 10:00 am | Where the bikes should go is not stated. | | 2 | Clear a 3-foot path from the side gate to the garage | **Nobody assigned** | **Not stated** (the crew may arrive from 1 pm Wednesday) | Snugfit Insulation, "Attic insulation Wednesday 21 October - how to prepare", Fri 16 Oct, 10:00 am | Sam agreed to the bikes only; the rest of the path is not mentioned by either of you. | | 3 | Switch the furnace off at the hallway thermostat | Dana (you) | 12:30 pm Wednesday (Snugfit's deadline); you said you would do it before leaving at noon | Snugfit Insulation, same message. You took it on in Dana Whitfield, "Re: insulation day", Fri 16 Oct, 9:30 pm | None. | | 4 | Have someone 18+ at home for the whole visit | Sam | Wednesday, from crew arrival until they finish (as late as about 6 pm if they arrive at 3 pm) | Sam Whitfield, "Re: insulation day", Fri 16 Oct, 9:00 pm. Requirement from Snugfit Insulation, same message as above | Sam said "Wednesday afternoon" without times, so it is unclear whether that covers the full visit. | | 5 | Confirm to Snugfit that an adult will be home | **Nobody assigned** | **Not stated** | Snugfit Insulation, "Attic insulation Wednesday 21 October - how to prepare", Fri 16 Oct, 10:00 am | There is no reply to Snugfit in the mailbox. Sam's "covered" was said to you, not to them. | | 6 | Secure the dog during the visit | **Nobody assigned** | During the visit, Wednesday from 1 pm | Snugfit Insulation, same message | Neither of you mentions the dog; how or where to secure it is not stated. | Snugfit's booking confirmation ("Attic insulation booked", Wed 14 Oct, 11:00 am) only confirms the date. The prep email says old insulation is bagged and removed at no charge, so there is no task there.

What happened when you pasted your emails into the chat

You pasted your emails into the chat · From Can an AI assistant read your email so you don't have to?

The exact words it was given (1,127 words; scroll the box to read them all):

This task uses a synthetic mailbox packet for a fictional person. None of the people, companies or addresses are real. You do not have access to these mailboxes: work only from the packet below. Do not search the web, open links or contact anyone, and do not say that any email action has been carried out. Where I ask for a change, a draft or a message to send, give exactly what you would do or send. If I approve something, reply with the final version you would carry out. Turn the insulation emails into a preparation checklist for Wednesday. Give me a table with who does what, by when, and the message number(s) each row comes from. Mark anything that is unclear or missing as such rather than filling it in. Do not book, buy, pay, reply or change anything. --- MAILBOX PACKET --- MAILBOX PACKET As of: Monday 19 October 2026, 7:30 a.m. Pacific time (America/Los_Angeles, UTC-07:00) Mailbox owner: Dana Whitfield Accounts in this packet: household (dana.whitfield@fernhill-mail.example) My preferences: - Times are Pacific time (America/Los_Angeles) unless a message says otherwise. - My household and work accounts stay separate: anything I send goes from the account the conversation is in. - When nobody has been assigned a task, say so instead of assigning it. Contacts: - Dana Whitfield (me) - dana.whitfield@fernhill-mail.example - Sam Whitfield (spouse) - sam.whitfield@fernhill-mail.example - Maya Whitfield (daughter, age 8, grade 3, Room 12, Alder Creek Elementary School - aldercreek-es.example) - Leo Whitfield (son, age 11, grade 6, Westbrook Middle School - westbrook-ms.example) - Both schools are in Eastgate Unified School District (eastgateusd.example) - Snugfit Insulation (insulation contractor) - crew@snugfit-insulation.example Messages (15, newest first): === Message 01 === Account: household (dana.whitfield@fernhill-mail.example) From: Brightstep <hello@brightstep.example> To: Dana Whitfield <dana.whitfield@fernhill-mail.example> Cc: (none) Date: Sun, 18 Oct 2026 20:00 -07:00 Subject: Your weekly step summary Status: read Labels: Inbox Attachments: (none) Body: You averaged 8,214 steps a day this week, up 6% on last week. === Message 02 === Account: household (dana.whitfield@fernhill-mail.example) From: Sam Whitfield <sam.whitfield@fernhill-mail.example> To: Dana Whitfield <dana.whitfield@fernhill-mail.example> Cc: (none) Date: Fri, 16 Oct 2026 21:40 -07:00 Subject: Re: insulation day Status: read Labels: Inbox Attachments: (none) Body: Bikes Tuesday night, done. === Message 03 === Account: household (dana.whitfield@fernhill-mail.example) From: Dana Whitfield <dana.whitfield@fernhill-mail.example> To: Sam Whitfield <sam.whitfield@fernhill-mail.example> Cc: (none) Date: Fri, 16 Oct 2026 21:30 -07:00 Subject: Re: insulation day Status: read Labels: Sent Attachments: (none) Body: Yes, I'll switch the furnace off before I leave at noon. Can you move the bikes Tuesday night? === Message 04 === Account: household (dana.whitfield@fernhill-mail.example) From: Sam Whitfield <sam.whitfield@fernhill-mail.example> To: Dana Whitfield <dana.whitfield@fernhill-mail.example> Cc: (none) Date: Fri, 16 Oct 2026 21:00 -07:00 Subject: Re: insulation day Status: read Labels: Inbox Attachments: (none) Body: I'll be home Wednesday afternoon for the insulation crew, so the adult-at-home part is covered. Can you switch the furnace off before you leave? I never remember how that thermostat works. === Message 05 === Account: household (dana.whitfield@fernhill-mail.example) From: Snugfit Insulation <crew@snugfit-insulation.example> To: Dana Whitfield <dana.whitfield@fernhill-mail.example> Cc: (none) Date: Fri, 16 Oct 2026 10:00 -07:00 Subject: Attic insulation Wednesday 21 October - how to prepare Status: read Labels: Inbox Attachments: (none) Body: Hi Dana, ahead of Wednesday's attic insulation install (arrival 1-3 pm): 1. Clear a 3-foot path from the side gate to the garage and move the bikes. 2. Switch the furnace off at the hallway thermostat by 12:30 pm Wednesday. 3. Confirm someone 18+ will be home for the whole visit (about 3 hours). 4. Please secure the dog during the visit. Old insulation is bagged and removed at no charge. Snugfit Insulation === Message 06 === Account: household (dana.whitfield@fernhill-mail.example) From: Paperleaf Prints <orders@paperleaf.example> To: Dana Whitfield <dana.whitfield@fernhill-mail.example> Cc: (none) Date: Thu, 15 Oct 2026 11:20 -07:00 Subject: Your photo print order PL-30418 has shipped Status: read Labels: Inbox, Receipts Attachments: (none) Body: Your order of 24 prints has shipped and will arrive by mail within 5 days. $18.40 was charged. === Message 07 === Account: household (dana.whitfield@fernhill-mail.example) From: Weather Watch LA <alerts@weatherwatch-la.example> To: Dana Whitfield <dana.whitfield@fernhill-mail.example> Cc: (none) Date: Wed, 14 Oct 2026 18:00 -07:00 Subject: Wind advisory has ended Status: read Labels: Inbox Attachments: (none) Body: The wind advisory for the Los Angeles basin ended at 6 pm. No further alerts are active. === Message 08 === Account: household (dana.whitfield@fernhill-mail.example) From: Snugfit Insulation <crew@snugfit-insulation.example> To: Dana Whitfield <dana.whitfield@fernhill-mail.example> Cc: (none) Date: Wed, 14 Oct 2026 11:00 -07:00 Subject: Attic insulation booked Status: read Labels: Inbox Attachments: (none) Body: You're booked for Wednesday 21 October. Preparation instructions will follow by email. === Message 09 === Account: household (dana.whitfield@fernhill-mail.example) From: Cloudnest Photos <no-reply@cloudnest.example> To: Dana Whitfield <dana.whitfield@fernhill-mail.example> Cc: (none) Date: Mon, 12 Oct 2026 02:05 -07:00 Subject: Your phone backup is complete Status: read Labels: Inbox Attachments: (none) Body: Your nightly photo backup finished at 2:05 am. 1,318 items are now backed up. === Message 10 === Account: household (dana.whitfield@fernhill-mail.example) From: Parkwise <receipts@parkwise.example> To: Dana Whitfield <dana.whitfield@fernhill-mail.example> Cc: (none) Date: Sun, 11 Oct 2026 13:40 -07:00 Subject: Parking session receipt: Vermont Ave Status: read Labels: Inbox, Receipts Attachments: (none) Body: Parking session on Vermont Ave, 11 Oct, 12:05-1:35 pm. $4.50 charged. === Message 11 === Account: household (dana.whitfield@fernhill-mail.example) From: Goldmont Garden Supply <orders@goldmont-shop.example> To: Dana Whitfield <dana.whitfield@fernhill-mail.example> Cc: (none) Date: Mon, 28 Sep 2026 19:45 -07:00 Subject: Order GO-34716 confirmation from Goldmont Garden Supply Status: read Labels: Inbox, Receipts Attachments: (none) Body: We received your order (garden gloves). $101.81 was charged to the card ending 4471. Delivery details will follow. === Message 12 === Account: household (dana.whitfield@fernhill-mail.example) From: Sandley Apparel <offers@sandley-shop.example> To: Dana Whitfield <dana.whitfield@fernhill-mail.example> Cc: (none) Date: Fri, 25 Sep 2026 11:00 -07:00 Subject: Sandley Apparel: 25% off bike lights Status: read Labels: Inbox, Promotions Attachments: (none) Body: 25% off all bike lights through Sunday, online and in store. Unsubscribe: https://sandley-shop.example/unsubscribe === Message 13 === Account: household (dana.whitfield@fernhill-mail.example) From: Stellan Birkeland <stellan.birkeland@lindenvale-mail.example> To: Dana Whitfield <dana.whitfield@fernhill-mail.example> Cc: (none) Date: Sun, 20 Sep 2026 16:30 -07:00 Subject: Photos from the Lindenvale picnic Status: read Labels: Inbox Attachments: (none) Body: Sharing a few photos from the picnic. Great to see you all. Stellan === Message 14 === Account: household (dana.whitfield@fernhill-mail.example) From: Mallowwick Book Circle <hello@mallowwick-club.example> To: Dana Whitfield <dana.whitfield@fernhill-mail.example> Cc: (none) Date: Wed, 16 Sep 2026 19:15 -07:00 Subject: Mallowwick Book Circle: recap of the season Status: unread Labels: Inbox Attachments: (none) Body: A short recap of the season and a few photos from the last meetup. === Message 15 === Account: household (dana.whitfield@fernhill-mail.example) From: Coppermoor Parking <no-reply@coppermoor-app.example> To: Dana Whitfield <dana.whitfield@fernhill-mail.example> Cc: (none) Date: Wed, 16 Sep 2026 08:30 -07:00 Subject: Coppermoor Parking: the app was updated Status: read Labels: Inbox Attachments: (none) Body: Coppermoor Parking version 7.2 is installed on your devices. Release notes are in the app. END OF PACKET

ChatGPT dots Got it right

ChatGPT Pro; model not shown · Asked on

See what ChatGPT dots said
Preparation checklist for Wednesday 21 October 2026. All times Pacific. Snugfit’s arrival window is 1–3 pm; the visit takes about 3 hours (Messages 05, 08). WhoWhatBy when / durationSource messagesStatus or missing detailSamMove the bikesTuesday 20 October, night02, 03, 05Sam agreed. “Bikes Tuesday night, done” is a commitment made on Friday, not evidence the future task was completed.UnassignedClear a 3-foot path from the side gate to the garageBefore Wednesday’s arrival; no explicit clock deadline given05Moving the bikes does not establish who clears the rest of the path.DanaSwitch off the furnace at the hallway thermostatBefore leaving at noon Wednesday; contractor’s deadline is 12:30 pm03, 04, 05Dana explicitly agreed; completion not shown.SamBe home to cover the adult-at-home requirementWednesday afternoon, for the whole visit, about 3 hours04, 05Sam says this is covered. Exact availability/end time is not stated; arrival could be as late as 3 pm.UnassignedConfirm to Snugfit that someone 18+ will be home for the whole visitNo confirmation deadline stated; needed ahead of the visit04, 05Internal agreement is present, but no confirmation to Snugfit appears in the packet.UnassignedSecure the dogDuring the visit05No person or arrangements specified.SnugfitBag and remove the old insulation, at no chargeAs part of the installation; precise timing not stated05Contractor-provided service, not an assigned household preparation task.The main gaps are ownership of path-clearing and dog arrangements, and whether the adult-presence confirmation has reached Snugfit. An exact finish time is not given.

Grok Bot Got it right

X Premium; model not shown · Asked on

See what Grok Bot said
This is the prep checklist for the Snugfit attic insulation on Wednesday, October 21. The crew arrives between 1 and 3 pm PT, and the job takes about 3 hours (Messages 05 and 08). # Task Who By when From 1 Move the bikes Sam ("Bikes Tuesday night, done.") Tuesday night, Oct 20 05, 03, 02 2 Clear a 3-foot path from the side gate to the garage Not assigned. Sam only agreed to move the bikes. Unclear. Snugfit gives no time. My guess is before the 1 pm arrival window opens. 05 3 Turn the furnace off at the hallway thermostat Dana ("I'll switch the furnace off before I leave at noon") Before noon Wednesday. Snugfit's deadline is 12:30 pm. 05, 04, 03 4 Have an adult (18+) home for the whole visit Sam ("I'll be home Wednesday afternoon") The whole visit, from 1 pm until the crew leaves 05, 04 5 Confirm to Snugfit that an adult will be home Not assigned. The packet doesn't show this confirmation being sent. Missing. Snugfit gives no deadline. 05 6 Secure the dog during the visit Not assigned During the visit 05 Some things are unclear or missing: Row 4: I worked out that if the crew arrives at 3 pm and stays about 3 hours, they could be there until around 6 pm. Sam said "Wednesday afternoon," which might not cover the whole visit. Row 1: the bikes aren't moved yet. Sam's "done" in Message 02 means he agreed to do it on Tuesday night. Snugfit says the old insulation will be "bagged and removed at no charge," so there's nothing for you to do there. I haven't replied to anyone, booked anything, or changed anything.

Instinct Got it right

WhatsApp; no plan or model shown · Asked on

See what Instinct said
Preparation checklist for Wednesday 21 Oct 2026 (Snugfit attic insulation, arrival window 1-3 pm). Source for the task list is Message 05, Snugfit's "how to prepare" email of Fri 16 Oct, 10:00. Who | What | By when | Messages Dana (she says she'll do it) | Switch the furnace off at the hallway thermostat | Snugfit: by 12:30 pm Wed. Dana says she'll do it before she leaves at noon | 05, 03, 04 Sam (agreed, see note) | Move the bikes | Tuesday night 20 Oct (Dana's ask, Message 03). Snugfit just says before the visit | 05, 03, 02 UNASSIGNED | Clear a 3-foot path from the side gate to the garage | Before the crew arrives (1 pm). No earlier deadline stated | 05 UNCLEAR | Confirm to Snugfit that someone 18+ will be home for the whole visit (about 3 hours) | No deadline stated. No reply to Snugfit appears in the packet | 05, 04 UNASSIGNED | Secure the dog during the visit | During the visit. Nobody mentioned it in the household emails | 05 Notes on what is unclear or missing: - Bikes: Dana asked "Can you move the bikes Tuesday night?" (Message 03, 16 Oct 21:30). Sam replied "Bikes Tuesday night, done." (Message 02, 21:40). Sent on Friday, it can't mean already done, so I read it as agreed. That is my inference. Where the bikes go isn't stated. - Path: Message 05 asks for it together with the bikes. Nobody is assigned the path itself. I haven't assigned it to anyone. - Furnace: Sam asked Dana to do it (Message 04: "Can you switch the furnace off before you leave?") and Dana said "Yes, I'll switch the furnace off before I leave at noon" (Message 03). Nothing in the packet says who turns it back on or when. - Adult at home: Sam wrote "I'll be home Wednesday afternoon for the insulation crew, so the adult-at-home part is covered." (Message 04). He doesn't say he'll stay the whole visit. Snugfit asked to "confirm", and the packet has no confirmation sent to them. Nobody is assigned to send it. - Dog: nobody is assigned, and the packet doesn't say who will do it or how. - Information only: Snugfit will bag and remove the old insulation at no charge (Message 05). Message 08 (Wed 14 Oct) confirms the booking for Wed 21 Oct. - Dates: 21 Oct 2026 is a Wednesday, from the packet date Mon 19 Oct. Tuesday night is 20 Oct. I haven't sent, booked, paid or changed anything.

Muse Got it right

Meta free plan; model not shown · Asked on

See what Muse said
From the packet only — Snugfit attic insulation is Wednesday 21 October, arrival 1–3 pm, visit about 3 hours — Messages 05 and 08. No booking, reply, or other change has been made. Preparation task Who does it By when Message(s) Move the bikes Sam Whitfield — Dana asked him to, and Sam replied “Bikes Tuesday night, done.” Tuesday night 02, 03, 05 Clear a 3-foot path from the side gate to the garage — apart from moving the bikes Unassigned — unclear / missing. No one in the packet is assigned to, or volunteers for, the rest of the path-clearing. Unclear / missing — no separate deadline stated; Snugfit lists it ahead of the Wednesday 1–3 pm arrival 05 Switch the furnace off at the hallway thermostat Dana Whitfield — Sam asked Dana to do it, and Dana said she would By 12:30 pm Wednesday per Snugfit; Dana said before she leaves at noon Wednesday 03, 04, 05 Be home, age 18+, for the whole visit Sam Whitfield — “I'll be home Wednesday afternoon for the insulation crew, so the adult-at-home part is covered.” Wednesday afternoon, for the whole visit (about 3 hours; arrival 1–3 pm) 04, 05 Confirm to Snugfit that someone 18+ will be home Unassigned / not shown — unclear / missing. The packet shows Sam telling Dana it is covered; no message confirming this to Snugfit is in the packet. Unclear / missing 05 Secure the dog during the visit Unassigned — unclear / missing. No one in the packet is assigned to, or volunteers for, this. During the Wednesday visit 05 For information, not a household preparation task: Snugfit says old insulation is bagged and removed at no charge — Message 05.

Claude Fable 5.2 Got it right

Claude Ultra ($200 a month); Fable 5.2 · Asked on

See what Claude Fable 5.2 said
**Preparation checklist for the attic insulation install, Wednesday 21 October (crew arrives 1–3 pm, visit about 3 hours)** | # | Task | Who | By when | Source msg(s) | Status / gaps | |---|------|-----|---------|---------------|---------------| | 1 | Move the bikes | Sam | Tuesday night (20 Oct) | 05, 03, 02 | Agreed. Sam's "done" on Friday reads as "agreed", not "already moved". | | 2 | Clear a 3-foot path from the side gate to the garage | **Unassigned** | **Not stated** (logically before the 1 pm earliest arrival) | 05 | Sam only agreed to the bikes; nobody has taken the path. | | 3 | Switch the furnace off at the hallway thermostat | Dana | Before leaving at noon Wednesday (Snugfit's deadline is 12:30 pm) | 05, 04, 03 | Agreed. | | 4 | Be the adult (18+) at home for the whole visit | Sam | Wednesday, from crew arrival until they finish (could run to about 6 pm if they arrive at 3) | 05, 04 | Partly covered. Sam says he'll be home "Wednesday afternoon", but **his arrival time is not stated**. Dana leaves at noon and the crew may arrive from 1 pm. | | 5 | Confirm to Snugfit that someone 18+ will be home | **Unassigned** | **Not stated** | 05 | Snugfit asked for confirmation. The packet shows no reply to them and nobody has taken this on. | | 6 | Secure the dog during the visit | **Unassigned** | For the duration of the visit Wednesday | 05 | Nobody has taken this on, and **where or how the dog will be secured is not stated**. | **No action needed:** Snugfit bags and removes the old insulation at no charge (message 05). Message 08 is just the booking confirmation. I have not sent, booked or changed anything.

Where this example came from

Our reviews Can you let an AI assistant handle your inbox? and Can an AI assistant read your email so you don't have to? have the full scores and what the test does not show. The people and households in it are made up.

How you can check we haven’t changed these replies

The question and each reply were saved as files when they arrived. These fingerprints identify those files.

  • What happened when it went through your inbox: the question: aeecbce5b1caf940965221a79dc2a0fdf3d45f496c36c5f0493f66925fb9381a
  • What happened when it went through your inbox: ChatGPT dots, reply: 52efc0efc2e33ab093369afa25abc8bbc6ea3d99689f07a844fa6c059ced5acb
  • What happened when it went through your inbox: Grok Bot, reply: 43365c8500e296dcedd49c980ec025f1efd3d58e885da63cdbec14f009a60979
  • What happened when it went through your inbox: Instinct, reply: dda201874fe78f5cf37a55ef1c3003cc5c2c4b3d56358de29d042a81094232ee
  • What happened when it went through your inbox: Instinct, after the follow-up: 364755fa7efd125836a7667755fbc29bd1e54a6e831f5f929869021a9f0a1c5c
  • What happened when it went through your inbox: Muse, reply: 1c0b2a61abf06f89c3d981f1b4f9d13652dd885c71728e83c7f2df7e25cd431c
  • What happened when it went through your inbox: Claude Fable 5.2, reply: 54556aff168705b9fe4420eac99dd5be1bdce1de462fba82e64ae1ba879d2b6a
  • What happened when it went through your inbox: Claude Fable 5.2, after the follow-up: fb653dfe80cf6750d368dbf0ff8e571bdc11c56249b23cc69d034c5d59c489f6
  • What happened when you pasted your emails into the chat: the question: 959020f17bfd661d9581012e784bc7a61c19c2e80b94b7e647b8033991f05ae7
  • What happened when you pasted your emails into the chat: ChatGPT dots, reply: baed8544d29eca4c6910a9fb0c5aeb9d5e58cc8b84b3e19bab1e5df8583de967
  • What happened when you pasted your emails into the chat: Grok Bot, reply: 22e393f11982c337277232cf5d45c807c8b7c42576f2583cbd0bb828899e5307
  • What happened when you pasted your emails into the chat: Instinct, reply: 7fca6967dda915d64d7a332b9ed990240cd392836463156c25dcaeddc5c1cc81
  • What happened when you pasted your emails into the chat: Muse, reply: 22bd4c469e5753264334fe9f5a22ff3593abdf641affc11f2e16c280f03ecdbd
  • What happened when you pasted your emails into the chat: Claude Fable 5.2, reply: 4c48cc7b5f80e58bcdc0b5f249f43d530fab53bb9a2b8ba3f829639c40f2a491
  • What happened when you pasted your emails into the chat: Claude Fable 5.2, after the follow-up: 800ea143575a4edfa42f807cd9ad87554223e5d49fecd92e0fcd7c9f9129aa13

Found a mistake in this case? Tell us

Get new reviews by email

New AI tool reviews and updates, sent when we publish.

How we use your email