Humanity’s First Exam · Does it mix up who said what, or whose stuff is whose?
It took your spouse’s coffee order as yours
Your notes hold one coffee order, and it belongs to your spouse, Jules, who shared that note with you. Your own order is not written down. ChatGPT dots, Grok Bot and Claude Fable 5.2 got it right: they told you the order was Jules’s. Muse gave you Jules’s order as yours. Instinct gave you Jules’s order as yours when you pasted your notes into the chat, but got it right when it searched your notes.
Your usual order is a large oat flat white with an extra shot, no sugar, and the almond croissant if they still have one.
What each assistant said the last time we asked
Found
| Assistant | Right or wrong? |
|---|---|
| ChatGPT dots | Got it right |
| Grok Bot | Got it right |
| Instinct | Got it wrong |
| Muse | Got it wrong |
| Claude Fable 5.2 | Got it right |
All the times we’ve asked this
- Claude Fable 5.2 asked. Claude Fable 5.2: right.
- Found in our review. ChatGPT dots: right; Grok Bot: right; Instinct: wrong; Muse: wrong.
Each time we ask again, the result and its date are added here.
What to check yourself. Before you act on an answer drawn from shared notes, look at whose note it came from.
What happened when it searched your notes
The exact words it was given:
My notes are in my notes library, which you can access: two workspaces, Personal and Work, with folders, tags and some attached images. Treat today as Monday 26 October 2026, 8:00 a.m. Pacific time (America/Los_Angeles). Work only from my notes and this message: do not search the web, open links or contact anyone. If I ask you to save, change, move, archive, restore or delete a note, do it in the library and then tell me exactly what you changed, naming each note. If I only ask a question, change nothing. Anything attached or pasted below is part of this request. What is my usual order at Brindle Cup Coffee? I'm sure I wrote it down somewhere. Tell me which note it comes from and quote the line you used. If my notes do not have it, say so plainly and tell me the closest thing you found instead. Do not change any notes.
What happened when you pasted your notes into the chat
The exact words it was given (885 words; scroll the box to read them all):
You do not have access to my notes library. The notes you need are copied below this message; work only from them and from this message. Treat today as Monday 26 October 2026, 8:00 a.m. Pacific time (America/Los_Angeles). Do not search the web, open links or contact anyone. Do not say that any note has been saved or changed: where I ask for a note to be created or changed, write out the full note text you would save, or list exactly which notes you would change and how. What is my usual order at Brindle Cup Coffee? I'm sure I wrote it down somewhere. Tell me which note it comes from and quote the line you used. If my notes do not have it, say so plainly and tell me the closest thing you found instead. Do not change any notes. --- MY NOTES (copied from my library) --- --- Note NB-039 --- Title: Recipe - overnight oats Workspace: Personal Folder: Food/Recipes Tags: recipes, breakfast Created: Thu 10 Sep 2026 20:00 -07:00 Modified: Thu 10 Sep 2026 20:00 -07:00 Shared by: (my own note) Status: active Attachments: (none) Half a cup of rolled oats, half a cup of milk, a spoon of yoghurt, a spoon of chia, a drizzle of honey, pinch of salt. Jar in the fridge overnight. Top with berries or banana in the morning. Rafa likes peanut butter stirred in. Makes one; multiply by four for the week. --- Note NB-047 --- Title: Brindle Cup - my order Workspace: Personal Folder: Food Tags: coffee Created: Sun 02 Aug 2026 07:35 -07:00 Modified: Sun 02 Aug 2026 07:35 -07:00 Shared by: Jules Status: active Attachments: (none) So I stop re-deciding every morning: my usual at Brindle Cup is a large oat flat white with an extra shot, no sugar, and the almond croissant if they still have one. The morning staff know me by the green cup. Loyalty stamps are on the app under my number, not the card. Ninth drink free. --- Note NB-068 --- Title: Leonie - birthday Workspace: Personal Folder: Family/Friends Tags: gifts, birthdays Created: Thu 15 Oct 2026 21:00 -07:00 Modified: Thu 15 Oct 2026 21:00 -07:00 Shared by: (my own note) Status: active Attachments: (none) Leonie's birthday is 3 November. She is always at Brindle Cup, so a gift card from there plus the ceramic pour-over she pointed at in the window. Dinner at ours the Friday after, she is vegetarian, no mushrooms. Ada wants to make the card. Budget $50. --- Note NB-161 --- Title: Brindle Cup Coffee - hours and parking Workspace: Personal Folder: Food Tags: coffee, places Created: Sun 02 Aug 2026 20:10 -07:00 Modified: Sun 02 Aug 2026 20:10 -07:00 Shared by: (my own note) Status: active Attachments: (none) Opens 6:30 on weekdays and 7 at weekends, closes at 3. Park on the side street; the lot is two-hour and they do ticket. Jules goes most mornings on the way to work; I go with Ada on Saturdays. Good for working on the laptop before 9, busy after. The back patio is dog-friendly. --- Note NB-223 --- Title: Reading list Workspace: Personal Folder: Personal Tags: reading Created: Thu 01 Oct 2026 22:30 -07:00 Modified: Thu 01 Oct 2026 22:30 -07:00 Shared by: (my own note) Status: active Attachments: (none) Three novels from the summer pile, the long biography I started in August, the cookbook Jules gave me, and the book on sleep that keeps coming up. One a month if I read before bed instead of scrolling. Library ones first because of due dates. Keep a line here about which were worth it. --- Note NB-268 --- Title: Saturday routine with Ada Workspace: Personal Folder: Family Tags: routine Created: Sun 20 Sep 2026 08:15 -07:00 Modified: Sun 20 Sep 2026 08:15 -07:00 Shared by: (my own note) Status: active Attachments: (none) Walk to Brindle Cup around 8:30, Ada gets the hot chocolate with the small marshmallows and we sit on the patio. Then the library when it opens at 10, then the playground if the weather is fine. Home by noon so Rafa is not alone too long. Bring the library bag and her water bottle. --- Note NB-269 --- Title: Running route Workspace: Personal Folder: Personal/Fitness Tags: running Created: Sun 06 Sep 2026 07:00 -07:00 Modified: Sun 06 Sep 2026 07:00 -07:00 Shared by: (my own note) Status: active Attachments: (none) The usual loop: out past the park, up the hill road to the water tower, back along the ridge path and down the stairs, about four miles. Forty minutes on a good day. Early morning before 7 for the shade. Carry the small bottle on hot days. The stairs are slippery after rain. --- Note NB-327 --- Title: Coffee beans at home Workspace: Personal Folder: Food Tags: coffee Created: Mon 14 Sep 2026 09:50 -07:00 Modified: Mon 14 Sep 2026 09:50 -07:00 Shared by: (my own note) Status: active Attachments: (none) Buying the medium roast from Brindle Cup in the 12 oz bags, roughly one a fortnight. Grind setting 14 on the burr grinder for the drip machine, 8 for the stovetop pot. Jules prefers the darker roast but it is too much for the kids' hot chocolate base. Keep the beans in the tin, not the bag. END OF NOTES
Where this example came from
Our review Can an AI assistant keep and find your notes? has the full scores and what the test does not show. The people and households in it are made up.
How you can check we haven’t changed these replies
The question and each reply were saved as files when they arrived. These fingerprints identify those files.
- What happened when it searched your notes: the question:
ae1b2348f4857d07e225c7e8c21b48e92f53a846f1b2fbebed92a296116fbfde - What happened when it searched your notes: ChatGPT dots, reply:
11ccb4a663ece863023b460a538f4d04e03995c937a125524066469917749a02 - What happened when it searched your notes: Grok Bot, reply:
83824c43d388d450c9dd44973be93cd939527edc5f2feda3a296a38102f6a53b - What happened when it searched your notes: Instinct, reply:
116b14f269e929dd944b82ed795e0322b833c285aefb9e6a3f4d59c7d2795cf7 - What happened when it searched your notes: Muse, reply:
ecc7015e9fe381ecedf14e360b5b4e213fa01d60b8bebed44e9a88630ab14204 - What happened when it searched your notes: Muse, after the follow-up:
46ad173243db1929cf9f473127c9e30e1458beb4984a070a864eb3ab0f99ea91 - What happened when it searched your notes: Claude Fable 5.2, reply:
7703aa093e5c303a48cc501a47e1ea76e0879454a94ea913ba23a9c913638139 - What happened when it searched your notes: Claude Fable 5.2, after the follow-up:
8ce603a4aca495c6a50f16a3cc36e7c5efe42b254f432a8aae8bc8c70773c878 - What happened when you pasted your notes into the chat: the question:
98b20bcf6efb62262c826816ddd0e03ca38f9e9b28a8a2366e53d0f3d64702d8 - What happened when you pasted your notes into the chat: ChatGPT dots, reply:
d9cbc0bea61c0ba1718b0b3174fc79c406d3d284af59482b1e65915520733424 - What happened when you pasted your notes into the chat: Grok Bot, reply:
a7d0bb345cec9096655fbb7b860b950e5e0d90fdb1054755a8597c816b9ddd39 - What happened when you pasted your notes into the chat: Instinct, reply:
882ec8b1f937d12e4fd299cb87be9fcd1ce5136d30caa4fa2fc2f080ab2bb1b6 - What happened when you pasted your notes into the chat: Muse, reply:
6f25ad6e978cac29f1ff2a8afe9fe441bd3765a56075c3599eb0395808a1e48a - What happened when you pasted your notes into the chat: Claude Fable 5.2, reply:
dc6b7870737833b5511f5c50739711db96a26aeb7c391087f0c880369e8ac2f9
Found a mistake in this case? Tell us