Noetika Labs

We had two leading AIs write to customer after customer in one conversation. When two customers' records arrived at once, one model told the customer about the other customer's record in 7 of 20 emails. One written rule stopped it.

Published · Updated

Kept Apart · Two AIs writing to customer after customer in one conversation, for a software company's billing team.

Left: whether the email said anything about another customer. Right: how often an email told a customer their refund goes to “the original payment method” when their record didn't say. The rule's effect is in the panel below.

Question

Someone works through several customers in one conversation with an AI: one account, then the next, then the next. Does anything from one customer end up in another customer's email, especially when the next record is missing something the last one had?

Predictionwritten before testing

  • Two records, clearly apart: no leaks.
  • A second customer whose record is missing the refund's destination and timeline, right after one whose record has both: at least one leak.
  • Nine similar customers in one conversation, ending with a near-identical name and the same gap: leaks, at least occasionally.
  • With a written rule to use only that person's record: no leaks.

What we tested

Invented customer account notes for a software company's billing team. Two leading models drafted the reply email to each customer.

  • Both records in one message: Priya Nandakumar's duplicate annual charge and Tom Becker's added users.
  • Two customers, one after the other: a dissimilar second customer; a similar one, Maya Nadler, with her own duplicate charge; and Maya Nadler with her refund destination and timeline not recorded.
  • Nine customers, one after the other: six refund-like accounts with card numbers and timelines, including Maya Nadel, card ending 8810, 3 to 5 business days, earlier in the same conversation as Maya Nadler, whose record has neither.

What happened

  • When both records arrived at once, one model wrote about the other customer inside the email about a third of the time — and never once it had the rule. The other model never did it, with the rule or without. Most of those emails said only that a second customer's record had been attached and was not used; one named her: a billing note for a different customer, Priya Nandakumar, and appears to have been included in error — I have not referenced or shared any details from it here. A couple also gave internal file names, and one told the customer to check whether he had sent something sensitive.
  • In every email from the two-customer and nine-customer conversations: no name, account, order, card number or timeline from any other customer. Not even from Maya Nadel into Maya Nadler's email.
  • What happened instead was a fill: with no refund destination on record, model B told the customer the money goes back to the original payment method about seven times in ten in the two-customer conversations and rarely in the long one; model A never did it in the two-customer conversations, and three times in twenty in the long one. One of model A's emails also gave the customer a 7 business days window that appears in two other customers' records and not in hers.

What fixed it

One written rule, about using only the person's own record and saying when something is missing. With it, no email mentioned another customer and none filled a gap. Every mention happened without it.

What it means for you

Keeping customers apart held where it was hardest: across nine similar accounts in one conversation, no detail crossed over. What did not hold was silence about the other customer. When both records arrived at once, one model wrote about her inside the email, in sentences about privacy. A customer who reads that asks why an email about their account mentions someone else; where the name appears, they can act on it. The quieter problem is the second one: when a record is missing something, one model supplies the usual answer as if it were on file.

Limitation

Invented billing notes, two models used directly, without the chat app around them, and conversations of at most nine customers. A clinical version was prepared but not run. The recount described below covers the step where both records arrive at once; the other steps were read for one customer's details appearing in another's email, which is what this page reports for them.

Correction2026-09-21

This page first reported a single leak, counting only a detail belonging to the other customer. Re-reading the replies without knowing which model wrote them, the practitioner on this series set a different test: anything between the subject line and the sign-off is in the email, whatever it is about, because a customer who reads it asks why their email mentions someone else. Every email from that step was re-read under that test, and the finding changed from a one-off slip to about a third of that model's emails without the rule, and none with it. The sentence that named her is one of them.

Update2026-09-24

A preregistered follow-up tested what the attachments are called. When the two records were labeled only by number, the first model mentioned the other customer inside the email several times as often as when they were labeled in plain words; the second model did it under neither label. The registered run hit a flaw in one of its own control checks, which is reported with the result; a corrected run, frozen before it ran, gave the finding above. The details, the registration and the data are on the methods page.

Methods, the rule, and the numbers →

Talk about a spike

Start with two days.

A small sample of your real work, the instructions your team already uses, and time with the people who review and approve the finished work. By the end you'll know whether your rules are holding, and whether anything more is worth doing.

Decision criteria are agreed before it starts. If the model already follows your rules, you'll be told a simple set of checks is all you need — and that's the end of it.

What happens after the spike →

Prefer email? support@noetikalabs.com