---
title: "How to build an AI agent that remembers returning customers"
description: "AI agents that fail to recognize returning customers force them to repeat information, with 74% of consumers reporting repetition and 71% willing to abandon conversations early. Twilio’s approach uses three capabilities: identity resolution to match profiles across channels, recall to pull observations and summaries from Conversation Memory, and write-back to save new facts via the Memory API. Conversation Memory stores structured traits, extracted observations from conversations, and short conversation summaries, with the Recall API returning up to 20 observations and 5 summaries per profile. Agent Connect loads relevant context before the agent replies, running in Orchestrator mode with memory modes of always or once, and it uses ConversationRelay for voice calls. New facts are saved mid-conversation by agent tools calling the Memory API directly because automatic extraction only runs after a conversation closes, and memory carries across channels and human handoffs through Twilio Flex."
---

# How to build an AI agent that remembers returning customers

[Twilio](https://yomu.fyi/company/twilio) · Jesse Sumrak · Nov 6, 2026

**Type:** Tutorial

## Summary

AI agents that fail to recognize returning customers force them to repeat information, with 74% of consumers reporting repetition and 71% willing to abandon conversations early. Twilio’s approach uses three capabilities: identity resolution to match profiles across channels, recall to pull observations and summaries from Conversation Memory, and write-back to save new facts via the Memory API. Conversation Memory stores structured traits, extracted observations from conversations, and short conversation summaries, with the Recall API returning up to 20 observations and 5 summaries per profile. Agent Connect loads relevant context before the agent replies, running in Orchestrator mode with memory modes of always or once, and it uses ConversationRelay for voice calls. New facts are saved mid-conversation by agent tools calling the Memory API directly because automatic extraction only runs after a conversation closes, and memory carries across channels and human handoffs through Twilio Flex.

## Context

AI agents often fail to recognize returning customers, leading to repeated questions and customer frustration. Research in the post shows 74% of consumers report having to repeat themselves, 71% are willing to abandon conversations early, and 91% of brands have seen customer satisfaction drop due to AI missteps, most notably when context is lost between channels or interactions.

## Approach / What changed

Using Twilio Conversation Memory for storing traits, observations, and summaries; Conversation Orchestrator for identity resolution across channels; and Agent Connect with configurable memory modes to load context before replies and save new facts mid-conversation via the Memory API. The system relies on three capabilities: identity (matching profiles using phone numbers, handles, IDs), recall (Retrieving up to 20 observations and 5 summaries with date filters), and write-back (adding observations or updating traits during a conversation via the Memory API).

## Takeaways

- Twilio Conversation Memory resolves customer identity across channels using phone numbers, WhatsApp handles, email addresses, chat IDs, and user IDs, and Conversation Orchestrator applies this to every conversation.
- The Recall API returns up to 20 observations and 5 summaries per profile, with date filters to focus on recent conversations, and Agent Connect’s memory mode can be set to always or once.
- Automatic memory extraction runs after a conversation goes inactive or closes; mid-conversation updates must be written directly via the Memory API because there is no mid-conversation extraction.

## FAQ

### How do I stop my chatbot from asking the same questions every time a customer returns?

Twilio Conversation Memory stores what customers share as traits, observations, and conversation summaries. Agent Connect retrieves that memory before each reply, so the agent starts with what it already knows, preventing repeated questions.

### What tools let an AI agent update a customer profile mid-conversation based on new information?

Twilio Conversation Memory's API lets an agent tool create observations or update traits during a live conversation. Automatic extraction runs later, after the conversation goes inactive or closes, so direct API calls are needed for immediate updates.

### Why does my AI agent forget customers between conversations?

Twilio Conversation Memory can only recall a profile it can identify, and it extracts observations after a conversation goes inactive or closes. Check identifier links, extraction settings, and the agent's memory mode to ensure proper memory persistence.

**Tags:** [AI Agents](https://yomu.fyi/topic/ai-agents), [Conversation Memory](https://yomu.fyi/topic/conversation-memory), [Twilio](https://yomu.fyi/topic/twilio)

- Source: [Twilio](https://www.twilio.com/en-us/blog/insights/ai-agent-remember-returning-customers)
- Source URL: https://www.twilio.com/en-us/blog/insights/ai-agent-remember-returning-customers
- Ingested by Yomu: 2026-11-07T06:00:16.920Z

[Read original post](https://www.twilio.com/en-us/blog/insights/ai-agent-remember-returning-customers)
