MongoDBProblem & solution
The Merchant Identity Gap: The Hidden Payment Data Problem
Summary
Banks face a merchant identity gap: transaction descriptors from acquirers (e.g., SBUX) often don’t match customer search terms (e.g., “Starbucks” or “星巴克”) due to script differences, colloquial aliases, and cross-subsidiary naming inconsistencies. This gap inflates support costs, degrades spend categorization, and undermines personalized financial management and AI advisors. The solution uses a semantic resolution architecture on MongoDB storing a master merchant catalog with canonical names, aliases, and vector embeddings. An escalating pipeline applies fuzzy matching, semantic vector search with Voyage AI embeddings and MongoDB Vector Search, and gen AI write-back to resolve unknown descriptors and enrich the catalog. With canonical identities indexed, customers search in their own language, and institutions power conversational AI that accurately answers queries like “How much did I spend at Starbucks last month?” across markets.
Context
Financial institutions processing payment transactions face a merchant identity gap where raw acquirer descriptors (e.g., SBUX) do not match customer search terms (e.g., Starbucks or 星巴克) due to script/language mismatches, colloquial aliases (e.g., Méqui for McDonald’s), and cross-subsidiary naming variations. This gap inflates support costs, degrades spend categorization, and undermines personalized financial management and AI assistants. The post describes a three-dimensional problem and presents a semantic resolution architecture using MongoDB as a unified data foundation, with a master merchant catalog, fuzzy matching, semantic vector search, and gen AI write-back.
Approach / What changed
A two-pillar semantic resolution architecture: (1) Merchant alias enrichment pipeline using escalating steps of fuzzy matching via MongoDB Search, semantic vector search with Voyage AI embeddings and MongoDB Vector Search plus a reranker, and gen AI write-back via RAG for unknown descriptors. Resolved aliases are written back to the master merchant catalog stored in MongoDB. (2) Merchant query and search using MongoDB Search with canonical identities and aliases to enable customer search in their own language and power conversational AI. The master merchant catalog stores each merchant as a single document with canonical name, aliases in any script, and vector embedding, co-located and queryable in one operation.
Takeaways
The merchant identity gap compounds from three challenges: script and language mismatch, colloquial alias divergence, and cross-subsidiary naming inconsistency across acquirers.
MongoDB’s document model enables co-location of descriptor variants, aliases in any script, and vector embeddings in a single document, eliminating synchronization overhead and separate vector stores.
The enrichment pipeline reduces LLM reliance over time because resolved aliases write back to the master merchant catalog, improving future match rates without repeated API calls.
FAQ
How does the solution handle merchant names in different scripts?
The solution embeds merchant strings into a shared semantic vector space using Voyage AI models, so names like Starbucks, SBUX, and 星巴克 cluster together regardless of script. The master merchant catalog stores aliases in any script, and semantic vector search matches by meaning, not character matching.
What happens when a new merchant descriptor has no match?
The gen AI write-back step uses retrieval-augmented generation (RAG) with known merchant examples from the catalog to generate a canonical name and local alias. The new alias is then written back to the master merchant catalog for future resolutions.
Can this architecture scale without manual mapping across markets?
Yes, the escalating pipeline automates resolution through fuzzy matching, semantic vector search, and gen AI write-back. The catalog is enriched continuously, reducing manual curation, and MongoDB's document model handles variable-length records and unpredictable scripts without schema migrations.
Source and freshness
- Source
- mongodb.com
- Published
- Added to Yomu
Summaries are generated from the original by a language model. Check the original before relying on it.
Keep reading
Related reading
The Good Stuff
Paid picks we use ourselves. Links carry a referral code — a subscription through one earns us a commission at no extra cost to you.
The best engineering reads, once a week
One useful email. Unsubscribe anytime.