---
title: "Meta Andromeda: Powering the Next Generation of Ads Retrieval Through Model-System Co-Design"
description: "Meta Andromeda is Meta’s personalized ads retrieval engine, and its next generation uses model-system co-design to achieve near ranking-level performance at retrieval scale. The system scores over one billion ads per second, a 100x throughput increase over the 2024 system, and has delivered a 2.4% increase in conversions on Facebook since 2025. The key innovation is a retrieval mixture-of-experts (MoE) architecture that reduces inference-time FLOPs by ~300x compared to the 2024 model, enabling ranking-level matching quality. The entire retrieval pipeline is fused into a single GPU kernel, eliminating memory bandwidth bottlenecks and achieving over 10 billion ads per second on a single NVIDIA GH200 Grace Hopper Superchip. The co-design approach, developed in collaboration with NVIDIA, positions the architecture to absorb more model complexity without proportional infrastructure growth."
---

# Meta Andromeda: Powering the Next Generation of Ads Retrieval Through Model-System Co-Design

[Meta](https://yomu.fyi/company/meta) · Haiyu Lu · Oct 28, 2026

**Type:** Announcement

## Summary

Meta Andromeda is Meta’s personalized ads retrieval engine, and its next generation uses model-system co-design to achieve near ranking-level performance at retrieval scale. The system scores over one billion ads per second, a 100x throughput increase over the 2024 system, and has delivered a 2.4% increase in conversions on Facebook since 2025. The key innovation is a retrieval mixture-of-experts (MoE) architecture that reduces inference-time FLOPs by ~300x compared to the 2024 model, enabling ranking-level matching quality. The entire retrieval pipeline is fused into a single GPU kernel, eliminating memory bandwidth bottlenecks and achieving over 10 billion ads per second on a single NVIDIA GH200 Grace Hopper Superchip. The co-design approach, developed in collaboration with NVIDIA, positions the architecture to absorb more model complexity without proportional infrastructure growth.

## Context

Meta Andromeda is Meta’s personalized ads retrieval engine. The 2024 system achieved tens of millions of ads per second per GPU. With generative AI tools, the ad candidate pool grew to unprecedented scale, requiring a 100x throughput increase. The new system co-designs model, system, and hardware to achieve near ranking-level performance at retrieval scale.

## Approach / What changed

The approach includes a retrieval mixture-of-experts (MoE) architecture with specialized user experts and an MoE attention-based gating network, fused GPU kernels that combine model and system workloads, and co-location of per-request logics with per-user-ad kernels on a single GPU box. This achieves over 10 billion ads per second on a single GH200 GPU.

## Takeaways

- The retrieval MoE architecture reduces inference-time FLOPs by ~300x compared to the 2024 model while delivering near ranking-level matching quality.
- Fusing the entire retrieval pipeline into a single GPU kernel eliminates memory bandwidth bottlenecks, enabling over 10 billion ads per second on a single GH200 GPU.
- Since 2025, Meta Andromeda has delivered a 2.4% increase in conversions on Facebook, demonstrating business impact from the co-design approach.

## FAQ

### How does the new Andromeda architecture achieve higher throughput?

It uses a retrieval mixture-of-experts (MoE) architecture that reduces FLOPs by ~300x, and fuses the entire pipeline into a single GPU kernel, eliminating memory bandwidth bottlenecks. This allows over 10 billion ads per second on a single GH200 GPU.

### What business impact has the new Andromeda system delivered?

Since 2025, Meta Andromeda has delivered a 2.4% increase in conversions on Facebook, meaning better ad relevance and more conversions for advertisers.

### How does the co-design approach differ from previous optimizations?

Previous optimizations focused on model execution only, but the new approach fuses both model and system workloads into a single GPU kernel, and co-locates per-request logics with per-user-ad kernels on a single GPU box, eliminating network and memory bottlenecks.

**Tags:** [GPU](https://yomu.fyi/topic/gpu), [Meta](https://yomu.fyi/topic/meta), [Mixture of Experts](https://yomu.fyi/topic/mixture-of-experts), [NVIDIA](https://yomu.fyi/topic/nvidia), [Recommendation Systems](https://yomu.fyi/topic/recommendation-systems)

- Source: [Meta](https://engineering.fb.com/2026/10/28/ml-applications/meta-andromeda-next-gen-ads-retrieval-gpu-co-design)
- Source URL: https://engineering.fb.com/2026/10/28/ml-applications/meta-andromeda-next-gen-ads-retrieval-gpu-co-design
- Ingested by Yomu: 2026-10-28T18:01:08.235Z

[Read original post](https://engineering.fb.com/2026/10/28/ml-applications/meta-andromeda-next-gen-ads-retrieval-gpu-co-design)
