Loading post…
MetaAnnouncement
Sapienz Receives ISSTA 2026 Impact Paper Award
Summary
Sapienz, a multi-objective automated testing system for Android, received the ISSTA 2026 Most Influential Paper Award for its 2016 research by Ke Mao, Mark Harman, and Yue Jia. The system combines three goals: exploring more of an app, finding more crashes, and reducing the steps needed to trigger them, making failures easier to investigate. In an evaluation of 1,000 popular Google Play apps, Sapienz found 558 previously unknown crashes. Within 17 months of publication, it was deployed at Meta, where it now runs millions of tests daily, surfaces thousands of unique crashes each week, and helps safeguard hundreds of app releases each month. Sapienz also became the app-exploration engine for dynamic taint analysis at WhatsApp using synthetic conversation test accounts.
Context
The work began at University College London and went on to become testing infrastructure at Meta, winning the ISSTA 2026 Most Influential Paper Award a decade later.
Approach / What changed
Multi-objective optimization combining maximization of app exploration, crash discovery, and minimization of reproduction steps. Deployed at Meta using test accounts with synthetic conversations for dynamic taint analysis at WhatsApp.
Takeaways
In an evaluation of 1,000 popular Google Play apps, Sapienz uncovered 558 previously unknown crashes.
Within 17 months of publication, Sapienz was deployed at Meta, where it now runs millions of tests daily and surfaces thousands of unique crashes each week.
Sapienz’s core multi-objective exploration and actionable fault revelation ideas have extended to LLM agents that test app behavior for functional correctness.
FAQ
How is Sapienz used at WhatsApp?
Sapienz uses test accounts with synthetic conversations as the app-exploration engine for dynamic taint analysis at WhatsApp.
What is Sapienz's current daily impact at Meta?
It runs millions of tests daily, surfaces thousands of unique crashes each week, and helps safeguard hundreds of app releases each month.
What three goals did the original Sapienz research combine?
Exploring more of an app, finding more crashes, and reducing the number of steps needed to trigger them.
Source and freshness
- Source
- engineering.fb.com
- Published
- Added to Yomu
Summaries are generated from the original by a language model. Check the original before relying on it.
Keep reading
Related reading
The Good Stuff
Paid picks we use ourselves. Links carry a referral code — a subscription through one earns us a commission at no extra cost to you.
The best engineering reads, once a week
One useful email. Unsubscribe anytime.