Loading…
Platform Thinking: Three Views from Two Sigma Leaders
Two SigmaEmily Majewski
Summary
Two Sigma structures its quantitative investment operations around foundational platforms that balance operational speed with scientific rigor. In data engineering, foundational teams provide both raw and curated datasets using BigQuery, CI/CD-managed transformation pipelines, and reusable data contracts termed ice cubes to serve ninety percent of use cases. Quantitative modeling incorporates open-source large language models trained strictly on point-in-time data to rapidly generate features while preventing temporal leakage. Long-term platform innovation follows an epsilon and omega strategy that couples overarching vision with iterative, learning-focused steps. Platform leadership categorizes artificial intelligence applications into advisory, oracle, operational, and agentic functions designed to enhance human productivity rather than replace researchers.
Context
Investment management and quantitative research require foundational infrastructure that balances rapid experimentation with scientific rigor while handling evolving technologies and complex data requirements.
Approach / What changed
Two Sigma relies on a platform-centric model featuring standardized warehouses like BigQuery, data transformations managed via CI/CD, and reusable data contracts alongside raw data access. Additionally, research workflows incorporate open-source LLMs trained on point-in-time data to prevent temporal leakage while categorizing AI into advisory, oracle, operational, and agentic roles.
Takeaways
- Foundational data engineering shifted to offering both raw and curated data while using reusable 'ice cube' data contracts to satisfy 90% of use cases without building custom solutions.
- To prevent temporal leakage in feature forecasting, modeling teams utilize open-source models trained on point-in-time data so models do not access future information during past prediction evaluations.
- Platform innovation is framed as stacked S-curves guided by an epsilon and omega approach that aligns long-term vision with small, learning-generating steps across four distinct AI roles.
Related reading
Odysseus to AI: Matt Greenwood on the Dev Interrupted Podcast
Matt Greenwood, Chief Innovation Officer at Two Sigma, outlines strategies for managing technological change, integrating artificial intelligence into systematic investment, and building supportive engineering organizations. Greenwood describes sustained innovation through the S-curve using an epsilon and omega approach, combining small iterative steps with a broad long-term vision. To direct resources amid rapid advances in machine learning and large language models, he presents a functional framework categorizing AI roles into advisory insights, oracle outcome validation, operational task automation, and agentic coordination. This categorization aims to automate routine workflows while keeping human creativity, control, and higher-level thinking at the center of the investment process. Additionally, the organization fosters employee engagement through initiatives such as an internal hacker lab where cross-disciplinary teams build projects ranging from robots to racing simulators.
Emily Majewski