# STARFlow2: Bridging Language Models and Normalizing Flows for Unified Multimodal Generation

[Apple](https://yomu.fyi/company/apple) · Aug 25, 2026

**Type:** Problem & solution

## Summary

Existing multimodal models struggle with structural fragmentation, often sacrificing visual fidelity via discrete tokenization or breaking structural symmetry by pairing causal text generation with diffusion-based denoising. STARFlow2 addresses these limitations by leveraging autoregressive normalizing flows, which share the causal mask, key-value cache mechanism, and left-to-right structure of large language models. Built upon the Pretzel architecture, the system vertically interleaves a frozen pretrained vision-language model stream with a TARFlow stream through residual skip connections under a single causal mask. A deep-shallow flow design combined with a unified FAE latent space allows both text and continuous visual outputs to enter the key-value cache directly without re-encoding. Benchmark experiments validate strong performance across multimodal understanding and continuous image generation tasks.

## Context

Unified multimodal models that understand, reason over, and generate interleaved text-image sequences remain structurally fragmented. Existing methods either sacrifice visual fidelity through discrete tokenization, impose structural asymmetry by combining causal text generation with iterative diffusion-based denoising, or degrade pretrained understanding when adapting vision-language models for generation.

## Approach / What changed

STARFlow2 adopts the Pretzel architecture to vertically interleave a frozen pretrained vision-language model stream with a TARFlow stream via residual skip connections under a single causal mask. It couples a deep-shallow flow design with a unified FAE latent space to enable cache-friendly interleaved generation where text and visual outputs enter the KV-cache directly without re-encoding.

## Takeaways

- Autoregressive normalizing flows share the same causal mask, KV-cache mechanism, and left-to-right structure as LLMs, making them suitable for continuous, single-pass multimodal generation.
- The Pretzel architecture vertically interleaves a frozen pretrained VLM stream with a TARFlow stream via residual skip connections, preserving understanding while generating images.
- Combining a deep-shallow flow design with a unified FAE latent space allows text and visual outputs to enter the KV-cache directly without requiring re-encoding.

**Tags:** [Architecture](https://yomu.fyi/topic/architecture), [LLMs](https://yomu.fyi/topic/llm), [Machine Learning](https://yomu.fyi/topic/machine-learning)

[Read original post](https://machinelearning.apple.com/research/starflow2-multimodal-generation)