---
title: "How to Build an ASL Gloss Workflow That Keeps Context"
description: "Learn a practical workflow for translating English discourse into ASL gloss while preserving spatial references, question-answer structure, and consistent concept-to-gloss mappings."
---

# How to Build an ASL Gloss Workflow That Keeps Context

**Type:** [How to](https://yomu.fyi/visual-explainers/category/how-to.md)

![A numbered four-step workflow for ASL gloss translation: capture discourse context, track entities and spatial locations, resolve clauses and map concepts to glosses, then evaluate consistency and gloss quality.](https://yomufyi.s3.us-east-1.amazonaws.com/visual-explainers/b80458e2-5976-4613-ba19-dc2093f7c07c/image-e256e948-94ec-48cd-96d7-a851b1b836e1.webp)

> Learn a practical workflow for translating English discourse into ASL gloss while preserving spatial references, question-answer structure, and consistent concept-to-gloss mappings.

## Explanation

ASL gloss translation needs more than sentence-by-sentence conversion. This workflow starts with discourse context, tracks entities and their spatial locations, resolves question-answer clauses, and maintains stable English-to-ASL concept-gloss mappings. The final checkpoint evaluates spatial consistency, entity tracking, and gloss quality separately, giving engineers a clearer way to diagnose failures than relying on one sentence-level score.

**Tags:** [Accessibility](https://yomu.fyi/topic/accessibility.md), [AI](https://yomu.fyi/topic/ai.md), [Architecture](https://yomu.fyi/topic/architecture.md), [ASL](https://yomu.fyi/topic/asl.md)

## Related reading

### [AI Functions in ClickHouse: Upgrade your SQL to the AI age](https://yomu.fyi/post/ai-functions-in-clickhouse-upgrade-your-sql-to-the-ai-age.md)
- Company: [Clickhouse](https://yomu.fyi/company/clickhouse.md)
- Published: Sep 11, 2026
- Type: Explainer

ClickHouse’s beta AI Functions let SQL queries call an LLM or embedding provider directly, keeping classification, extraction, generation, translation, redaction, filtering, embedding, and similarity work alongside stored data. The feature addresses workflows that export rows to separate LLM, orchestration, or vector-database systems and then reload results, with the stated goal of running the full RAG cycle in ClickHouse. Functions make remote HTTP calls per input, or batch embedding inputs, and return native ClickHouse values; in open-source deployments, named collections store provider credentials and endpoint settings. Examples use Hacker News data for topic classification and natural-language filtering, while the guidance emphasizes cheap predicates, quotas, LIMIT tests, prompt-injection defenses, non-determinism, cost, latency, and provider access to data in cleartext after TLS termination.


### [DiscoSign: Discourse-Aware Text to Sign Language Gloss Translation](https://yomu.fyi/post/discosign-discourse-aware-text-to-sign-language-gloss-translation.md)
- Company: [Apple](https://yomu.fyi/company/apple.md)
- Published: Sep 11, 2026
- Type: Problem & solution

DiscoSign addresses a limitation in sign language processing: systems have traditionally translated at the sentence level, overlooking discourse phenomena important to sign language comprehension. It presents a modular Large Language Model (LLM)-based framework for text-to-sign language gloss translation that handles spatial coreference resolution, Question-Answer Clauses (QACs), and concept-gloss consistency, preserving entity locations and stable English-to-ASL sign mappings across discourse. Because traditional translation metrics do not measure discourse-level quality, the authors introduce metrics for each coherence dimension targeted by the framework. Experiments on sentence-level and discourse-level datasets report improved spatial consistency and entity tracking over sentence-only translation, while maintaining competitive single-sentence gloss quality; the work describes this as the first systematic framework with a corresponding evaluation methodology.


### [Putting Captions to the Test: Evaluating Video Caption Quality through Multiple-Choice Question Answering](https://yomu.fyi/post/putting-captions-to-the-test-evaluating-video-caption-quality-through.md)
- Company: [Apple](https://yomu.fyi/company/apple.md)
- Published: Sep 11, 2026
- Type: Benchmark

Evaluating video captions is difficult because reference-matching metrics can penalize valid descriptions that use different wording or focus on different visual content, while offering little fine-grained diagnosis. The paper reframes quality around information fidelity: captions should cover salient visual information and remain factually accurate. It introduces CapQuiz, a reference-free benchmark that tests caption utility through human-verified, fine-grained multiple-choice questions derived from videos, organized into 10 Descriptive and Inferential question types across 24 domains. It also proposes CapF1, which combines CapP for factuality with CapR for coverage; extensive experiments report significantly stronger correlation with human judgments than existing metrics and interpretable insight into model performance.


### [Building Pinterest’s VLM Serving Stack on NVIDIA Dynamo](https://yomu.fyi/post/building-pinterest-s-vlm-serving-stack-on-nvidia-dynamo.md)
- Company: [Pinterest](https://yomu.fyi/company/pinterest.md)
- Author: Pinterest Engineering
- Published: Sep 10, 2026
- Type: Explainer

Pinterest describes building a VLM serving stack on NVIDIA Blackwell B200 GPUs and NVIDIA Dynamo for multimodal products including Pinterest Assistant, hybrid search, multimodal reranking, content understanding, signal generation, and content safety. Unlike text-only workloads, requests may contain thousands of images, costly and variable prefill, long multi-turn histories, and large KV caches, making preprocessing, routing, memory, and latency central serving concerns. The implementation combines Dynamo's distributed orchestration, multimodal frontend and vLLM support, KV-aware routing, disaggregated encoder/prefill/decode serving, and LMCache-based KV offloading with vLLM, an OpenAI Chat Completions interface, model-aware routing, EKS, and custom deployment components. Production-oriented AIPerf DAG benchmarks model QPS patterns, multi-turn conversations, many-image requests, and agentic DAGs; the team concludes that payload design, cache-aware routing, offload tiers, and a shared platform are essential to meeting product targets and accelerating new launches.