---
title: "LLMON: An LLM-Native Markup Language, now in Granite 4.1 3B and 8B"
description: "LLMON is a markup language that uses reserved special tokens to explicitly communicate structure and semantics to LLMs, addressing brittleness and prompt injection vulnerabilities. Components like instructions and data are marked with meaningful tags and unique IDs, enabling explicit binding between them. The authors release two experimental preview models derived from Granite 4.1 base models, trained to consume and generate LLMON-marked text. On the OPI benchmark, LLMON models achieve near-zero attack success rates for indirect prompt injections, outperforming the best frontier model by 47% while maintaining general capability comparable to Granite 4.1 Instruct models. LLMON enriches chat templates by adding component-level semantics and binding, and the models are trained through re-serialized instruction-tuning data and reinforcement learning."
---

# LLMON: An LLM-Native Markup Language, now in Granite 4.1 3B and 8B

[Hugging Face](https://yomu.fyi/company/hugging-face) · Abraham Daniels, Basel Shbita, Chad DeLuca, Dan Gutfreund, Michael Hind, Shub A · Nov 12, 2026

**Type:** Announcement

## Summary

LLMON is a markup language that uses reserved special tokens to explicitly communicate structure and semantics to LLMs, addressing brittleness and prompt injection vulnerabilities. Components like instructions and data are marked with meaningful tags and unique IDs, enabling explicit binding between them. The authors release two experimental preview models derived from Granite 4.1 base models, trained to consume and generate LLMON-marked text. On the OPI benchmark, LLMON models achieve near-zero attack success rates for indirect prompt injections, outperforming the best frontier model by 47% while maintaining general capability comparable to Granite 4.1 Instruct models. LLMON enriches chat templates by adding component-level semantics and binding, and the models are trained through re-serialized instruction-tuning data and reinforcement learning.

## Context

LLMs rely on context that often lacks explicit structure, causing brittleness and vulnerability to prompt injections, especially in smaller models. Existing formats like JSON are designed for parsers, not LLMs.

## Approach / What changed

LLMON uses reserved special tokens to mark semantically coherent components (instructions, data, requirements) with meaningful tags and unique IDs, enabling explicit binding. The preview models are trained from Granite 4.1 base checkpoints using re-serialized instruction-tuning data and reinforcement learning stages including GRPO and DPO.

## Takeaways

- LLMON uses reserved special tokens for structural delimiters, separating structure from content in the vocabulary, unlike JSON which uses characters that can appear in text.
- LLMON models achieve near-zero attack success rates on indirect prompt injection benchmarks like OPI, outperforming frontier and open-source models significantly.
- LLMON enriches chat templates by adding component-level semantics and binding, allowing explicit instruction/data separation without replacing the chat template.

## FAQ

### How does LLMON prevent prompt injection?

LLMON separates instructions from data using explicit tags and an execution block that binds instructions to specific data. Instructions not bound in the execution block are ignored, so hidden instructions in data are not followed, reducing attack success rates to near zero.

### How does LLMON differ from JSON?

JSON uses characters like quotes and brackets for structure, which are the same tokens as text, causing confusion for LLMs. LLMON uses reserved special tokens for structure, making boundaries explicit. Conversion tools allow lossless translation between JSON and LLMON.

### Can I define custom tags in LLMON?

Yes, you can define your own tag names and structure for your domain and fine-tune a LoRA adapter on top of the LLMON models to understand them, as demonstrated with the ScienceWorld benchmark.

**Tags:** [Granite](https://yomu.fyi/topic/granite), [LLMON](https://yomu.fyi/topic/llmon), [LLMs](https://yomu.fyi/topic/llm), [Prompt Injection](https://yomu.fyi/topic/prompt-injection)

- Source: [Hugging Face](https://huggingface.co/blog/ibm-granite/llmon-an-llm-native-markup-language-now-in-granite)
- Source URL: https://huggingface.co/blog/ibm-granite/llmon-an-llm-native-markup-language-now-in-granite
- Ingested by Yomu: 2026-11-12T21:00:12.736Z

[Read original post](https://huggingface.co/blog/ibm-granite/llmon-an-llm-native-markup-language-now-in-granite)
