---
title: "Granite"
description: "2 posts about Granite, summarised, each linking to the original."
---

# Granite
> 2 posts about Granite, summarised, each linking to the original.

## Articles

### [Granite Switch 4.1: Chat, Decisions, and Speech from One Endpoint](https://yomu.fyi/post/granite-switch-4-1-chat-decisions-and-speech-from-one-endpoint.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: Kate Soule, Subhajit Chaudhury, Hendrik Strobelt, Luis A Lastras
- Published: Oct 15, 2026
- Type: Announcement

Granite Switch 4.1 models combine chat, general and specialized decisions, and speech-to-text from a single hosted endpoint. The 8B and 30B models include a new Decision aLoRA for general-purpose decision-making and a Guardian aLoRA that outperforms Jev 1.13 and other closed models on safety tasks. They also embed Granite-Speech-5.0-Turbo-CTC, the fastest ASR model on the OpenASR Leaderboard, enabling efficient transcription. All components are composed into one model using cache-efficient Activated LoRAs, taking up about the same GPU VRAM as the base model alone, and the KV cache from base generation can be reused for any subsequent adapter decisions. Granite Switch 4.1 can switch between chat, decision, and spoken requests quickly, and a 3B variant achieved 60-100 decisions per second playing Doom, compared to Jev’s 10, while also narrating and answering questions.


### [Build an AI matching engine with Docling, Granite & OpenShift AI](https://yomu.fyi/post/build-an-ai-matching-engine-with-docling-granite-openshift-ai.md)
- Company: [Red Hat](https://yomu.fyi/company/red-hat.md)
- Author: Peter Samouelian, Swati Kale, Francesco Pace
- Published: Oct 12, 2026
- Type: Tutorial

PeopleMesh uses Docling and Granite4:3B LLM on Red Hat OpenShift to extract structured data from PDF resumes and match people across multiple dimensions. Docling converts documents into a DoclingDocument with semantic labels using an AI model trained on 150,000 annotated samples to recover reading order from PDF’s print-oriented encoding, then exports to Markdown for LLM-driven JSON extraction via a system prompt. For matching, PeopleMesh decomposes a user query with an LLM to extract intent, entity type, country, and language, then applies structured filtering followed by semantic vector search via cosine similarity on distilled query embeddings. To mitigate embedding dilution from concatenated concepts, PeopleMesh uses a weighted scoring algorithm that reranks top 100 candidates using 7 information channels including nice-to-have skills and penalty multipliers for missing must-have and negative skills. The scoring provides relative ordering only, not normalized probabilities, and default weights are adjustable via the SearchOptions Java record.