granite-switch

ibm-granite/granite-switch-4.1 30B/8B Granite Switch 4.1 30B 📝 Read the launch blog: Granite Switch 4.1: Chat, Decisions, and Speech from One Endpoint Model Summary: Granite Switch 4.1 30B is a modular LLM that composes a base model, multiple adapters and an encoder together so that a single hosted endpoint can move between natural-language responses, general and specialized decisions, and speech-to-text. Adapters are activated on demand via control tokens in the chat template. For full details on model composition and adapter configuration, see BUILD.md. - Base Model: ibm-granite/granite-4.1-30b (30B params, 128K context) - Adapters: 2 — decision (aLoRA, general-purpose Decisions) and guardian-core (aLoRA, from granitelib-guardian-r1.0) - Audio: embedded speech-to-text via ibm-granite/granite-speech-5.0-470m-turboctc (470M params, English) - License: Apache 2.0 - Release Date: October 14, 2026 - Backends: HuggingFace Transformers, vLLM - Automatically Composed with: granite-switch Granite Switch is also available in granite-switch-4.1-8b (same Chat + Decisions + Guardian + speech configuration, 8B base), and with the complete Granite Libraries bundle (no audio) in granite-switch-4.1-30b-preview, -8b-preview, and -3b-preview. huggingface.co huggingface.co preview.redd.it (video on the blog) I think llama.cpp support is not yet ready? llama.cpp#30621