Granite 4.0 Nano: Just how small can you go?

Summary

IBM has released Granite 4.0 Nano, a collection of sub-billion and ~1.5B parameter language models tailored for edge and on-device deployments. Trained on more than 15 trillion tokens under an Apache 2.0 license, the suite includes four instruct models alongside their base counterparts. The lineup introduces hybrid-SSM architectures—specifically the ~1.5B parameter Granite 4.0 H 1B and the ~350M parameter Granite 4.0 H 350M—as well as standard transformer variants suited for runtimes like llama.cpp. According to benchmark results across general knowledge, math, code, and safety domains, these compact models demonstrated strong capability improvements relative to their parameter footprint. Furthermore, evaluation on IFEval and Berkeley's Function Calling Leaderboard v3 indicated competitive performance on instruction following and tool calling tasks.

Takeaways

1. 1

   Granite 4.0 Nano provides both hybrid-SSM architectures (H 1B and H 350M) and standard transformer variants (1B and 350M) for platforms lacking hybrid runtime support.

2. 2

   The models were trained on over 15 trillion tokens under an Apache 2.0 license and carry ISO 42001 certification for responsible model governance.

3. 3

   In evaluations using IFEval and Berkeley's Function Calling Leaderboard v3, Granite Nano outperformed several similarly sized models on instruction following and tool calling.