Introducing the Palmyra-mini family: Powerful, lightweight, and ready to reason!

Summary

WRITER released three open models in the Palmyra-mini family ranging between 1.5B and 1.7B parameters, designed for efficient inference and specialized reasoning tasks. Built on the Qwen architecture, the release includes the standard palmyra-mini base model alongside two Chain of Thought variants, palmyra-mini-thinking-a and palmyra-mini-thinking-b. In benchmark evaluations, palmyra-mini achieved 52.6% on Big Bench Hard, while palmyra-mini-thinking-a reached 82.87% on GSM8K and palmyra-mini-thinking-b reached 92.5% on AMC23. For palmyra-mini-thinking-b, applying reinforcement learning fine-tuning to an OpenReasoning-Nemotron-1.5B base improved single-shot pass@1 accuracy while reducing sampling diversity and majority@64 performance. The models are available in GGUF and MLX-BF16 quantizations and support inference engines including vLLM, SGLang, TRTLLM, and TGI.

Takeaways

1. 1

   Palmyra-mini-thinking-a achieved 82.87% on GSM8K (strict match) and held the highest overall average benchmark score among the released models.

2. 2

   Palmyra-mini-thinking-b scored 92.5% on AMC23 and led average benchmark scores across AIME24, AIME25, GPQA, HMMT25, HLE, MMLU_PRO, MATH500, and LCB.

3. 3

   Reinforcement learning fine-tuning improved pass@1 single-shot accuracy on palmyra-mini-thinking-b but reduced sampling diversity, resulting in lower majority@64 performance compared to the SFT base model.