Abstract
We introduce BitNet b1.58 2B4T, the first open-source, native 1-bit LargeLanguage Model (LLM) at the 2-billion parameter scale. Trained on a corpus of 4trillion tokens, the model has been rigorously evaluated across benchmarkscovering language understanding, mathematical reasoning, coding proficiency,and conversational ability. Our results demonstrate that BitNet b1.58 2B4Tachieves performance on par with leading open-weight, full-precision LLMs ofsimilar size, while offering significant advantages in computationalefficiency, including substantially reduced memory footprint, energyconsumption, and decoding latency. To facilitate further research and adoption,the model weights are released via Hugging Face along with open-sourceinference implementations for both GPU and CPU architectures.