Microsoft BitNet Accelerates 1-Bit LLMs on Standard CPUs
Microsoft expanded its open-source BitNet framework to support native 1.58-bit ternary weight quantization {-1, 0, 1} across commodity x86 and ARM processors. By replacing floating-point matrix multiplications with simple integer additions, BitNet drastically reduces memory bandwidth requirements. This allows standard client CPUs to run on-device speech recognition and local reasoning without requiring dedicated GPU acceleration.
Primary sources