What are 1-bit LLMs?

1-bit LLMs are a new addition to the Generative AI world that can help eliminate challenges associated with LLMs, especially their huge size. These LLMs use only 1 bit to store weight parameters, reducing the overall size and enabling use on smaller devices. BitNet b1.58, a 1-bit LLM variant, shows promising results in terms of performance and optimization.