How Good Are the Latest Open LLMs? And Is DPO Better Than PPO?

The post discusses the latest open LLM releases including Mixtral 8x22B, Llama 3, Phi-3, and OpenELM. It also compares the performance of Mixtral 8x22B to other LLMs and explores the training data size for Llama 3. Additionally, it provides a comprehensive study on whether DPO is superior to PPO for LLM alignment.