Researchers introduce Video-LLaVA, a unified vision-language model that aligns visual representations of images and videos into a unified feature space before projection. It outperforms benchmarks in image question-answering and excels in video understanding. Future research could explore advanced alignment techniques and unified tokenization for further enhancements.
Sort: