Meet Graph-Mamba: A Novel Graph Model that Leverages State Space Models SSM for Efficient Data-Dependent Context Selection

Graph-Mamba is an innovative graph model that integrates a selective SSM into the GraphGPS framework, achieving advanced sparsification and promising significant improvements in computational efficiency and scalability. It outperforms sparse attention methods and rivals dense attention Transformers.