In this presentation, Raia Hadsell, VP of Research at Google DeepMind and AI Ambassador for the United Kingdom, opens AIE Europe and explores what's open in Frontier AI and the future of intelligence by focusing on advancements beyond standard large language models. She categorizes these innovations into three key areas:

00:00 Introduction
05:05 Advanced Embedding Models: Raia discusses the importance of embedding models for fast retrieval and recognition, similar to how the human brain uses 'Jennifer Aniston cells' to identify concepts across modalities. She highlights Gemini Embeddings 2, a fully omnimodal model that processes text, video, and audio into unified semantic vectors.
09:53 AI for Weather Forecasting: The team has developed revolutionary models for atmospheric prediction, moving away from traditional physics simulations. Notable breakthroughs include:
11:00 GraphCast: A spherical graph neural network that provides accurate 15-day weather forecasts.
12:47 GenCast: A probabilistic model that offers higher efficiency and accuracy (97% of the time compared to gold-standard benchmarks).
13:51 FGN: A functional generative network that directly predicts cyclone behavior, which is currently being utilized by the US National Hurricane Center.
14:35 World Models: Hadsell introduces Genie, a project focused on creating interactive, real-time environments. Starting from Genie 1 (2D platformers) and progressing to Genie 3, these models allow users to create and interact with high-quality, 3D photorealistic worlds. These environments demonstrate capabilities like memory, consistency, and the ability to be dynamically prompted by the user to change the surroundings in real-time.

Speaker info:
- https://uk.linkedin.com/in/raia-hadsell-35400266
- https://github.com/raiah

AI Engineer

Raia Hadsell, VP of Research at Google DeepMind, presents three non-language-model AI research areas. First, Gemini Embeddings 2, a fully omnimodal embedding model supporting text, video, audio, and PDFs in a unified semantic space using Matryoshka Representation Learning. Second, weather forecasting models GraphCast, GenCast, and FGN — a series of graph neural network models that outperform physics-based forecasts, with FGN directly predicting cyclone trajectories and already in use by the US National Hurricane Center. Third, Genie 3, an interactive world model that generates real-time, photorealistic, memory-consistent 3D environments from text or video prompts, available to Gemini Ultra subscribers.

Frontier AI and the Future of Intelligence — Raia Hadsell, VP of Research, Google DeepMind