NVIDIA and Siemens Healthineers have developed NV-Raw2Insights-US, an AI model that learns directly from raw ultrasound channel data rather than reconstructed images. The model estimates patient-specific speed-of-sound maps to enable adaptive image focusing in real time, replacing traditional hand-engineered beamforming pipelines that make simplifying physics assumptions. Deployment uses NVIDIA Holoscan Sensor Bridge with an FPGA to stream raw data from existing ultrasound scanners via DisplayPort, then runs inference on Blackwell-class GPUs. The architecture is modular, allowing future AI models to be integrated without hardware changes. Model weights, dataset, and code are publicly available on GitHub and Hugging Face.

5m read timeFrom huggingface.co
Post cover image
Table of contents
IntroductionRaw2InsightsDeploymentSystem CapabilitiesClosing Perspective

Sort: