Amazon EMR Serverless now offers Apache Spark 4.0.1 in preview, introducing ANSI SQL support for easier data pipeline development, VARIANT data types for handling JSON and semi-structured data, Apache Iceberg v3 table format for enhanced compliance and governance, and improved streaming capabilities for real-time applications. The release aims to reduce technical debt, improve data accuracy, and enable faster deployment of use cases like fraud detection and real-time personalization. Available in most AWS regions except China and GovCloud.
Sort: