Amazon EMR Serverless now makes it easier to specify fine grained log configurations for your driver and executor logs. Spark uses Log4j2 to configure logs for Spark and Apache Hive. Spark's default log settings can be too verbose, making it difficult to find relevant log entries.

1m read timeFrom aws.amazon.com
Post cover image

Sort: