Running cost optimized Spark workloads on Kubernetes using EC2 Spot Instances
AWS FeedRunning cost optimized Spark workloads on Kubernetes using EC2 Spot Instances This post is written by Kinnar Sen, Senior Solutions Architect, EC2 Spot Apache Spark is an open-source, distributed processing system used for big data workloads. It provides API operations to perform multiple tasks such as streaming, extract transform load (ETL), query, machine learning (ML),…