Automating EMR workloads using AWS Step Functions

By Dustin Ward

Amazon Web Services FeedAutomating EMR workloads using AWS Step Functions Amazon EMR allows you to process vast amounts of data quickly and cost-effectively at scale. Using open-source tools such as Apache Spark, Apache Hive, and Presto, and coupled with the scalable storage of Amazon Simple Storage Service (Amazon S3), Amazon EMR gives analytical teams the…

AWS Glue supports reading from self-managed Apache Kafka

By Dustin Ward

Amazon Web Services FeedAWS Glue supports reading from self-managed Apache Kafka Streaming extract, transform, and load (ETL) jobs in AWS Glue can now ingest data from Apache Kafka clusters that you manage yourself. Previously, AWS Glue supported reading specifically from Amazon Managed Streaming for Apache Kafka (Amazon MSK). With this update, AWS Glue allows you…

Field Notes: Implementing Hardware-in-the-Loop for Autonomous Driving Development on AWS

By Dustin Ward

Amazon Web Services FeedField Notes: Implementing Hardware-in-the-Loop for Autonomous Driving Development on AWS Automotive customers use AWS as their platform for advanced driving assistance systems (ADAS) and autonomous driving (AD) development to accelerate their development cycles and experience faster time-to-market.  In the blog post, Autonomous Vehicle and ADAS development on AWS Part 1: Achieving Scale,…

Integrating the OpenTelemetry JavaScript SDK with AWS X-Ray

By Dustin Ward

Amazon Web Services FeedIntegrating the OpenTelemetry JavaScript SDK with AWS X-Ray In this blog post, AWS intern Cong Zou shares his experience contributing to a large open source project—OpenTelemetry—for the first time. OpenTelemetry provides a single set of APIs, libraries, agents, and collector services to capture distributed traces and metrics from applications. Users can analyze…

Event-driven refresh of SPICE datasets in Amazon QuickSight

By Dustin Ward

Amazon Web Services FeedEvent-driven refresh of SPICE datasets in Amazon QuickSight Businesses are increasingly harnessing data to improve their business outcomes. To enable this transformation to a data-driven business, customers are bringing together data from structured and unstructured sources into a data lake. Then they use business intelligence (BI) tools, such as Amazon QuickSight, to…