New Amazon Builders’ Library Article: Avoiding overload in distributed systems by putting the smaller service in control

By Dustin Ward

Amazon Web Services FeedNew Amazon Builders’ Library Article: Avoiding overload in distributed systems by putting the smaller service in control Today, the Amazon Builders’ Library published a new article titled, Avoiding overload in distributed systems by putting the smaller service in control. AWS Senior Principal Engineer Joe Magerramov dives deep into the strategies for avoiding…

AWS Firewall Manager helps automate security group management: 3 scenarios

By Dustin Ward

Amazon Web Services FeedAWS Firewall Manager helps automate security group management: 3 scenarios In this post, we walk you through scenarios that use AWS Firewall Manager to centrally manage security groups across your AWS Organizations implementation. Firewall Manager is a security management tool that helps you centralize, configure, and maintain AWS WAF rules, AWS Shield…

How nClouds Helps Accelerate Data Delivery with Apache Hudi on Amazon EMR

By Dustin Ward

Amazon Web Services FeedHow nClouds Helps Accelerate Data Delivery with Apache Hudi on Amazon EMR By Deepu Mathew, Sr. DevOps Engineer at nCloudsBy Fernando Gonzalez, Sr. DevOps Engineer at nCloudsBy Kireet Kokala, VP Big Data & Analytics at nClouds At nClouds, customers often ask us for help with their data and analytics platform when their…

Using multiple queues and instance types in AWS ParallelCluster 2.9

By Dustin Ward

Amazon Web Services FeedUsing multiple queues and instance types in AWS ParallelCluster 2.9 Since its release as an officially supported AWS tool and open source project in November 2018, AWS ParallelCluster has made it simple for high performance computing (HPC) customers to set up easy-to-use environments with compute, storage, job scheduling, and networking in the…

Integrating Jenkins with AWS CodeArtifact to publish and consume Python artifacts

By Dustin Ward

Amazon Web Services FeedIntegrating Jenkins with AWS CodeArtifact to publish and consume Python artifacts Python packages are used to share and reuse code across projects. Centralized artifact storage allows sharing versioned artifacts across an organization. This post explains how you can set up two Jenkins projects. The first project builds the Python package and publishes…