Running on-demand, serverless Apache Spark data processing jobs using Amazon SageMaker managed Spark containers and the Amazon SageMaker SDK

By Dustin Ward

Amazon Web Services FeedRunning on-demand, serverless Apache Spark data processing jobs using Amazon SageMaker managed Spark containers and the Amazon SageMaker SDK Apache Spark is a unified analytics engine for large scale, distributed data processing. Typically, businesses with Spark-based workloads on AWS use their own stack built on top of Amazon Elastic Compute Cloud (Amazon…

Normalize data with Amazon Elasticsearch Service ingest pipelines

By Dustin Ward

Amazon Web Services FeedNormalize data with Amazon Elasticsearch Service ingest pipelines Amazon Elasticsearch Service (Amazon ES) is a fully managed service that makes it easy for you to deploy, secure, and run Elasticsearch cost-effectively at scale. Search and log analytics are the two most popular use cases for Amazon ES. In log analytics at scale,…

Deploying open source web conferencing solution BigBlueButton on AWS

By Dustin Ward

Amazon Web Services FeedDeploying open source web conferencing solution BigBlueButton on AWS Major advancements in technology have drastically changed how and where we conduct business. Pushed by the increased number of employees working remotely, the globalization of businesses, and the rise of instant, on-demand communications, technology has had to adapt. For modern and innovative businesses…

Azure Cost Management + Billing updates – September 2020

By Dustin Ward

Whether you’re a new student, thriving startup, or the largest enterprise, you have financial constraints, and you need to know what you’re spending, where, and how to plan for the future. Nobody wants a surprise when it comes to the bill, and this is where Azure Cost Management + Billing comes in. We’re always looking…

Scaling Microsoft Kaizala on Azure

By Dustin Ward

This post was co-authored by Anubhav Mehendru, Group Engineering Manager, Kaizala. Mobile-only workers depend on Microsoft Kaizala—a simple and secure work management and mobile messaging app—to get the work done. Since COVID-19 has forced many of us to work from home across the world, Kaizala usage has surged close to 3x from pre-COVID-19. While this…