Nov 09 2021
Off

AWS Feed
Use AutoGluon-Tabular in AWS Marketplace

AutoGluon-Tabular is an open-source AutoML framework that requires only a single line of Python to train highly accurate machine learning (ML) models on an unprocessed tabular dataset. In this post, we walk you through a way of using AutoGluon-Tabular as a code-free AWS Marketplace product. We use this process to train and deploy a highly accurate ML model for a tabular prediction task.

Overview of AutoGluon-Tabular

Tabular data prediction, which includes both classification and regression, is the most prevalent class of prediction problems in business. If you’ve worked on this type of prediction problem before, you know that it’s a vast field with extreme diversity of data. Businesses want to build predictive models on top of data obtained through a wide array of sources, such as purchase histories, insurance claims, medical reports, and sensor readings streamed from IoT devices. This diversity has resulted in an enormous variety of modeling techniques.

Classical approaches have typically been dominated by domain expertise and careful, time-consuming feature engineering. However, if you follow data science competitions like those hosted by Kaggle, you may have noticed a transition happening. Lately, the most competitive approaches haven’t been encapsulated by domain experts with careful feature engineering, but instead by ML architecture experts, with large ensembles of models. Over time, the ML community has discovered that models that are worse in isolation are often superior in combination. This idea is sometimes known in other contexts as the diversity prediction theorem, or wisdom of the crowd. This effect is typically greatest when individual models are diverse and have errors in different ways.

This idea is at the core of AutoGluon-Tabular. AutoGluon-Tabular is designed to be straightforward, robust, efficient, accurate, and fault tolerant, returning to the latest checkpoint in the event of a failure. As a library, all the complexity has been abstracted away so that results can often be achieved with only three lines of code.

We’ve taken this one step further and launched AutoGluon-Tabular in the AWS Marketplace as one way of using AutoGluon-Tabular on AWS. It’s possible to build world-class models without a single line of code! In addition, you can take advantage of powerful Amazon SageMaker features. Amazon SageMaker is a fully managed service that provides every developer and data scientist with the ability to prepare build, train, and deploy machine learning models quickly. It makes it easy to deploy your trained model to production with a single click.

Solution overview

The following sections step you through how to use AutoGluon-Tabular in AWS Marketplace on the SageMaker console. If you want to use AutoGluon-Tabular in the AWS Marketplace in SageMaker notebooks, you can refer the following sample notebook.

We walk through the following steps:

  1. Subscribe to AutoGluon-Tabular in AWS Marketplace.
  2. Create a SageMaker training job.
  3. Create a model package.
  4. Deploy an endpoint.
  5. Create a SageMaker batch transform job.

Subscribe to AutoGluon-Tabular in AWS Marketplace

The first step is to subscribe to AutoGluon-Tabular in AWS Marketplace.

  1. Navigate to AutoGluon-Tabular in AWS Marketplace.
    ML 1461 image001 witharrows
  2. Choose Continue to Subscribe.
    ML 1461 image002 witharrows
  3. Choose Accept Offer.
    ML 1461 image003 witharros
  4. Choose Continue to configuration.
  5. For Software Version, choose version 3.5.
  6. For Region, choose a Region.
  7. Choose View in Amazon SageMaker.
    ML 1461 image004 witharrows

You’re redirected to the SageMaker console.

Create a SageMaker training job

To create a training job, complete the following steps:

  1. On the SageMaker console, create a new training job.
  2. For Job name, enter a name (for this post, autogluon-demo).
  3. For IAM role, choose an AWS Identity and Access Management (IAM) role.
  4. For Instance type, choose your instance size.
  5. For Additional storage volume per instance, enter your volume size.

We recommend using the m5 instance type and a volume size of more than 30 GB.
ML 1461 image005 witharrows

  1. In the Hyperparameters section, you can pass args for AutoGluon-Tabular.

The minimum requirement is to set the name of the label column to predict.
ML 1461 image006 witharrows

  1. In the Input data configuration section, for S3 location, enter the Amazon S3 location of your CSV file for training.
    ML 1461 image007 witharrows
  2. Optionally, specify the Amazon S3 location of your testing file.
  3. Specify the Amazon S3 location for your output data.
  4. Choose Create training job.

Create a model package

When training is complete, you can create a model package.

  1. On the Training jobs page on the SageMaker console, select your training job.
  2. On the Actions menu, choose Create model package.
    ML 1461 image008 witharrows
  3. For Model package name, enter a name (for this post, autogluon-demo).
  4. Select Provide the algorithm used for training and its model artifacts.
    ML 1461 image009 witharrows
  5. Choose Next.
  6. For Validate this resource, select No.
  7. Choose Create model package.
    ML 1461 image010 witharrows

Deploy an endpoint

To deploy your endpoint, complete the following steps:

  1. On the SageMaker console, choose the model package you created.
  2. Choose Create endpoint.
    ML 1461 image011 witharrows
  3. Choose Next.
  4. For Model name, enter a name (for this post, autogluon-demo).
  5. For Container input options, select Use a model package subscription from AWS Marketplace.
    ML 1461 image012 witharrows
  6. On the next page, for Endpoint name, enter a name (for example, autogluon-demo).
  7. Select the instance type.
  8. Choose Create endpoint configuration, then choose Submit.
    ML 1461 image013 witharrows

Create a SageMaker batch transform job

To create a batch transform job, complete the following steps:

  1. On the SageMaker console, navigate to the model you created.
  2. Choose Create batch transform job.
    ML 1461 image014 witharrows
  3. For Job name, enter a name (for this post, autogluon-demo).
  4. For Instance type, choose an instance type.
    ML 1461 image015 witharrows
  5. In the Input data configuration section, for Split type, choose Line.
  6. For Content type, enter text/csv.
  7. For S3 location, enter the S3 path of your CSV file.
    ML 1461 image016 witharrows
  8. For S3 output path, enter the S3 path for your output data.
  9. Choose Create job.
    ML 1461 image017 witharrows

Clean up resources

Finally, delete the endpoint when you’re done so you don’t incur further charges.

Conclusion

In this post, we walked you through how to train ML models and make predictions using AutoGluon-Tabular in AWS Marketplace via the SageMaker console. You can use this code-free solution to use the power of ML without any prior programming or data science expertise. Try it out and let us know how it goes in the comments!

About the Authors

NAK Yohei Nakayama is a Deep Learning Architect at the Amazon ML Solutions Lab. He works with customers across different verticals to accelerate their use of artificial intelligence and AWS Cloud services to solve their business challenges. He is interested in applying ML/AI technologies to the space industry.

Austin WelchAustin Welch is a Data Scientist at the Amazon ML Solutions Lab, where he helps AWS customers across different industries accelerate their AI and cloud adoption.

Arai TatsuyaTatsuya Arai Ph.D. is a biomedical engineer turned deep learning data scientist on the Amazon ML Solutions Lab team. He believes in the true democratization of AI and that the power of AI shouldn’t be exclusive to computer scientists or mathematicians.

Posted inAWS News
TagsAWS