You can now use Apache Spark 2.2.1, Apache Hive 2.3.2, and Amazon SageMaker integration with Apache Spark on Amazon EMR release 5.11.0. Spark 2.2.1 and Hive 2.3.2 include various bug fixes and improvements. Amazon SageMaker Spark is an open-source Spark library for Amazon SageMaker, a fully-managed service which can build, train, and deploy machine learning models at scale. It enables you to interleave Spark stages and stages that interact with Amazon SageMaker in your Spark ML Pipelines, allowing you to train models using Spark DataFrames in Amazon SageMaker with Amazon-provided ML algorithms like K-Means clustering or XGBoost.
from What's New (Thursday) http://ift.tt/2BPQwA3
No comments:
Post a Comment