Recently, Amazon EMR introduced software releases referenced by their release label rather than the AMI version. AWS Data Pipeline now supports Amazon EMR 4.x software releases. You can specify the required release in the releaseLabel field on the EmrCluster object in your pipeline. Using the EmrConfiguration object, you can specify cluster configurations, such as choosing the applications to be installed at cluster creation, or setting the Apache Hadoop environment variables.
To learn more, please refer to AWS Data Pipeline documentation.
from What's New from Amazon Web Services http://ift.tt/1jUs8CM
No comments:
Post a Comment