I need to use a newer boto3 package for an AWS Glue Python3 shell job (Glue Version: 1.0).
The default version is very old and hence all the API's does not work
For eg pause_cluster() and resume_cluster() does not work in AWS Glue Python Shell due to this older version
https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/redshift.html
/>
Similarly for many other product features.
Additionally, we don't have to Glue internet access by security and hence need a solution based on s3 storage libraries
Which is the best way to upgrade the Python Shell as it seems the lightest weight part of our architecture
Basically, we are using python glue shell as our core workflow engine to asynchronously deisgn our pipeline through boto3 apis
AWS Glue Python Shell Upgrade Boto3 Library without Internet Access
Programing Coderfunda
October 09, 2023
No comments
Related Posts:
Bootstrap - ButtonsBootstrap - Buttons This chapter covers the use age of Bootstrap button with examples. Anything that is given a class of .btn will inherit the default… Read More
Bootstrap - TablesBootstrap - Tables Bootstrap provides a clean layout for building tables. Some of the table elements supported by Bootstrap are − TagDescription&… Read More
Bootstrap - Helper ClassesBootstrap - Helper ClassesCaretsUse carets to indicate dropdown functionality and direction. To get this functionality use the class caret with a <… Read More
Bootstrap - FormsBootstrap - FormsIn this chapter, we will study how to create forms with ease using Bootstrap. Bootstrap makes it easy with the simple HTML markup an… Read More
Bootstrap - CodeBootstrap - CodeBootstrap allows you to display code with two different key ways − The first is the <code> tag. If you are going to be displayin… Read More
0 comments:
Post a Comment
Thanks