Not able to create AWS Glue Job

Playgrounds
#1

When I try to create an AWS Glue Job(the example job - Visual ETL job to join multiple sources), I get an error when trying to assign role.

image
image1330×304 40.8 KB

Note: I created this role, since I was not able to see any other roles in the dropdown.

Also, I believe Glue is one of the supported services in the AWS Playground as I can see it in the AWS Playgrounds page. Is there a guide anywhere that tells how to set up the jobs?

#2

Our playgrounds only cover a limited set of AWS services, both for security and also to keep the pricing of our playgrounds in a reasonable range. So AWS Glue is not part of our offering. You’d need a person account to try this particular service.

#3

So how can I know which services are available under the kodekloud playground?

https://kodekloud.com/cloud-playgrounds/aws

In the above page, AWS GLue was listed. So, I thought it was available.

#4

My mistake. They add things frequently, and I was unaware of Glue being added. Let me take a closer look.

#5

Could you please describe, step by step, what you tried to do? I will probably have to pass this to one of our lab engineers who are more familiar with how this playground is configured in order to ferret out what permissions you need to do this, and the more detail you can give, the better they’ll be able to check.

#6

Nothing fancy. I just tried to set up their example job to see if everything works before I do something else.

  1. On the AWS Glue page, ETL jobs page, I selected the example job(Visual ETL job to join multiple sources) to be set up.
  2. Then I created a role for glue since no options were shown in the dropdown of the execution role of the job details by default.
  3. I selected the created role and tried to save the job. And it errors out with IAM PassRole.
    image
    image1903×550 51 KB

I am assuming we can only use already defined roles, but I am not able to see any in the dropdown by default. That’s why I created a role with access to S3 services.

Also, I am assuming S3 is the most basic of accesses needed for this. We may need to have access to other services as well, like RDS, etc.

#7

I wouldn’t call the interface as terribly intuitive, but you want to let Glue’s wizard “Prepare your account for AWS Glue” for IAM, rather than try to do it via IAM’s interface. I could not get the latter to work, but the wizard does fine for you. I ended up using this video to generally guide me on the basics for Glue. Once you can get the catalog and databases working, see what it takes for ETL.

#8

Same error as before but on a different step.

I tried to follow the video that you suggested and when I was trying to set up the crawler, it threw the same IAM: PassRole error. Even though I believe I was using a predefined role.

image
image1063×463 55.8 KB

When I tried creating a new role and attach it, the same error again.

How can I pass the role to the service if I do not have the IAM: PassRole assigned to me?

#9

I seemed to make it work. Will keep you posted. Sorry for the confusion.

Edit: It worked perfectly fine. Thanks again for all the help!