Skip to content

[Enhancement] New Worker Type R and G.12X and G.16 #43446

@GonkCoelho

Description

@GonkCoelho

Description

Hi,

There is a new type of worker types that are type "R" which possess more memory then the G worker type. Which there is a need for some jobs that are spark intensive.

It seems that the new available worker types are:

  • R1.X
  • R2.X
  • R4.X
  • R8.X

It was also added for the G.12X and G.16X

I don't know if it is available yet in the AWS SDK but it is in the aws cli.

Affected Resource(s) or Data Source(s)

  • aws_glue_job

Potential Terraform Configuration

resource "aws_glue_job" "example" {
  name = "glue_job"
  
  worker_type = "R4.X"

  ...
}

References

https://aws.amazon.com/blogs/big-data/scale-your-aws-glue-for-apache-spark-jobs-with-r-type-g-12x-and-g-16x-workers/

Would you like to implement the enhancement?

No

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementRequests to existing resources that expand the functionality or scope.service/glueIssues and PRs that pertain to the glue service.

    Type

    No type

    Projects

    No projects

    Milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions