Search by job, company or skills

zorba ai

Data Engineer Python/Pysaprk AWS

Save
  • Posted an hour ago
  • Be among the first 10 applicants
Early Applicant

Job Description

Desired Competencies (Technical/Behavioral Competency)

Must-Have**

(Ideally should not be more than 3-5)

Total Experience > 5 Years with 4 Years of relevant Experience

Should Have Working Experience:

  • Development: Python, PySpark & with Spark Framework
  • Cloud: 2+ years experience AWS Services (Lambda, S3, Glue, Step Functions, Event Bridge, ECS, EKS)
  • DevOps & IaC tooling: Terraform, CI/CD pipelines, Git

Good-to-Have

  • Python (preferred) or PowerShell scripting
  • SonarQube and Veracode.
  • Proficiency with automated testing tools (e.g. Pytest, Scalates).
  • Knowledge of RESTful and microservice architectures.

SN

Responsibility of / Expectations from the Role

1

Design, build, and maintain scalable, cloud-native data pipelines using AWS

2

Develop ETL/ELT workflows using Glue, Pyspark , and Python. Optimize data modeling, partitioning, and querying strategies.

3

Champion of DevOps practices, CI/CD pipelines, and cloud-native tooling to enhance posture and reduce friction.

4

Skilled in reading and developing Terraform-based infrastructure code

5

6

Details For Candidate Briefing**

(It should NOT contain any confidential information or references)

About Client:

world's leading global information services company, unlocking the power of data to create more opportunities for consumers, businesses, and society. In addition, for the last five years they've been listed as one of the 100 World's Most Innovative Companies by Forbes Magazine

USP Of The Role And Project:

Desired Competencies (Technical/Behavioral Competency)

Must-Have**

(Ideally should not be more than 3-5)

Total Experience > 5 Years with 4 Years of relevant Experience

USP Of The Role And Project:

Desired Competencies (Technical/Behavioral Competency)

Must-Have**

(Ideally should not be more than 3-5)

Total Experience > 5 Years with 4 Years of relevant Experience

Should Have Working Experience:

  • Development: Python, PySpark & with Spark Framework
  • Cloud: 2+ years experience AWS Services (Lambda, S3, Glue, Step Functions, Event Bridge, ECS, EKS)
  • DevOps & IaC tooling: Terraform, CI/CD pipelines, Git



Good-to-Have

  • Python (preferred) or PowerShell scripting
  • SonarQube and Veracode.
  • Proficiency with automated testing tools (e.g. Pytest, Scalates).
  • Knowledge of RESTful and microservice architectures.

SN

Responsibility of / Expectations from the Role

1

Design, build, and maintain scalable, cloud-native data pipelines using AWS

2

Develop ETL/ELT workflows using Glue, Pyspark , and Python. Optimize data modeling, partitioning, and querying strategies.

3

Champion of DevOps practices, CI/CD pipelines, and cloud-native tooling to enhance posture and reduce friction.

4

Skilled in reading and developing Terraform-based infrastructure code

5

6

Details For Candidate Briefing**

(It should NOT contain any confidential information or references)

About Client:



world's leading global information services company, unlocking the power of data to create more opportunities for consumers, businesses, and society. In addition, for the last five years they've been listed as one of the 100 World's Most Innovative Companies by Forbes Magazine

USP Of The Role And Project:

Desired Competencies (Technical/Behavioral Competency)

Must-Have**

(Ideally should not be more than 3-5)

Total Experience > 5 Years with 4 Years of relevant Experience

Should Have Working Experience:

  • Development: Python, PySpark & with Spark Framework
  • Cloud: 2+ years experience AWS Services (Lambda, S3, Glue, Step Functions, Event Bridge, ECS, EKS)
  • DevOps & IaC tooling: Terraform, CI/CD pipelines, Git



Good-to-Have

  • Python (preferred) or PowerShell scripting
  • SonarQube and Veracode.
  • Proficiency with automated testing tools (e.g. Pytest, Scalates).
  • Knowledge of RESTful and microservice architectures.

SN

Responsibility of / Expectations from the Role

1

Design, build, and maintain scalable, cloud-native data pipelines using AWS

2

Develop ETL/ELT workflows using Glue, Pyspark , and Python. Optimize data modeling, partitioning, and querying strategies.

3

Champion of DevOps practices, CI/CD pipelines, and cloud-native tooling to enhance posture and reduce friction.

4

Skilled in reading and developing Terraform-based infrastructure code

5

6

Details For Candidate Briefing**

(It should NOT contain any confidential information or references)

About Client:



world's leading global information services company, unlocking the power of data to create more opportunities for consumers, businesses, and society. In addition, for the last five years they've been listed as one of the 100 World's Most Innovative Companies by Forbes Magazine

Should Have Working Experience:

  • Development: Python, PySpark & with Spark Framework
  • Cloud: 2+ years experience AWS Services (Lambda, S3, Glue, Step Functions, Event Bridge, ECS, EKS)
  • DevOps & IaC tooling: Terraform, CI/CD pipelines, Git



Good-to-Have

  • Python (preferred) or PowerShell scripting
  • SonarQube and Veracode.
  • Proficiency with automated testing tools (e.g. Pytest, Scalates).
  • Knowledge of RESTful and microservice architectures.

SN

Responsibility of / Expectations from the Role

1

Design, build, and maintain scalable, cloud-native data pipelines using AWS

2

Develop ETL/ELT workflows using Glue, Pyspark , and Python. Optimize data modeling, partitioning, and querying strategies.

3

Champion of DevOps practices, CI/CD pipelines, and cloud-native tooling to enhance posture and reduce friction.

4

Skilled in reading and developing Terraform-based infrastructure code

5

6

Details For Candidate Briefing**

(It should NOT contain any confidential information or references)

About Client:



world's leading global information services company, unlocking the power of data to create more opportunities for consumers, businesses, and society. In addition, for the last five years they've been listed as one of the 100 World's Most Innovative Companies by Forbes Magazine

USP Of The Role And Project:

Skills: terraform,aws,cloud,python,devops,pyspark











More Info

Job Type:
Industry:
Employment Type:

About Company

Job ID: 150998625