Role & responsibilities
- Hand on Expertise of 6- 8 years in AWS services like S3, Lambda, Glue, Athena, RDS, Step functions, SNS, SQS, API Gateway, Security, Access and Role permissions, Logging and monitoring Services.
- Good hand on knowledge on Python, Spark, Hive and Unix, AWS CLI
- Prior experience in working with streaming solution like Kafka .
- Prior experience in implementing different file storage types like Delta-lake / Ice-berg.
- Excellent knowledge in Data modeling and Designing ETL pipeline.
- Must have strong knowledge in using different databases such as MySQL, Oracle and Writing complex queries.
- Strong experience working in a continuous integration and Deployment process.
Nice to Have:
Hand on experience in the Terraform, GIT, GIT Actions. and Amazon Q.
Must have technical skill
Pyspark, AWS, SQL, Kafka, CICD pipeline
Good to have technical skills
Terraform, GIT, GIT Actions, AI
