About the Role
We are looking for an AWS Data Engineer / Data Architect to design, build and maintain a modern AWS Data Lake and Lakehouse platform.
You will work on data ingestion, transformation, storage, security and governance, while ensuring data pipelines are reliable, scalable and cost-effective.
Key Responsibilities
- Design and develop AWS Data Lake and Lakehouse solutions.
- Build data pipelines using APIs, databases, files and SaaS platforms.
- Develop data ingestion and transformation workflows.
- Work with AWS Glue, S3, Redshift, Lambda and Step Functions.
- Manage data processing for both batch and streaming data.
- Maintain the AWS Glue Data Catalogue and data metadata.
- Implement data security and access controls.
- Monitor and troubleshoot data pipelines and data quality issues.
- Maintain technical documentation.
- Improve platform performance, reliability and AWS cost efficiency.
Requirements
Must have:
- 3-5 years of experience in Data Engineering, Data Architecture, Cloud Infrastructure or a related role.
- Strong hands-on experience with: Amazon S3 | AWS Glue | Amazon Redshift | AWS Lambda | AWS Step Functions | Amazon Kinesis | Amazon EventBridge | AWS AppFlow | AWS Lake Formation
- Strong SQL skills.
- Experience with Python or Scala.
- Experience designing and implementing Data Lake or Lakehouse architectures.
- Experience with data governance, data cataloguing and metadata management.
- Experience with batch and streaming data processing.
- AWS Certified Data Engineer - Associate, AWS Certified Solutions Architect or equivalent certification.
Good to Have
- Experience with Tableau or other BI tools.
- Experience with AWS SageMaker or MLOps.
- Experience integrating Salesforce using AWS AppFlow.
- Knowledge of Change Data Capture (CDC) and incremental data loads.
- Government or public sector data experience.
Interested candidates are encouraged to submit their resumes outlining their relevant experience and achievements to sherriyang(@)talentvis.com or click apply!
..We regret to inform that only shortlisted candidates would be notified..
EA License No: 04C3537
EA Personnel No: R22106683
EA Personnel Name: Yang Hui Shan, Sherri