Key Responsibilities:
- Design, Migrate, build, and maintain data pipelines for performance, scalability, and reliability
- Develop and maintain data models and schemas
- Integrate data from diverse sources.
- Ensure data quality and implement data governance policies.
- Able to create reports using PowerBI.
- Collaborate with data analysts, product owners and other stakeholders for the Data requirements and support the releases.
Minimum Skills & Qualifications:
- Bachelor s degree in computer science & engineering with at least 1-3 years of working experience.
- Strong proficiency in SQL: Ability to write complex queries, perform data manipulation, and understand database concepts (both relational and potentially NoSQL).
- Proficiency in at least one programming language relevant to data engineering (e.g., Python, Java): Python is preferable.
- Understanding of data modeling concepts: Including relational modeling, dimensional modeling and schema design.
- Familiarity with ETL/ELT processes and tools: Knowledge of data integration and transformation techniques.
- Basic understanding of database systems (AWS Aurora DB, Dynamo DB and RDS) with data warehousing principles(Preferably AWS Redshift):
- Basic understanding of cloud computing concepts: Familiarity with at least one major cloud platform (AWS or Azure) is often a plus.
- Strong problem-solving and critical thinking abilities
- Excellent communication and collaboration skills
- Understanding of the agile development methodology
Preferred Skills and Qualifications:
- Experience with AWS cloud platform and their data engineering services: AWS (Redshift, Aurora, Dynamo, RDS).
- Proficiency at Python programming relevant to data engineering concepts.
- Familiarity with data governance and data quality frameworks and tools.
- Experience in setting up and managing CI/CD pipelines using tools such as Jenkins or similar
- Knowledge/working with Semi-conductor domain (Foundry) is an added plus.
- Experience with data visualization with Power BI.
- Experience with Agile development methodologies.
- Good to have any relevant certifications (e.g., AWS Certified Data Engineer)
