Senior Data Engineer

What You&aposll Do:

• Design and implement data pipelines on data lake/data lakehouse concept.
• Design and implement self-service tools in data platform (orchestration tool and data quality tool).
• Design and implement data validation process to improve data quality in data pipeline.
• Monitor data platform cluster (Kubernetes).
• Design and implement data observability process to monitor data pipeline.
• Design and implement data lineage process to tracking data movement.
• Design and implement data models to support analysts.
• Coaching other team members.

About You:

• At least 4+ years of experience in designing and implementing data pipelines on data lake/data lakehouse concepts.
• Experience with Apache Spark and Apache Airflow.
• Ability to manage multiple projects.
• Understanding of data quality and data validation concepts.
• Strong programming skills (SQL, Python, Scala)
• Strong in using Docker and Kubernetes.
• Experience in coding standard and testing practices.
• A growth mindset with a passion for learning and knowledge sharing.

Its Great if you have:

• Understanding of data lineage, data observability, or data mesh concept is a plus
• Data analytics engineer experience is a plus

Sound interesting Apply Now!