We are seeking a Senior Data Engineer with deep expertise in AWS data services, Athena performance optimization, Airflow orchestration, and dbt transformations to help us diagnose, optimize, and enhance our existing data pipelines. The ideal candidate has hands-on experience improving large-scale, cloud-based analytics environments and can proactively identify bottlenecks across compute, storage, orchestration, and SQL/modeling layers.
You will collaborate closely with our Data team to review the current architecture, recommend improvements, and lead the implementation of performance enhancements.
Responsibilities:
- Review and assess the current AWS-based data platform, including S3, Athena, Glue, Lambda, and IAM configurations.
- Analyze existing Airflow DAGs, scheduling patterns, dependencies, and performance.
- Evaluate dbt project structure, model materializations, SQL performance, and lineage.
- Identify performance bottlenecks, inefficient queries, and unnecessary processing steps.
- Optimize AWS Athena workloads (partitioning, file formats, table design, query tuning).
- Improve ETL/ELT data pipelines for reliability, cost efficiency, and scalability.
- Implement best practices for data modeling, orchestration, and CI/CD in dbt.
- Provide guidance/documentation to the Data team on long-term improvements.
- Collaborate with analytics, engineering, and product teams to align data processing needs.
Required Qualifications
- 47+ years of experience in Data Engineering or Analytics Engineering.
- Strong hands-on experience with AWS (S3, Athena, Glue, Lambda, IAM).
- Proven track record optimizing Athena performance:
- Partitioning strategies
- Columnar file formats (Parquet/ORC)
- Table design & metadata tuning
- Query debugging and cost optimization
- Advanced Airflow expertise (DAG optimization, sensors, hooks, scheduling).
- Strong dbt experience:
- Modular modeling
- Performance tuning
- Materializations
- Testing and documentation
- Excellent SQL optimization skills.
- Experience working with large datasets and distributed systems.
- Strong communication skills to present architectural recommendations.
If you know someone based in Thailand who may be a good fit or is interested in this role, please encourage them to share their updated CV with us at [Confidential Information]
