Tech Lead / Senior Data Engineer

Job Summary

We are looking for an experienced Senior Data Engineer with 7+ years of hands-on experience in designing, developing, monitoring, troubleshooting, and optimizing scalable data pipelines and data architectures.

The ideal candidate should have strong expertise in AWS, PySpark, AWS Glue, Apache Airflow, Amazon S3, Apache Iceberg, Amazon Redshift, and PostgreSQL. The candidate will be responsible for building reliable data pipelines, optimizing data processing workflows, and ensuring high availability and performance of data solutions.

Key Responsibilities

• Design, develop, and maintain scalable and reliable data pipelines using AWS data services and modern data engineering technologies.
• Develop and optimize data processing solutions using PySpark.
• Build and manage ETL/ELT workflows using AWS Glue.
• Design, schedule, monitor, and troubleshoot workflows using Apache Airflow.
• Work with Amazon S3 and Apache Iceberg for scalable data storage and data lake solutions.
• Develop and optimize data solutions using Amazon Redshift.
• Work with PostgreSQL for data storage, querying, and data integration.
• Monitor data pipelines and proactively identify and resolve failures and performance issues.
• Perform troubleshooting, debugging, and root-cause analysis of data pipeline issues.
• Optimize data pipelines, queries, and processing jobs for improved performance and scalability.
• Participate in data architecture and solution design activities.
• Ensure data quality, reliability, consistency, and security across data workflows.
• Collaborate with application developers, data analysts, architects, and other stakeholders to deliver data solutions.
• Follow best practices for coding, testing, deployment, monitoring, and documentation.

If you are interested in this opportunity, please share your updated CV along with the below details to [HIDDEN TEXT]:

Candidate Name

Contact Number

Total Experience

Relevant Experience

Current Location

Preferred Work Location – Hyderabad / Trivandrum / Kochi

Current CTC

Expected CTC

Notice Period

Last Working Day (LWD), if serving notice

Availability for F2F L1 Interview