Seeking a skilled Data Engineer to design, develop, and optimize data pipelines and systems using cutting-edge technologies.
Key Responsibilities:
- Build and maintain scalable data pipelines with tools like Airflow.
- Develop big data solutions using Spark, Hadoop, and ETL processes.
- Design data models and manage storage in Redshift, BigQuery, and cloud platforms (AWS, Azure).
- Write efficient Python, Java, and SQL code for data processing and automation.
- Collaborate with stakeholders to deliver robust data solutions.
- Ensure efficient data ingestion from various sources into SQL databases.
- Troubleshoot complex issues related to data quality, performance, and security.
- Design, develop, and maintain large-scale data pipelines using Python, Spark, and Pandas.
Qualifications:
- Bachelor's degree in a relevant field.
- 3+ years of experience in data engineering.
- Proficiency in Python, Java, ETL tools, and big data technologies.
- Expertise in SQL, NoSQL, and cloud-based data solutions.
Preferred:
- Knowledge of Docker, Kubernetes, CI/CD, and data security.
