Senior Data Engineer

Logic Planet

Remote

7-10 Years

Save

Posted 27 days ago
Over 200 applicants

Quick Apply

Job Description

• Strong hands-on experience in Python programming and backend data engineering development.

• Expertise in PySpark and Python-based data processing frameworks for handling large-scale data pipelines.

• Experience working with AWS Glue and PySpark for ETL development and data transformation processes.

• Good working knowledge of Python libraries such as Pandas, NumPy, and Joblib.

• Experience in parallel batch processing using Python for optimized performance and scalability.

• Hands-on experience with AWS Batch and AWS Step Functions for workflow orchestration and automation.

• Strong understanding of AWS services including ECS, ECR, Docker, CloudWatch, and Athena.

• Ability to design, build, and maintain scalable cloud-based data engineering solutions.

• Experience in developing efficient and reliable data pipelines in cloud environments.

• Collaborate with cross-functional teams to support data integration and analytics requirements.

• Troubleshoot and optimize data workflows to improve performance and reliability.

More Info

Job Type:

Permanent Job, Work From Home

Industry:

Consulting, Information Services

Role:

Other Roles

Function:

Others

Employment Type:

Full time

About Company

Logic Planet

Logicplanet IT Services (India) Pvt. Ltd., incorporated in 2007 and headquartered in Hyderabad, operates as a software publishing, consulting, and IT solutions provider. The company delivers enterprise technology services including software development, digital transformation, and IT staffing solutions. With expertise in areas such as embedded systems, QA automation, ERP, and cloud technologies, Logicplanet supports global clients by combining technical innovation with workforce solutions, positioning itself as both a technology partner and a recruitment facilitator.

Job ID: 147443635

Jobs by Skill - IT