Senior Databricks Data Engineer

Job Information

Description

KPI Partners is seeking a highly skilled and motivated Senior Databricks Engineer to join our dynamic team. As a key member of our engineering team, you will be responsible for designing, developing, and implementing powerful data solutions using Databricks. You will work closely with data scientists, analysts, and other engineers to leverage data for business intelligence and analytics.

Key Responsibilities:

- Design and develop scalable data pipelines using Databricks to process large volumes of data.

- Collaborate with cross-functional teams to gather requirements and understand business needs for data solutions.

- Optimize Databricks environments for performance, reliability, and scalability.

- Implement data transformation, cleansing, and enrichment processes using Apache Spark.

- Ensure data quality and integrity by developing robust testing and validation frameworks.

- Assist in troubleshooting and resolving data-related issues in a timely manner.

- Stay updated on industry trends and best practices in data engineering and Databricks.

- Provide mentorship and guidance to junior engineers and team members.

Qualifications:

- Bachelor's or Master's degree in Computer Science, Engineering, or a related field.

- 5+ years of experience in data engineering or similar roles, with a strong focus on Databricks and Apache Spark.

- Proficiency in programming languages such as Python, Scala, or Java.

- Experience with data modeling, ETL processes, and data warehousing concepts.

- Familiarity with cloud platforms such as AWS, Azure, or Google Cloud.

- Strong problem-solving skills and the ability to work in a fast-paced environment.

- Excellent communication and interpersonal skills to work effectively with stakeholders.

What We Offer:

- Competitive salary and benefits package.

- Opportunities for professional growth and development.

- A collaborative and innovative work environment.

- The chance to work on cutting-edge technologies with a talented team.

If you are passionate about data engineering and looking for an exciting opportunity to make a significant impact, we encourage you to apply for the Senior Databricks Engineer position at KPI Partners.

To apply, please submit your resume and cover letter detailing your relevant experience and why you would be a great fit for our team.

KPI Partners is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.

Overall 7+ years of IT expereince

Databricks, Pyspark, Python, SQL, Data Modeling