Senior Data Engineer

Role:

As a Senior Databricks Engineer you will be responsible for automating platform operations, managing CI/CD pipelines, and supporting deployments across multiple environments. The role ensures platform stability, security, and scalability while enabling faster and more reliable software delivery.

Key Responsibilities:

1. Hands on experience working on Databricks, creating data pipelines, transformation rules using Unity Catalog, PySpark, SparkSQL
2. Hands on Databricks Devs – Deployments, CICD, Performance Management
3. Hands on Databricks Infrastructure like creating resources (Catalogs, Volumes, Storage Account, Private end points)
4. User permissions, access controls, Keyvalults etc.
5. Handling release deployments, job controls, workflow management & organizing via automations
6. Handling production incidents, triaging production issues, work with Databricks to open incident tickets/case and follow up to close the issue and ensure long term fixes
7. Additional knowledge of other Databricks key features, like Genie, Apps, Models creations etc

Required Qualifications:

• Bachelor's degree in computer science, Information Technology, Engineering, or a related field.
• Bachelor's/Master's degree in Computer Science, Information Technology, Engineering, or related field.
• 8+ years of experience in Devops and 3+ years in DBX.
• Strong hands-on experience in Databricks (Spark, Delta Lake, PySpark, MLflow).
• Proficiency in SQL and programming languages like Python or Scala.
• Experience with Azure cloud data services.
• Solid understanding of data modeling, data governance, security.

Why join us

• Work with a passionate and innovative team in a fast-paced, growth-oriented environment.
• Gain hands-on experience in content marketing with exposure to real-world projects.
• Opportunity to learn from experienced professionals and enhance your marketing skills.
• Contribute to exciting initiatives and make an impact from day one.
• Competitive stipend and potential for growth within the company.
• Recognized for excellence in data and AI solutions with industry awards and accolades.