We are a forward-thinking team dedicated to building innovative AI applications. We're seeking a talented Data Engineer with strong software engineering expertise to join our dynamic team in a hybrid role. You will be responsible for designing and maintaining scalable data pipelines and ETL processes, while also developing AI applications that encompass both backend and frontend components. Passionate individuals who excel in full-stack development, including experience with version control, CI/CD, FastAPI, Next.js, and data tools like Databricks, are encouraged to apply.
Key Responsibilities:
- Design, develop, and maintain scalable data pipelines and ETL processes
- Build and deploy AI applications with full-stack development skills
- Collaborate with cross-functional teams using Agile methodologies
- Implement version control and CI/CD pipelines to ensure reliable software delivery
- Contribute to both backend and frontend development tasks
Required Skills & Qualifications:
- Strong proficiency in SQL and Python for data engineering tasks
- Experience with data pipeline tools and frameworks, including familiarity with Databricks and Azure Data Factory
- Experience with cloud platforms (Azure, AWS, GCP)
- Solid understanding of version control systems (e.g., Git)
- Hands-on experience with CI/CD tools, especially Jenkins
- Familiarity with FastAPI for building APIs
- Knowledge of frontend frameworks such as Next.js
- Experience with Agile software development practices
- Excellent problem-solving skills and attention to detail
Nice to Have:
- Prior experience in AI/ML projects
- Familiarity with containerization (Docker, Kubernetes)
- Familiarity with monitoring tools (Kibana, Grafana, Tempo)