- Designing and deploying Databricks platforms for AWS, Azure or Google Cloud.
- Building and deploying data engineering pipelines into production, including automation best practices for CI/CD.
- Guiding clients as they implement transformational big data projects, including end-to-end development and deployment of big data and AI applications.
- Working in Scrum/Agile setting.
- Streamlining the customer machine learning lifecycle and integrating it with the data platform.
Qualifications / Tech Stack
- 12+ years of experience.
- Experience in Data Lake, Azure Data Bricks, and Spark SQL.
- Experience designing and deploying Databricks platforms for AWS, Azure or Google Cloud.
- Experience building and deploying data engineering pipelines into production with CI/CD automation.
- Experience in Big Data technologies.