- Build and maintain data pipelines and DAG workflows in Airflow
- Prepare and transform data for analytics and business use cases
- Work with ClickHouse and MySQL, optimize queries, and analyze query execution plans
- Integrate with partner services and external data sources via APIs and FTP
- Design and develop microservices for data processing
- Work with high-load systems processing terabytes of data
- Contribute to architecture and propose technical solutions to improve performance and scalability
Requirements
- 5+ years of professional Python development experience
- Strong SQL skills and hands-on experience with query optimization
- Experience with ClickHouse and/or MySQL
- Experience designing Python frameworks and libraries, as well as profiling and performance optimization
- Experience developing and working with OLAP systems
- Hands-on experience with Airflow, Pandas, Kafka and/or RabbitMQ
- Experience retrieving and processing data via APIs and FTP
- Experience with Docker and Kubernetes
- Ability to independently evaluate and choose technical solutions
- The opportunity to work on large-scale products and contribute to their development
- A flexible work environment built on autonomy, ownership, and trust, without micromanagement
- The option to work fully remotely or from a modern office
- Medical insurance coverage in countries where the company operates
- An annual $2,000 perks allowance after the probation period, which can be used for health insurance upgrades, language learning, and sports activities
- Partial reimbursement for professional training, courses, and participation in industry conferences
- Access to a corporate digital library
- Company-funded weekly online sessions with a psychologist
- Relocation opportunities to countries where the company has offices, with relocation assistance available after the probation period, subject to approval
#J-18808-Ljbffr
📌 Data Engineer IT & Data Development (Australia)
🏢 01.tech
📍 Australia
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.