Accenture PLC is seeking a hands-on Data Engineer to design and operate reliable real-time data pipelines in Australia. The role focuses on moving high-volume data from Amazon Kinesis into the Databricks Lakehouse using Spark Structured Streaming and Delta tables, with collaboration across batch engineers and monitoring via AWS CloudWatch.
You will build and optimize streaming pipelines, implement clean Python and SQL code, and troubleshoot data-processing issues while focusing on performance,