Accenture PLC in Canberra is seeking a hands-on Data Engineer to design and operate real-time data pipelines using Amazon Kinesis and Databricks. You will build streaming pipelines from Kinesis into the Databricks Lakehouse with Spark Structured Streaming and Delta tables.
You will implement monitoring with AWS CloudWatch, optimize latency and cost, collaborate with batch data engineers, and write clean Python and SQL code, with a focus on security clearances.