Job Description:
5+ years experience working in Data Engineering and Warehousing.
3 -5 years’ experience integrating data into analytical platforms
Experience in ingestion technologies (e.g. Swoop, flume), processing technologies (Spark/Scala), and storage (e.g. HDFS, HBase, Hive)
Experience in data profiling, source-target mappings, ETL development, SQL optimization, testing, and implementation
Expertise in streaming frameworks (Kafka/Spark Streaming/Storm) essential
Experience in building Spark SQL and Spark Data Frame API-based applications.
Experience managing structured and unstructured data types
Experience in requirements engineering, solution architecture, design, and development/deployment
Experience in creating big data or analytics IT solution
Track record of implementing databases and data access middleware and high-volume batch and (near) real-time processing.
📌 Big Data Engineer New South Wales
🏢 Pyramid Global Technologies
📍 New South Wales
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.