09 Aug
|
Pyramid Global Technologies
|
New South Wales
09 Aug
Pyramid Global Technologies
New South Wales
About the job Big Data Engineer Job Description: · 5+ years experience working in Data Engineering and Warehousing.
· 3 -5 years' experience integrating data into analytical platforms · Experience in ingestion technologies (e.g. Sqoop, flume), processing technologies (Spark/Scala), and storage (e.g. HDFS, HBase, Hive) · Experience in data profiling, source-target mappings, ETL development, SQL optimization, testing, and implementation · Expertise in streaming frameworks (Kafka/Spark Streaming/Storm) essential · Experience in building Spark Sql and Spark Data Frame API-based applications.
· Experience managing structured and unstructured data types · Experience in requirements engineering, solution architecture, design, and development/deployment · Experience in creating big data or analytics IT solution · Track record of implementing databases and data access middleware and high-volume batch and (near) real-time processing
📌 Big Data Engineer (New South Wales)
🏢 Pyramid Global Technologies
📍 New South Wales