(BJR285) - Senior Data Integration Engineer

(BJR285) - Senior Data Integration Engineer

22 Apr
|
Versent
|
Melbourne

22 Apr

Versent

Melbourne

Versent is an Australian-born technology company, focused on architecting, building & operating cloud native applications, data streams, platforms and services. Our solutions are centred around AWS and best of breed technology. From a stand-still start in 2014, we've grown to over 400 Versentonians in just five years across Sydney, Melbourne, Adelaide Perth, Brisbane, Singapore and now Denver.With a diversified offering in professional services, managed services and product, we are poised for significant growth in 2021.At Versent, being a DataOps Engineer means that you will deliver scalable, automated, repeatable analytic patterns within the AWS stack. You will work closely with our clients’ data teams,

ensuring stability and quality of data landscape, optimisation and re-design of architecture to support the next generation of products and initiatives. You will understand both data pipeline development, operations and management as well as delivery of automated data solutions that are ready for production operations. You will help respond to an incident, do root cause analysis, improve observability, plan changes/deployments and capacity planning.



Responsibilities



- Maintain data platforms and cloud infrastructure.

- Ensure reliability and quality of ETL/ELT processes.

- Work closely with customer data teams to design, implement and maintain ETL processes, infrastructure and tools.

- Ability to communicate cross-functionally, derive requirements and advice on approaches; ability to synthesise, simplify and explain complex problems to different types of audiences.

- Perform SRE tasks like incident, security, capacity, reliability, on-call and change management.



Experience required



- High proficiency in the administration and troubleshooting of Linux based operating systems.

- Extensive experience working with and maintaining Hadoop ecosystem components such as HDFS, Hbase, (py)Spark(SQL), Yarn, Hive, Impala etc.

- Extensive experience in AWS, including security controls, storage and compute. S3, EC2, Lambda.

- Good software engineering skills, including Python and use of modern engineering practices such as version control, continuous integration/delivery, DevOps, etc.

- Experience with SQL RDBMS. e.g., debugging queries, troubleshooting and administration.

- Experience in orchestrating data pipelines, e.g. using ETL tools like Apache AirFlow, Oozie, NiFi, Talend, StreamSets and etc.

- Experience in DataOps Engineering on a large data-focused project.

The original job offer can be found in Kit Job:
https://www.kitjobau.com/job/10476126/bjr285-senior-data-integration-engineer-melbourne/?utm_source=html

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:
Enter Your E-mail address to receive the latest job offers for: (bjr285) - senior data integration engineer
Publish a new Free Offer
Need to publish an offer? With more than 1 million unique users per month, you will find the ideal candidate for your company instantly, what are you waiting for!
Publish Now

Subscribe to this job alert