DevOps Engineer

Purpose:

The goal of the DevOps Engineer Big Data is to build and maintain reliable and scalable systems for Big Data processing. Develop scripts and tools to automate deployment tasks and monitor critical aspects of the operation, resolve engineering problems and incidents. Collaborate with developers to help create platforms for the future. Work closely with Big Data and Software engineers to understand our applications and keep them running smoothly.

Responsibilities:

Infrastructure planning and maintenance in the Big Data and Software environments

Mentors, supports, and coaches colleagues, Data Scientists, Data Engineers and Software Engineers, regarding infrastructure topics

Find ways to automate tasks, monitor and to continuously improve our systems

Documents the work for the developed solutions and maintain consistency of information

Make the infrastructure resilient and efficient

Qualifications & Requirements:

A bachelor's degree in computer science, Engineering or related education or experience

Experience working as DevOps Engineer, Site Reliability Engineer or Systems Engineer

Proficiency working with Linux systems and scripting languages (Bash, Python)

Experience with Docker and Kubernetes environments (OKD, Openshift, Rancher)

Experience working with distributed systems and high availability technologies

Experience working with Ceph or other distributed storage systems will be valued

Experience working with on-premise infrastructure or hybrid environments will be valued

Experience working in cloud environments (AWS or Azure) will be valued but not required

Experience working on infrastructure for Big Data will be valued

Skillset

Proven ability to design, build, and maintain scalable infrastructure for Big Data and Software environments

Skilled in leveraging monitoring systems for getting insights on reliability and performance

Decisive in solving infrastructure incidents and diagnosing technical problems

Strong collaboration skills to work with architects, developers, and cross-functional teams

Capable of documenting solutions, communicating ideas and knowledge

Ability for learning and adapting to technology changes

Committed to building resilient and efficient infrastructure