Senior Big Data Devops Engineer

This is a hybrid role, based in G-Research's office in Dallas.
G-Research is Europe's leading quantitative finance research firm. We hire the brightest minds in the world to tackle some of the biggest questions in finance. We pair this expertise with machine learning, Big Data, and some of the most advanced technology available to predict movements in financial markets.
Opened in 2022, the Dallas office is a key infrastructure hub where we work on the latest technologies in a cutting-edge environment.
The role
The Big Data Platform Engineering team is expanding and seeking an experienced Platform DevOps Infrastructure Engineer with demonstrable experience in automation engineering and platform self-service.
The team manages a significant distributed Hadoop HDFS storage footprint and deploys infrastructure on Kubernetes. The team also supports YARN, Trino, Spark, Airflow, Grafana, Hive, Nifi and HBase, to name a few.
You will help us deliver automation, feature enhancements and best practice security on our existing hybrid cloud platforms, as well as explore new technologies and integration with other Open Source products within our ecosystem. There is a significant focus on configuration management, container orchestration, Infrastructure as Code (IaC) and CI/CD.
In return, you will gain exposure to the latest hardware and software technologies in a forward-thinking company, which values innovation, personal development and training.
Key responsibilities of the role include:

• Developing and implementing robust automation solutions within the Big Data ecosystem to streamline operations and enhance efficiency
• Driving continuous improvement initiatives, identifying areas for optimization and innovation on our platforms
• Delivering automation engineering solutions ensuring they are scalable, stable, performant, and operationally efficient
• Designing and implementing self-service capabilities, metrics and documentation to help our customers work at pace and get the most out of the platforms
• Implementing strategies to automate scaling and ensuring efficient resource utilization
• Optimizing and maintaining CI/CD pipelines, enabling automated testing, deployment, configuration and monitoring of applications and infrastructure changes
• Championing DevOps practices and methodologies within the team

Who are we looking for?
The successful candidate will be an experienced DevOps Platform Engineer who is enthusiastic about contributing to an automated, scalable, reliable and high performing Big Data Platform.
The ideal candidate will have the following skills and experience:

• A strong desire to continually learn about new technologies, approaches, and systems, along with the agility to work across multiple teams
• Excellent problem-solving skills
• Highly proficient with Python or other programming languages
• Extensive Linux and Networking knowledge
• Experience with CI/CD (preferably Jenkins and ArgoCD) and Configuration Management tools, such as Ansible and Terraform
• Experience deploying and running applications on Docker and Kubernetes, including the creation of Helm charts
• Experience working with distributed systems
• Understanding of SRE concepts and their implementation in platform engineering

Beneficial experience would include:

• Familiarity with Big Data and Data Engineering technologies, such as:
  • Spark, Trino, Hive
  • Ozone / HDFS
  • Cloud technologies, like AWS EMR, Dataproc
  • Familiarity with Automation and Operational monitoring tools, such as Prometheus, ELK or Airflow

Why should you apply?

• Market-leading compensation plus annual discretionary bonus
• Informal dress code and excellent work/life balance
• Excellent paid time off allowance
• Sick days, military leave, and family and medical leave
• Generous 401(k) plan
• 16-weeks' fully paid parental leave
• Medical and Prescription, Dental, and Vision insurance
• Life and Accidental Death & Dismemberment (AD&D) insurance
• Employee Assistance and Wellness programs
• Generous relocation allowance and support
• Great selection of office snacks, and hot and cold drinks
• On-site gym and car park

G-Research is committed to cultivating and preserving an inclusive work environment. We are an ideas-driven business and we place great value on diversity of experience and opinions.
We want to ensure that applicants receive a recruitment experience that enables them to perform at their best. If you have a disability or special need that requires accommodation please let us know in the relevant section