DevOps Engineer (AI Inference)

Role Overview

Join a global team of 550+ professionals building infrastructure and software that supports the entire digital ecosystem. As a DevOps Engineer, you will be responsible for designing, deploying, and maintaining infrastructure and services that enable scalable and secure AI inference workloads on-premises.

What You Will Do

Design, develop, and maintain infrastructure for AI inference workloads, including GPU scheduling, model deployment pipelines, and data access patterns in on-prem environments. Build and manage monitoring and observability tools for AI inference platforms, including dashboards, alerts, and runbooks for model health and system performance.

Why It Might Be a Fit

Strong understanding of Kubernetes architecture, including CNI, CSI, operators, ingress/gateway, and control plane components. Hands-on experience operating and troubleshooting production Kubernetes clusters. Strong Linux and networking troubleshooting skills, including DNS, routing, firewalling, TLS, MTU, connectivity and performance issues.

Requirements

• Strong understanding of Kubernetes architecture
• Hands-on experience operating and troubleshooting production Kubernetes clusters
• Strong Linux and networking troubleshooting skills
• Ability to develop automation and operational tooling using Python, Go, or Bash
• Experience with Terraform, Ansible, or similar IaC/configuration management tools
• Experience with VictoriaMetrics/Grafana or similar monitoring, alerting, and troubleshooting tools
• Strong experience with Git-based workflows and CI/CD pipelines

Benefits

• Competitive compensation
• Flexible working hours and hybrid or remote options
• Work from anywhere in the world for up to 45 days per year
• Private medical insurance for you and your family
• Extra paid vacation and sick leave days
• Support for life’s important moments and celebrations
• Language courses to help you connect and grow
• Modern, welcoming offices with snacks, drinks, and entertainment
• Team sports and social activities

Originally posted on Himalayas