DevOps Engineer (AI Inference)

About the role

This position is available only under an employment agreement. At Gcore you will help design and deliver the infrastructure foundation for an AI‑driven world. We are looking for a talented DevOps Engineer to join our AI Inference Operations Team.

Key responsibilities

• Design, develop, and maintain infrastructure for AI inference workloads, including GPU scheduling, model deployment pipelines, and data access patterns in on‑prem environments.
• Build and manage monitoring and observability tools for AI inference platforms, including dashboards, alerts, and runbooks for model health and system performance.
• Collaborate with ML engineers and platform teams to design system architecture for AI workloads, integrate inference runtimes, and test performance at scale.

Required profile

• Strong understanding of Kubernetes architecture, including CNI, CSI, operators, ingress/gateway, and control‑plane components.
• Hands‑on experience operating and troubleshooting production Kubernetes clusters.
• Strong Linux and networking troubleshooting skills (DNS, routing, firewalling, TLS, MTU, connectivity and performance issues).
• Ability to develop automation and operational tooling using Python, Go, or Bash.
• Experience with Terraform, Ansible, or similar IaC/configuration‑management tools.
• Experience with VictoriaMetrics/Grafana or similar monitoring, alerting, and troubleshooting tools.
• Strong experience with Git‑based workflows and CI/CD pipelines.

Required skills

• Kubernetes
• Linux
• Python
• Go
• Bash
• Terraform
• Ansible
• VictoriaMetrics
• Grafana
• Git
• CI/CD pipelines

What we offer

• Competitive compensation
• Flexible working hours and hybrid or remote options, depending on the role
• Work from anywhere in the world for up to 45 days per year
• Private medical insurance for you and your family
• Extra paid vacation and sick leave days
• Support for life’s important moments and celebrations
• Language courses to help you connect and grow
• Modern offices with snacks, drinks, and entertainment
• Team sports and social activities