Staff DevOps Engineer

Role Overview

As a Staff/Senior DevOps Engineer at Runware, you will be responsible for designing, building, and operating the infrastructure that powers real-time AI inference across large-scale GPU fleets. This senior role involves automating infrastructure operations, improving system reliability, and ensuring fast performance, directly impacting how quickly new AI models are launched and scaled to meet customer demands.

Perks & Benefits

Runware offers a remote-first work environment with flexible hours outside core collaboration times, allowing you to work from anywhere. The company promotes a healthy work-life balance with generous paid time off, meaningful stock options, and paid family leave. Additionally, there are biannual retreats to foster team connections and collaboration.

Full Job Description

Headquarters: United Kingdom URL: http://runware.ai

DescriptionRunware is building the API layer for the next generation of AI products. Our platform gives teams fast, reliable access to real-time inference across thousands of models through a single flexible API. We help customers build and scale media generation products with better performance, lower cost, and less operational complexity.Behind this is an infrastructure platform built for speed, reliability, and GPU scale. New models launch constantly. Customer traffic can grow quickly. Performance matters at every layer.We are looking for a Staff/Senior DevOps Engineer to help build, operate, and scale the infrastructure behind Runware s global AI inference platform. You ll play a critical role in making our systems faster, more resilient, easier to operate, and ready for the next stage of growth.About the roleRunware s infrastructure is the engine behind some of the fastest-growing AI products in the world. As a Staff/Senior DevOps Engineer, you ll help design, build, and operate the systems that power real-time AI inference across large-scale GPU fleets and a global production platform.This is not a traditional DevOps role. You ll be working at the intersection of bare-metal infrastructure, GPUs, networking, automation, observability, and high-performance distributed systems. Your work will directly shape how quickly we can launch new models, scale customer traffic, recover from failures, and deliver low-latency AI experiences to millions of users.You ll turn complex, hardware-driven infrastructure into reliable, automated, developer-friendly platforms. From provisioning and orchestration to deployment pipelines, monitoring, incident response, and capacity scaling, you ll help remove friction so engineering teams can move faster without compromising reliability.You ll build the foundations that let Runware scale with confidence: infrastructure that is fast, resilient, observable, secure, and built for the demands of real-time AI.What you ll doBuild and scale the infrastructure that powers real-time AI inference across GPU fleets, bare-metal servers, serverless and containerised production systemsHelp evolve Runware s platform toward more elastic, on-demand infrastructure that can scale quickly with customer traffic and model demandMake Runware faster, more reliable and more resilient by improving the critical paths behind our request entrypoints, inference services, queues, storage, load balancers and networking layerAutomate the hard parts of infrastructure operations, from provisioning and configuration through to CI/CD, deployment safety, progressive rollouts and rapid rollbackBuild the observability backbone for a high-performance AI platform, with the signals needed to spot issues early, understand capacity and fix problems before customers feel themPlay a leading role in production operations, incident response, debugging and post-incident improvements, helping us turn operational challenges into a stronger platformStrengthen the security and compliance foundations of our infrastructure through patching, secrets management, access controls, hardening, auditability, documentation and repeatable operational processesRequirementsStrong experience as a DevOps Engineer, SRE, Infrastructure Engineer, Platform Engineer or similar, with a track record of running production systems at scaleDeep Linux knowledge and confidence debugging real production issues across networking, storage, performance, services and system behaviourHands-on experience building automation, Infrastructure-as-Code, CI/CD pipelines and deployment workflows that make infrastructure safer and easier to operateExperience operating high-availability, low-latency or high-throughput platforms where reliability and performance directly affect customersStrong networking fundamentals across TCP/IP, DNS, load balancing, routing, firewalls, proxies, TLS and HTTPA calm and pragmatic approach under pressure, with strong communication, good judgement and a bias toward automation over manual toilBonusExperience operating GPU infrastructure for AI/ML inference, including NVIDIA drivers, CUDA, container runtimes, GPU monitoring, capacity planning and workload isolationFamiliarity with inference serving and optimisation frameworks such as vLLM, TensorRT, Triton or similarBenefitsWe re a remote-first collective, meeting in person twice a year to plan, brainstorm, celebrate wins, and enjoy some face-to-face time. We have core hours for cooperative working and calls, but outside of that your calendar is yours. Work the hours that let you perform at your peak while also building a healthy life.Our release cycles are fast and intense, but they re followed by real downtime. After big pushes we expect the team to unplug, recharge, and come back ready & stronger than ever for the next leap. Generous paid time off vacation, sick days, public holidays Meaningful stock options share in the upside you create Remote-first setup work from home anywhere we can employ you Flexible hours own your schedule outside core collaboration blocks Family leave paid maternity, paternity, and caregiver time Company retreats twice-yearly gatherings in inspiring locations

To apply: https://weworkremotely.com/remote-jobs/runware-staff-devops-engineer

Similar jobs

Found 6 similar jobs