Jobs at Hut 8

Operate and improve large-scale AI compute, storage, and networking infrastructure in 24x7 environments. Responsibilities include capacity planning, performance analysis, patching, upgrades, firmware management, automation, incident response, documentation, disaster recovery testing, and L3 escalation support. The role also requires customer collaboration, operations enablement, and participation in an on-call rotation while supporting OpenStack or similar private cloud platforms.

Designs, deploys, integrates, validates, and operates infrastructure supporting large-scale AI compute clusters. Responsibilities include Linux systems, virtualization, storage, identity and security services, infrastructure automation, provisioning, testing, production acceptance, Tier 3 escalation, troubleshooting, reliability optimization, and lifecycle management. The role collaborates with engineering teams, vendors, NOC personnel, SREs, and data center technicians across multiple sites, including travel for commissioning and complex troubleshooting.

Support and improve large-scale network infrastructure for AI and HPC workloads. Responsibilities include production incident response, network fault resolution, on-call support, observability improvements, automation, documentation, customer collaboration, and reliability initiatives across multi-site GPU clusters.

Monitor and support large-scale AI/ML compute, storage, and network infrastructure in a 24x7 environment. Responsibilities include customer case triage, incident response, SLA impact management, documentation, runbook maintenance, fleet management, firmware and configuration upgrades, planned maintenance orchestration, and collaboration with SRE and product teams. The role requires data center travel for commissioning and troubleshooting, plus flexibility for critical incidents outside regular business hours.

Lead deployment, commissioning, validation, optimization, and production support for large-scale AI and HPC network fabrics. Configure Ethernet and InfiniBand networks, RDMA/RoCE, routing, switching, telemetry, and automation. Conduct acceptance testing, troubleshoot performance and hardware issues, resolve Tier 3 incidents, coordinate vendor escalations, and develop reliability standards, diagnostics, runbooks, and operational handoffs for GPU clusters.

Provides Tier 2 operational support for large-scale GPU compute and storage platforms. Responsibilities include troubleshooting Linux servers, GPU systems, storage services, Kubernetes and Slurm environments; managing incidents and tickets; provisioning and maintaining nodes; coordinating with NOC, SRE, data center technicians, vendors, and Tier 3 teams; supporting upgrades and cluster expansions; documenting issues; and automating recurring operational tasks with Bash or Python.

Supervise NOC workflows and frontline response for 24x7 AI cloud infrastructure. Manage compute, storage, and network impacts; handle escalations; lead incident management and prevention; maintain runbooks; drive automation and observability; and collaborate with customers and product teams. The role requires hands-on network and systems operations experience, OpenStack or private-cloud expertise, and travel to data centers for commissioning and troubleshooting.

Lead the integration and production readiness of large-scale GPU clusters, including bare-metal provisioning, Linux and GPU configuration, Kubernetes and Slurm validation, performance benchmarking, acceptance testing, and Tier 3 operational support. Diagnose hardware, firmware, driver, networking, and distributed workload issues; optimize cluster reliability and performance; lead root-cause analysis, vendor escalations, upgrades, automation, documentation, and customer handoff activities.