Easy Apply
Easy Apply
Design and operate large-scale networks for GPU workloads, automate network infrastructure, ensure network performance, and troubleshoot issues.
You are a seasoned networking engineer who has designed, deployed, and operated high-performance networks at scale. At fal, our platform orchestrates AI inference workloads across thousands of GPUs spread over multiple data centers and cloud providers. You will own the network layer that ties it all together—ensuring that model traffic, storage I/O, and control-plane communication are fast, reliable, and secure. You think in terms of packets per second, tail latency, and fabric utilization, and you automate everything you touch.
Key Responsibilities
- Design, build, and operate the network fabric that interconnects our GPU fleet, including spine-leaf architectures, RDMA/RoCEv2 networks for distributed inference, and overlay networks for tenant isolation.
- Own L2/L3 network design across bare-metal and cloud environments, including BGP peering, ECMP, VXLAN/EVPN, and high-bandwidth interconnects between data centers.
- Develop and maintain network automation using Ansible, Terraform, and custom tooling to provision, configure, and validate switches, routers, DPUs, and SmartNICs at scale.
- Instrument deep network observability—build dashboards, alerting, and anomaly detection across our fabric using Prometheus, Grafana, and packet-level telemetry.
- Partner with the Compute and ML Performance teams to tune network paths for AI workloads, minimizing latency for model serving and maximizing throughput for large tensor transfers.
- Drive incident response and root-cause analysis for network-related production issues and build automation to prevent recurrence.
- Evaluate and qualify new networking hardware and software—NICs, switches, DPUs, SONiC, Cumulus, and similar—as we scale to next-generation GPU clusters.
- 8+ years of experience building and operating large-scale networks, ideally in GPU cloud, HPC, or hyperscale environments.
- Deep expertise in Linux networking internals: kernel networking stack, iptables/nftables, tc, eBPF, network namespaces, bonding/teaming, and SR-IOV.
- Strong command of routing and switching protocols: BGP, OSPF, ECMP, VXLAN, EVPN, MPLS, and segment routing.
- Hands-on experience with high-performance networking for AI/ML: RDMA, RoCEv2, InfiniBand, GPUDirect, and NCCL tuning.
- Proficiency automating network infrastructure with Ansible, Python, Go, and Git.
- Experience with network-as-code workflows.
- Familiarity with modern network operating systems such as SONiC, Cumulus Linux, Arista EOS, or Nokia SR Linux.
- Experience with network observability stacks: Prometheus, Grafana, sFlow/NetFlow, and packet capture tools.
- Experience with DPU/SmartNIC programming (NVIDIA BlueField, AMD Pensando) and SDN/NFV architectures.
- Contributions to open-source networking projects (SONiC, FRR, DPDK, eBPF/XDP).
- Experience operating networks that support Kubernetes and container-native workloads (Calico, Cilium, MetalLB).
- Familiarity with data center physical layer design, optics, and cabling at scale
- Interesting and challenging work
- Competitive salary and equity
- A lot of learning and growth opportunities
- We offer visa sponsorship and will help you relocate to San Francisco.
- Health, dental, and vision insurance (US)
- Regular team events and offsite
Remote
Top Skills
Ansible
Arista Eos
Cumulus Linux
Ebpf
Evpn
Git
Go
Gpudirect
Grafana
Infiniband
Linux
Mpls
Network Observability
Prometheus
Python
Rdma
Rocev2
Sonic
Terraform
Vxlan
Similar Jobs
Artificial Intelligence • Fintech • Payments • Business Intelligence • Financial Services • Generative AI
Lead a global team to design and execute a risk-based Compliance Monitoring and Oversight framework, drive data-driven continuous monitoring, report findings to senior leadership and the board, partner with regional MLROs and first line teams, and ensure audit- and regulator-ready assurance across jurisdictions.
Top Skills:
Sql,Tableau
Artificial Intelligence • Fintech • Payments • Business Intelligence • Financial Services • Generative AI
Lead Airwallex's global Second Line assurance function for financial crime controls. Build and mature a scalable, data-driven monitoring framework, run annual assurance planning, drive continuous monitoring and automated testing, report insights to senior leadership and regulators, and manage an international team to ensure remediation and regulatory readiness.
Top Skills:
Sql,Tableau
Food • Retail • Sales • Manufacturing
Partner with Sales Leadership to identify, analyze, and integrate new Natural & Wholesale channel businesses. Perform syndicated data analyses, develop growth strategies, synthesize insights for sales integration, recommend resource deployments, track market trends, and support business integration and training to increase revenue and profitability.
Top Skills:
Iri,Etl,Microsoft Excel,Power Bi,Tableau
What you need to know about the Charlotte Tech Scene
Ranked among the hottest tech cities in 2024 by CompTIA, Charlotte is quickly cementing its place as a major U.S. tech hub. Home to more than 90,000 tech workers, the city’s ecosystem is primed for continued growth, fueled by billions in annual funding from heavyweights like Microsoft and RevTech Labs, which has created thousands of fintech jobs and made the city a go-to for tech pros looking for their next big opportunity.
Key Facts About Charlotte Tech
- Number of Tech Workers: 90,859; 6.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Lowe’s, Bank of America, TIAA, Microsoft, Honeywell
- Key Industries: Fintech, artificial intelligence, cybersecurity, cloud computing, e-commerce
- Funding Landscape: $3.1 billion in venture capital funding in 2024 (CED)
- Notable Investors: Microsoft, Google, Falfurrias Management Partners, RevTech Labs Foundation
- Research Centers and Universities: University of North Carolina at Charlotte, Northeastern University, North Carolina Research Campus
