Design, orchestrate, and optimize large-scale LLM pre-training across 1,000+ GPUs. Implement 3D parallelism, manage GPU clusters (SLURM/Kubernetes), optimize InfiniBand/RDMA networking and memory, and automate checkpointing and failure recovery for long training runs.
We are seeking a highly skilled LLM Pre-training & Distributed Systems Engineer. This role is essential for orchestrating large-scale machine learning training runs and optimizing distributed infrastructure. The ideal candidate will have a deep understanding of GPU clusters and extensive experience in system engineering to ensure efficient and reliable training processes.
Responsibilities:
- Orchestrate distributed training runs across 1,000+ GPUs using PyTorch, DeepSpeed, or Megatron-LM.
- Optimize networking (InfiniBand/RDMA) and memory management to prevent out-of-memory errors.
- Automate checkpointing and failure recovery during month-long training runs.
Required Skills:
- Deep expertise in 3D parallelism (Data, Tensor, Pipeline).
- Experience managing SLURM or Kubernetes-based GPU clusters.
- Strong systems engineering background (C++, CUDA, Python).
Similar Jobs
Fintech • Financial Services
Conduct manual penetration testing, secure code reviews, and SAST triage across web applications, APIs, and AWS infrastructure. Develop AI-assisted security tooling, define testing approaches for LLM applications and agentic systems, and review AI-generated software before production. Communicate vulnerabilities, risks, and remediation priorities to engineering teams while improving secure SDLC practices.
Top Skills:
Ai AgentsAWSGoLlmsPythonRubySastTypescript
Blockchain • eCommerce • Fintech • Payments • Software • Financial Services • Cryptocurrency
Build and operate GRC data pipelines, integrations, policy-as-code, continuous control monitoring, evidence automation, and agentic AI workflows. Normalize security data from diverse systems, create auditable evaluation harnesses, govern AI systems, and define technical direction across teams. Partner with security governance, compliance, and engineering groups to transform manual governance processes into scalable products.
Top Skills:
AWSBuildkiteCi/CdClaudeGCPGoGrpcHTTPJavaJSONKotlinKubernetesLlm ApisModel Context ProtocolProtocol BuffersPythonSnowflakeSQLTerraform
Blockchain • eCommerce • Fintech • Payments • Software • Financial Services • Cryptocurrency
Lead Block’s global tax planning and controversy agenda, including international and U.S. tax strategy, transfer pricing, M&A taxation, legal-entity structuring, tax audits, examinations, disputes, and transaction negotiations. Advise senior leadership on tax implications, partner with Legal, Treasury, Corporate Development, and finance teams, monitor legislative developments, and ensure tax positions are reflected in reporting and compliance. Build high-performing teams and represent Block before domestic and foreign tax authorities.
Top Skills:
AnalyticsArtificial IntelligenceTax ModelingTax TechnologyTransfer Pricing
What you need to know about the Charlotte Tech Scene
Ranked among the hottest tech cities in 2024 by CompTIA, Charlotte is quickly cementing its place as a major U.S. tech hub. Home to more than 90,000 tech workers, the city’s ecosystem is primed for continued growth, fueled by billions in annual funding from heavyweights like Microsoft and RevTech Labs, which has created thousands of fintech jobs and made the city a go-to for tech pros looking for their next big opportunity.
Key Facts About Charlotte Tech
- Number of Tech Workers: 90,859; 6.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Lowe’s, Bank of America, TIAA, Microsoft, Honeywell
- Key Industries: Fintech, artificial intelligence, cybersecurity, cloud computing, e-commerce
- Funding Landscape: $3.1 billion in venture capital funding in 2024 (CED)
- Notable Investors: Microsoft, Google, Falfurrias Management Partners, RevTech Labs Foundation
- Research Centers and Universities: University of North Carolina at Charlotte, Northeastern University, North Carolina Research Campus
