Relativity Logo

Relativity

Lead Software Engineer - Data Platform

Posted 7 Days Ago
In-Office
40 Locations
150K-224K Annually
Senior level
In-Office
40 Locations
150K-224K Annually
Senior level
Lead the development of a data platform, enhancing data processing and query engines while mentoring team members and managing production issues.
The summary above was generated by AI

Posting Type

Hybrid

Job Overview

Join our team as we innovate the future of data platform architecture, enabling massive scaling and data processing for ML and Gen AI projects. You'll be at the forefront of processing vast unstructured data, building high-throughput APIs, and supporting distributed compute frameworks for seamless model deployment. Ready to dive into the heart of cutting-edge tech?

Job Description and Requirements

Your role in action

  • Assist in building our next-generation data platform tooling and services to support the ingestion and processing of large volumes of documents at scale. Contribute to improving and extending our Spark-based distributed data processing pipeline.
  • Help enhance our Rust-based distributed query engine used to request large amounts of document data.
  • Create tools to automate and optimize processes across disciplines.
  • Participate in the on-call schedule to investigate and fix production issues related to our data processing pipeline or query engine.
  • Participate in code reviews for projects written by your team.
  • Focus on quality through comprehensive unit and integration testing.

Your Skills

  • 6+ years of software development experience in writing performant, commercial-grade systems and applications
  • Experience with monitoring and troubleshooting production environments Proficiency in programming languages used in high volume data processing and applications like: Java or Scala and Python
  • Experience building data pipelines with distributed compute frameworks like Hadoop. Spark, or Dask
  • Knowledge of Linux/Unix systems, Docker/Kubernetes and CI/CD including scripting in Python or other scripting languages to automate build and deployment processes
  • Knowledge of professional software engineering practices & software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations
  • Leverages best practices and past experiences to mentor and improve the productivity of the team

We’d particularly love it if you have: Deep experience building and debugging distributed data pipelines Experience with columnar databases and storage formats like Delta Lake and Parquet Experience deploying and managing services on Kubernetes Experience building with Rust

Relativity is committed to competitive, fair, and equitable compensation practices.

This position is eligible for total compensation which includes a competitive base salary, an annual performance bonus, and long-term incentives.

The expected salary range for this role is between following values:

$150,000 and $224,000

The final offered salary will be based on several factors, including but not limited to the candidate's depth of experience, skill set, qualifications, and internal pay equity. Hiring at the top end of the range would not be typical, to allow for future meaningful salary growth in this position. 

Top Skills

Dask
Docker
Hadoop
Java
Kubernetes
Python
Scala
Spark

Similar Jobs

4 Hours Ago
Hybrid
5 Locations
119K-206K Annually
Senior level
119K-206K Annually
Senior level
Fintech • Financial Services
The Lead Risk Analytics Consultant will manage data systems, support analytics initiatives, lead projects, ensure data integrity, and collaborate on business analysis and reporting.
Top Skills: OraclePower BIPythonSASSQL ServerTableauTeradataToadUnix
10 Hours Ago
Hybrid
51 Locations
74K-244K
Mid level
74K-244K
Mid level
Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
The Senior Business Analyst Manager will analyze data, manage client accounts, supervise teams, and drive project engagement using Agile methodologies.
Top Skills: AgileScrum
10 Hours Ago
Remote or Hybrid
38 Locations
140K-215K Annually
Mid level
140K-215K Annually
Mid level
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
The role involves defining product strategy, enhancing the data model for proactive security products, and collaborating with engineering, marketing, and sales teams.
Top Skills: AWSAzureData GovernanceData LakesData Quality ManagementGCPGraph DatabasesMaster Data Management

What you need to know about the Charlotte Tech Scene

Ranked among the hottest tech cities in 2024 by CompTIA, Charlotte is quickly cementing its place as a major U.S. tech hub. Home to more than 90,000 tech workers, the city’s ecosystem is primed for continued growth, fueled by billions in annual funding from heavyweights like Microsoft and RevTech Labs, which has created thousands of fintech jobs and made the city a go-to for tech pros looking for their next big opportunity.

Key Facts About Charlotte Tech

  • Number of Tech Workers: 90,859; 6.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Lowe’s, Bank of America, TIAA, Microsoft, Honeywell
  • Key Industries: Fintech, artificial intelligence, cybersecurity, cloud computing, e-commerce
  • Funding Landscape: $3.1 billion in venture capital funding in 2024 (CED)
  • Notable Investors: Microsoft, Google, Falfurrias Management Partners, RevTech Labs Foundation
  • Research Centers and Universities: University of North Carolina at Charlotte, Northeastern University, North Carolina Research Campus

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account