Raydar Logo

Raydar

Data Engineer

Posted 2 Days Ago
Remote
Hiring Remotely in United States
180K-220K Annually
Senior level
Remote
Hiring Remotely in United States
180K-220K Annually
Senior level
Build and operate production pipelines for legal records from PACER, court systems, opinions, PDFs, scans, XML, and HTML. Develop LLM-assisted extraction workflows, validate data quality, optimize SQL, and support RAG and semantic search products. Manage AWS S3 and RDS systems within security guardrails while collaborating with engineering teams. The role requires strong Python and SQL skills, legal data experience, document extraction expertise, and autonomous problem-solving with large, messy datasets.
The summary above was generated by AI

About the company

Our client builds AI-powered legal software for research and litigation workflows. Its products use large collections of court records and legal documents to help turn complex information into structured insights.

The role / why it matters

You will own the data pipelines that ingest, normalize, and enrich caselaw and docket records. Legal source data is messy, often arriving as scanned filings or semi-structured documents. The reliable signal you create will support downstream research and AI products.

What you'll do

• Build and maintain production pipelines for PACER, NYSCEF, state court systems, published opinions, and other legal records.

• Turn PDFs, scanned filings, XML, and HTML into clean, queryable data.

• Create LLM-assisted extraction workflows for legal text and validate results against source documents.

• Run statistical analyses, improve data quality, and optimize SQL queries.

• Support RAG and semantic search workflows in partnership with full-stack engineers.

• Operate and improve AWS S3 and RDS data systems within established security and compliance guardrails.

What we're looking for

• 4-8 years of experience building and operating production data pipelines with large, dirty datasets, and quickly finding signal in them.

• Strong Python and SQL skills for pipeline engineering and data analysis.

• Hands-on experience with legal data such as PACER records, court dockets, or court filings.

• Experience with AI for data, including RAG, semantic search, and LLM-assisted extraction, plus PDF parsing, OCR, and document extraction tooling.

• A bachelor's degree in Computer Science, Data Science, or a related field.

• Works fully autonomously and thrives with minimal management direction; stays curious about messy data problems and critically reviews AI-assisted code and outputs.

Bonus points

• Experience with regulatory or government data sources.

• Experience with vector databases or semantic-search tooling such as Pinecone or Voyage AI.

Compensation and benefits

• Base salary: $180,000-$220,000 USD.

• Equity: 0.15%-0.25%.

Location / work model

• Remote within the United States, with at least four hours of overlap with Eastern Time each workday.

• Strong preference for candidates based in the New York City area.

• Plan for quarterly travel to New York City.

• Visa transfers may be considered. New visa sponsorship is not available.

Similar Jobs

Yesterday
In-Office or Remote
113K-193K Annually
Expert/Leader
113K-193K Annually
Expert/Leader
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Leads the architecture, development, modernization, and governance of enterprise-scale Azure data platforms. Builds data pipelines, warehouses, lakes, and analytics solutions using Azure services and Snowflake; automates deployments with Terraform; drives cloud migrations; develops AI-enabled engineering tools; and provides technical leadership, mentorship, security, reliability, and cost optimization guidance.
Top Skills: Ai Orchestration FrameworksAzure Data FactoryAzure Data Lake StorageAzure FunctionsAzure OpenaiAzure SqlCi/CdDatabricksDevOpsInfrastructure As CodeLarge Language ModelsMachine Learning WorkflowsAzurePythonRetrieval Augmented GenerationSnowflakeSparkSQLTerraformVector Databases
7 Days Ago
Remote or Hybrid
OH, USA
Senior level
Senior level
Financial Services
Build and operate scalable Databricks-on-AWS data pipelines using PySpark, Delta Lake, and lakehouse patterns. Optimize performance, implement data quality, monitoring, alerting, and automated remediation, and deliver curated datasets for BI and analytics partners. Collaborate with stakeholders on architecture and design while applying secure software engineering, CI/CD, agile, and operational stability practices. The role also uses AI-assisted development tools and supports workforce data analytics.
Top Skills: AlteryxAmazon AthenaAmazon EmrAmazon S3Apache AirflowApache IcebergSparkAutosysAWSAws CloudwatchAws GlueAws LambdaBitbucketClaudeDatabricksDatabricks WorkflowsDelta LakeDelta Live TablesGitGithub CopilotJavaJenkinsOracleParquetPysparkPythonScalaSigmaSpinnakerSQLTableau
8 Days Ago
Remote or Hybrid
USA
140K-215K Annually
Senior level
140K-215K Annually
Senior level
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Architects, deploys, and operates scalable data platform infrastructure supporting analytics. Responsibilities include administering Airflow and Superset, managing Terraform infrastructure, building CI/CD pipelines, enforcing security and compliance, developing DBT data models, cataloging assets in OpenMetadata, writing Python automation, and mentoring engineers. The role requires extensive infrastructure and data engineering experience across cloud platforms, containers, data security, and workflow orchestration.
Top Skills: Apache AirflowApache SupersetAWSAzureCi/CdData ModelingDbtDockerGCPIamKubernetesMachine Learning PipelinesOciOpenmetadataPythonSQLTerraform

What you need to know about the Charlotte Tech Scene

Ranked among the hottest tech cities in 2024 by CompTIA, Charlotte is quickly cementing its place as a major U.S. tech hub. Home to more than 90,000 tech workers, the city’s ecosystem is primed for continued growth, fueled by billions in annual funding from heavyweights like Microsoft and RevTech Labs, which has created thousands of fintech jobs and made the city a go-to for tech pros looking for their next big opportunity.

Key Facts About Charlotte Tech

  • Number of Tech Workers: 90,859; 6.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Lowe’s, Bank of America, TIAA, Microsoft, Honeywell
  • Key Industries: Fintech, artificial intelligence, cybersecurity, cloud computing, e-commerce
  • Funding Landscape: $3.1 billion in venture capital funding in 2024 (CED)
  • Notable Investors: Microsoft, Google, Falfurrias Management Partners, RevTech Labs Foundation
  • Research Centers and Universities: University of North Carolina at Charlotte, Northeastern University, North Carolina Research Campus

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account