540 Logo

540

Lead Data Engineer

Sorry, this job was removed at 04:21 p.m. (EST) on Tuesday, May 13, 2025
In-Office
Arlington, VA
In-Office
Arlington, VA

Similar Jobs

8 Days Ago
Hybrid
2 Locations
176K-221K Annually
Senior level
176K-221K Annually
Senior level
Fintech • Machine Learning • Payments • Software • Financial Services
As a Lead Data Engineer at Capital One, you will design and develop technical solutions, mentor team members, and work with cloud-based data warehousing and big data technologies.
Top Skills: Cloud (AwsEmrGoogle Cloud)GurobiHadoopHiveJavaKafkaMapreduceAzureMySQLNoSQLPythonRdbmsRedshiftScalaSnowflakeSpark
17 Days Ago
Remote or Hybrid
Richmond, VA, USA
176K-201K Annually
Senior level
176K-201K Annually
Senior level
Fintech • Machine Learning • Payments • Software • Financial Services
The Lead Data Engineer will design, develop, and support cloud-based data solutions, lead Agile teams, and mentor engineers while utilizing various technologies including Java and Python.
Top Skills: AWSCassandraDatabricksEmrGCPGurobiHadoopHiveJavaKafkaMapreduceAzureMongodbMySQLPythonScalaSnowflakeSparkSQL
24 Days Ago
Hybrid
3 Locations
205K-281K Annually
Senior level
205K-281K Annually
Senior level
Fintech • Machine Learning • Payments • Software • Financial Services
The Senior Lead Data Engineer will develop and optimize solutions using various data technologies, lead a team, and collaborate across Agile teams to solve complex problems.
Top Skills: Apache IcebergAWSDatabricksGCPJavaAzureNoSQLOpen Source RdbmsPythonScalaSnowflakeSparkSQL

540 is looking for a Lead Data Engineer that will serve as a lead for various financial management data initiatives related to Advana and the Army data community called ARES. 

The project engages with many systems and data sources across DoD and Army to build and manage data products by aggregating data in new ways. The goal is to create, lead and grow a data community focused on defense health and financial data. You will be the main technical point of contact for all projects across this portfolio and help guide the overall vision for the platform by engaging directly with the core Advana team who manages all of their backend tools and processes. 

Location: Must be local to the National Capital Region (NCR). This position offers significant remote flexibility, with occasional onsite meetings in Arlington, VA as required by the customer
Citizenship & Clearance Requirement: per client requirements, must be a US Citizen with an active DoD Secret clearance
Education Requirement: Bachelor’s Degree
540 Internal Thrive Level: Senior Software Engineer

WHY 540?

540 is a forward-thinking company that the government turns to in order to #GetShitDone. We do more than talk about it, we break down barriers to innovation and build impactful tech. We’re looking for someone with big ideas, who thrives on innovation and is a self-starter. If you love to learn about and work with new technologies, we want to talk to you.

REQUIRED SKILLS & EXPERIENCE

  • 8+ years of related experience
  • Well-versed in Python
  • Well-versed in Spark / PySpark
  • Experience building and managing data pipelines 
  • Proficient in data analytics tools such as Databricks
  • Experience building dashboards using PowerBI and/or similar data analytics tools
  • Experience working via the terminal / command line
  • Experience consuming data via APIs
  • Hands on experience using Jira and Confluence
  • Responsibilities include:
    • Working directly with government leadership managing teams, customers, and data requirements
    • Assisting Audit teams with monthly data ingestions from Army systems 
    • Management of data initiatives and small projects from start to finish
    • Working with Army FM&C Lead to prioritize Advana data product requirements
    • Developing recurring and ad hoc financial datasets
    • Developing Advana datasets and analytical products to enable the Army reporting on all Financial System data
    • Reviewing data pipeline code via GitLab to ensure it meets team and code standards 
    • Overseeing overall architecture and technical direction for FM&C data projects

NICE TO HAVE SKILLS & EXPERIENCE

  • AWS cloud experience
  • Experience maintaining data pipelines with tables containing over a billion rows / records
  • Experience building, deploying and managing Qlik dashboards
  • Experience in or with Advana
  • Experience with GitLab
  • Experience working with DoD systems
  • Experience working with financial systems 

BENEFITS & PERKS

  • 100% covered health, dental and vision premium for employees, optional dependent coverage
  • Flexible Spending Account (FSA)
  • 401k with employer match
  • Company Sponsored Life Insurance, Short and Long Term Disability coverage
  • Flexible PTO + all Federal holidays off
  • Home Office allowance
  • Reimbursement for trainings / certifications
  • Paid cloud developer accounts
  • Referral Bonus - good people know good people
  • Annual Social Events (540 week, hackathon, charity golf tournament, etc.)
  • Access to 540’s Washington Capitals & Nationals tickets

EQUAL EMPLOYMENT OPPORTUNITY (EEO)

540's policy is to provide equal employment opportunity to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.

This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation and training. 

What you need to know about the Charlotte Tech Scene

Ranked among the hottest tech cities in 2024 by CompTIA, Charlotte is quickly cementing its place as a major U.S. tech hub. Home to more than 90,000 tech workers, the city’s ecosystem is primed for continued growth, fueled by billions in annual funding from heavyweights like Microsoft and RevTech Labs, which has created thousands of fintech jobs and made the city a go-to for tech pros looking for their next big opportunity.

Key Facts About Charlotte Tech

  • Number of Tech Workers: 90,859; 6.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Lowe’s, Bank of America, TIAA, Microsoft, Honeywell
  • Key Industries: Fintech, artificial intelligence, cybersecurity, cloud computing, e-commerce
  • Funding Landscape: $3.1 billion in venture capital funding in 2024 (CED)
  • Notable Investors: Microsoft, Google, Falfurrias Management Partners, RevTech Labs Foundation
  • Research Centers and Universities: University of North Carolina at Charlotte, Northeastern University, North Carolina Research Campus

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account