Build and operate batch and streaming data pipelines on Google Cloud for analytics and machine learning. Ingest, transform, validate, and curate datasets in BigQuery; implement data quality, governance, security, monitoring, Terraform infrastructure, and CI/CD. Provide technical direction, lead code reviews, and document data processes. The role requires cloud data engineering experience, technical team leadership, strong SQL and Python skills, and eligibility for a federal Public Trust investigation.
Who we are...
Latitude is a growing Service-Disabled Veteran Owned (SDVOSB) Company within the Federal Sector. We have experience in working with various federal clients across multiple different agencies. We believe in adopting and growing a remote work-from-home culture wherever possible to ensure a healthy work-to-life balance. We believe in automating the mundane and investing in our employees helping them grow their careers over time. We strive for innovation and want to develop solutions that we can take pride in and help break through some of the barriers that exist in technology and the government sectors today.
We are hiring a Data Engineer to build and run the data pipelines behind analytics and machine learning work on Google Cloud Platform for a federal health customer. You will work with data architects, data scientists, ML engineers, and application teams to ingest, transform, and deliver curated datasets in BigQuery. The role sits on a cloud operations and migration team and includes technical leadership on data engineering standards and practices. This position is fully remote in the United States.
What you will do...
- Build, maintain, and optimize batch and streaming data pipelines on Google Cloud that support analytics and machine learning.
- Ingest data from APIs, databases, SaaS systems, streaming feeds, and files, then transform it and deliver curated datasets in BigQuery.
- Build data quality rules, schema validation, and automated tests into pipelines, and monitor pipeline health with Cloud Monitoring and Cloud Logging.
- Apply governance and security standards, including IAM, encryption, data masking, and auditing, and maintain pipeline infrastructure with Terraform and CI/CD.
- Provide technical direction on data engineering standards, lead code reviews, and document datasets, transformations, and operating procedures.
Minimum qualifications...
- Bachelor's degree in computer science, software engineering, information systems, data engineering, or a related technical field.
- 3+ years of hands-on data engineering experience, including building production data pipelines on a cloud platform.
- 3+ years leading technical teams, including setting technical standards and processes for cloud and on-premises environments and guiding technology decisions.
- Hands-on experience with BigQuery, Cloud Storage, Dataflow, Dataproc, and Pub/Sub.
- Strong SQL and Python, with experience in distributed data processing and data modeling.
- Experience transforming large datasets and delivering ML-ready datasets for model training.
- Ability to obtain and maintain a federal background investigation (Public Trust).
Preferred qualifications...
- Master's degree in a technical discipline.
- Experience supporting federal government programs, especially federal health.
- Knowledge of regulated environments: FedRAMP, HIPAA, NIST 800-53, CIS benchmarks.
- Experience with Vertex AI or other ML platforms, and with feature store concepts.
- Experience with Cloud Composer (Airflow), dbt, Dataplex, and Datastream for change data capture.
- Experience with Apache Kafka or other streaming technologies, and with Looker or Looker Studio.
- Security certification such as CISSP or CCSP.
Clearance...
Citizenship...
Applicants selected will be subject to a Security Investigation and May need to Meet Requirements for Access to Protected and/or Classified Information
Citizenship...
Applicants need to be a US Citizen to be considered for the position and have physically resided in the United States for a minimum of 3 years due to background investigation requirements.
- Medical, Vision, Dental
- Paid Vacation & Sick Time
- Paid Federal Holidays
- 401k Retirement Plan with 100% Company Matching
- Employer Paid Life Insurance
- Continued Education Assistance
- Employee Assistance Program (EAP)
- Commuter Benefits Program
- Health Savings Account (HSA)
Similar Jobs
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Data Engineering Interns will define metrics, instrument logging, ingest and model data, transform datasets, ensure data quality and governance, and support visualization, reporting, alerting, and scalable systems. They will partner with product, analytics, and data consumers to improve product engagement, efficiency, costs, and strategic decision-making. The 12-week, full-time internship includes technical training, mentorship, and hands-on project experience.
Top Skills:
PythonRelational DatabasesSQL
Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Build and maintain reliable data pipelines, computed tables, and scalable data models using SparkSQL and PySpark. Integrate IoT, product, customer, external, unstructured, and ML-related data into a central data lake for analytics, causal inference, model training, and dashboards. Ensure high data quality and uptime while collaborating with data science, analytics, AI/ML, and engineering teams.
Top Skills:
Apache AirflowAWSAzureDagsterData LakeData ModelingData PipelinesDatabricksDelta LakeETLGCPGitGitPrefectPysparkPythonRest ApisSparksqlSQL
Financial Services
Build and operate scalable Databricks-on-AWS data pipelines using PySpark, Delta Lake, and lakehouse patterns. Optimize performance, implement data quality, monitoring, alerting, and automated remediation, and deliver curated datasets for BI and analytics partners. Collaborate with stakeholders on architecture and design while applying secure software engineering, CI/CD, agile, and operational stability practices. The role also uses AI-assisted development tools and supports workforce data analytics.
Top Skills:
AlteryxAmazon AthenaAmazon EmrAmazon S3Apache AirflowApache IcebergSparkAutosysAWSAws CloudwatchAws GlueAws LambdaBitbucketClaudeDatabricksDatabricks WorkflowsDelta LakeDelta Live TablesGitGithub CopilotJavaJenkinsOracleParquetPysparkPythonScalaSigmaSpinnakerSQLTableau
What you need to know about the Charlotte Tech Scene
Ranked among the hottest tech cities in 2024 by CompTIA, Charlotte is quickly cementing its place as a major U.S. tech hub. Home to more than 90,000 tech workers, the city’s ecosystem is primed for continued growth, fueled by billions in annual funding from heavyweights like Microsoft and RevTech Labs, which has created thousands of fintech jobs and made the city a go-to for tech pros looking for their next big opportunity.
Key Facts About Charlotte Tech
- Number of Tech Workers: 90,859; 6.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Lowe’s, Bank of America, TIAA, Microsoft, Honeywell
- Key Industries: Fintech, artificial intelligence, cybersecurity, cloud computing, e-commerce
- Funding Landscape: $3.1 billion in venture capital funding in 2024 (CED)
- Notable Investors: Microsoft, Google, Falfurrias Management Partners, RevTech Labs Foundation
- Research Centers and Universities: University of North Carolina at Charlotte, Northeastern University, North Carolina Research Campus
