Vatica Health Logo

Vatica Health

Senior Data Engineer

Posted 6 Days Ago
Remote
Hiring Remotely in United States
Senior level
Remote
Hiring Remotely in United States
Senior level
Designs, builds, and operates scalable batch and streaming data pipelines, ETL/ELT workflows, cloud solutions, and secure Python REST APIs. Develops data foundations for machine learning, generative AI, embeddings, and retrieval-based applications. Ensures data quality, security, observability, lineage, and reliability while optimizing performance and cost. Leads architecture and code reviews, establishes engineering standards, mentors engineers, and collaborates with product, analytics, data science, and machine learning teams.
The summary above was generated by AI

Vatica Health and Cozeva bring together clinical expertise and technology to support risk adjustment, quality, and value-based care. Our teams help providers and health plans use clinical information to improve documentation and identify care gaps.

About the Role

As a Senior Data Engineer, you will design, build, and operate the data pipelines and APIs that support our data-driven and AI-enabled products. You will own how data moves from ingestion through consumption, ensuring it is reliable, secure, and available for the teams and products that depend on it.

You will partner with product, analytics, data science, and machine learning teams to translate business needs into scalable production solutions. This hands-on role also includes leading technical reviews, establishing engineering standards, and mentoring other engineers.

Responsibilities

  • Design, build, and maintain batch and streaming pipelines for structured and unstructured data from databases, APIs, event streams, and files.
  • Develop ETL/ELT processes and optimize performance, cost, scalability, and reliability.
  • Build and operate cloud solutions using AWS services such as EC2, ECS, Lambda, API Gateway, and SQS.
  • Develop and manage data workflows, including scheduling, dependencies, retries, alerts, and backfills.
  • Establish monitoring, logging, and observability to identify issues and support reliable production operations.
  • Design, develop, test, and maintain secure REST APIs and Python-based data services using frameworks such as FastAPI or Flask.
  • Implement API authentication, authorization, validation, versioning, error handling, rate limiting, and documentation.
  • Build data foundations for machine learning and generative AI, including feature pipelines, training and inference datasets, embeddings, and retrieval-based solutions.
  • Integrate AI tools and large language model (LLM) APIs into workflows for document processing, enrichment, classification, and summarization.
  • Implement data quality checks, validation, lineage, and documentation, applying security, privacy, and compliance standards.
  • Lead architecture and code reviews, mentor engineers, and communicate technical recommendations to business and technical stakeholders.

Requirements

Required Qualifications

  • 8–10 years of professional experience in data engineering or a related field.
  • Strong Python and advanced SQL skills, with experience delivering production data pipelines at scale.
  • Hands-on experience with at least one workflow orchestration platform and big data processing frameworks.
  • Experience developing and deploying production REST APIs, including integration, security, and automated testing.
  • Experience with cloud platforms and data services.
  • Understanding of data warehousing, lakehouse architecture, and data modeling.
  • Working knowledge of AI and machine learning workflows, LLM APIs, embeddings, and vector databases.
  • Experience with Git, CI/CD, Docker, and infrastructure as code tools such as Terraform.
  • Strong problem-solving, communication, and stakeholder management skills.

Preferred Qualifications

  • Experience building and operating solutions on AWS.
  • Experience delivering retrieval-augmented generation (RAG) or agent-based solutions in production.
  • Knowledge of data governance, cataloging, and lineage tools.
  • Cloud or data platform certifications.
  • Healthcare industry experience.
  • Bachelor’s or master’s degree in Computer Science, Engineering, or a related field.

Benefits

WORKING AT VATICA HEALTH ADVANTAGES

Prosperity

  • Competitive salary based on your experience and skills – we believe the top talent deserves the top dollar
  • Bonus Potential (based on role and is discretionary) – if you go above and beyond, you should be rewarded
  • 401k plans– we want to empower you to prepare for your future
  • Room for growth and advancement- we love our employees and want to develop within

Good Health

  • Comprehensive Medical, Dental, and Vision insurance plans
  • Tax-free Dependent Care Account
  • Life insurance, short-term, and long-term disability

Happiness

  • Excellent PTO policy (everyone deserves a vacation now and then)
  • Great work-life balance environment- We believe family comes first!
  • Strong supportive teams- There is always a helping hand when you need it

Similar Jobs

5 Days Ago
Easy Apply
Remote or Hybrid
United States
Easy Apply
125K-234K Annually
Senior level
125K-234K Annually
Senior level
Fintech • Mobile • Software • Financial Services
Build and maintain production data pipelines, dbt models, Airflow workflows, and governed datasets supporting People Analytics. Integrate Workday and other HR systems into reliable Snowflake data products, implement data quality monitoring, row-level security, semantic models, and AI agents. Partner with engineers, analysts, data scientists, and business stakeholders to deliver trusted data solutions, communicate technical trade-offs, enforce governance, and mentor other engineers.
Top Skills: Ai AgentsAmazon RedshiftApache AirflowCi/CdDbtEtl/EltGitlabGoogle Cloud PlatformLlmsPythonSnowflakeSQLWorkday
Yesterday
In-Office or Remote
180K-240K Annually
Senior level
180K-240K Annually
Senior level
Artificial Intelligence • Fintech • Payments • Business Intelligence • Financial Services • Generative AI
Build and operate distributed data and AI infrastructure for Airwallex’s Knowledge Platform. Responsibilities include architecting high-availability systems, optimizing state management and exactly-once processing, integrating streaming, vector indexing and agentic workflows, processing petabytes of data globally, and mentoring engineers through technical leadership.
Top Skills: Apache FlinkSparkClickhouseDatabricksGoJavaKafkaKotlinKubernetesOlap Engines
4 Days Ago
In-Office or Remote
CA, USA
185K-327K Annually
Senior level
185K-327K Annually
Senior level
Blockchain • eCommerce • Fintech • Payments • Software • Financial Services • Cryptocurrency
Design, build, and operate shared backend platforms and frameworks for data acquisition, processing, and access. Lead projects from architecture through production, develop event-driven and batch or streaming systems, and improve reliability, observability, scalability, and data quality. Collaborate with software engineers, data engineers, and data scientists, make architectural trade-offs, mentor engineers, and contribute to technical standards. The role may also involve external data integrations and analytics and machine-learning data systems.
Top Skills: AWSCloudeventsDatabricksDatahubDbtIcebergJavaKafkaKotlinPrefectSnowflakeSparkSpark Structured Streaming

What you need to know about the Charlotte Tech Scene

Ranked among the hottest tech cities in 2024 by CompTIA, Charlotte is quickly cementing its place as a major U.S. tech hub. Home to more than 90,000 tech workers, the city’s ecosystem is primed for continued growth, fueled by billions in annual funding from heavyweights like Microsoft and RevTech Labs, which has created thousands of fintech jobs and made the city a go-to for tech pros looking for their next big opportunity.

Key Facts About Charlotte Tech

  • Number of Tech Workers: 90,859; 6.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Lowe’s, Bank of America, TIAA, Microsoft, Honeywell
  • Key Industries: Fintech, artificial intelligence, cybersecurity, cloud computing, e-commerce
  • Funding Landscape: $3.1 billion in venture capital funding in 2024 (CED)
  • Notable Investors: Microsoft, Google, Falfurrias Management Partners, RevTech Labs Foundation
  • Research Centers and Universities: University of North Carolina at Charlotte, Northeastern University, North Carolina Research Campus

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account