Abacus Insights Logo

Abacus Insights

Senior Data Governance & Quality Engineer

Posted 6 Days Ago
Remote
Hiring Remotely in USA
Senior level
Remote
Hiring Remotely in USA
Senior level
The Senior Data Governance and Quality Engineer will design data quality frameworks, drive governance initiatives, and collaborate with teams to ensure data integrity and compliance.
The summary above was generated by AI

Abacus Insights is a mission-driven, start-up technology company focused on transforming the healthcare payer industry, ultimately creating a more personalized patient experience, improving health outcomes, and lowering the overall cost of healthcare. Abacus Insights provides a flexible, efficient, and secure platform that organizes and exchanges healthcare data from various sources and formats, allowing our customers to uncover differentiated insights that address their clients' needs. Our employees know that they play an active role in keeping our customers' data safe and are responsible for ensuring that our comprehensive policies and practices are met.  

With our deep expertise in cloud-enabled technologies and knowledge of the healthcare industry, we have built an innovative data integration and management platform that allows healthcare payers access to data that has been historically siloed and inaccessible. Through our platform, these health insurance payers can ingest and manage all the data they need to transform their business by supporting their analytical, operational, and financial needs.  

Since our founding in 2017, Abacus has built a highly successful SaaS business, raising $100 Million by leading VC firms who have deep expertise in the healthcare and technology industries. We are solving problems of massive scale and complexity in an industry that is not only ready for disruption. We're growing quickly and would love for you to be a part of it!  

About the Role:  

We are looking for a Senior Data Governance and Quality Engineer to play a critical role in maintaining the integrity, accuracy, and reliability of data throughout our enterprise data ecosystem. This role involves designing and implementing scalable data quality frameworks, driving governance initiatives, and collaborating with cross-functional teams to operationalize high standards of data quality.

The ideal candidate will possess a strong understanding of data governance principles, data lifecycle management, and end-to-end data transformation processes, along with hands-on experience in deploying enterprise-level data quality solutions. As a member of our engineering team, you will be responsible for coaching, mentoring, managing, and leading team members within an agile environment.

You should expect to:

  • Data Quality Framework Development: Develop, implement, and sustain a comprehensive data quality framework to systematically monitor, validate, and enhance data accuracy and consistency throughout all systems. Develop and maintain scalable data quality solutions utilizing Databricks and Apache Spark, primarily leveraging PySpark.
  • Governance & Compliance: Operationalize the enterprise data governance framework, aligning with stakeholder needs related to data quality, access controls, compliance, privacy, and security.
  • Data Monitoring & Auditing: Identify and address data anomalies, inconsistencies, duplicates, and missing values. Conduct periodic audits to ensure ongoing data integrity.
  • Cross-Functional Collaboration: Partner with data engineers, architects, product teams, and analysts to define data quality requirements and ensure alignment with business objectives.
  • Insight Generation: Develop clear and actionable dashboards and reports (e.g., Power BI, Salesforce) to visualize data quality trends, KPIs, and issue resolution progress.
  • Root Cause Analysis: Collaborate with data stewards and product owners to investigate and resolve data quality issues, establishing sustainable remediation processes.
  • Technical Expertise: Apply strong understanding of data models (e.g., star schema, snowflake, data marts, data lakes) to evaluate and improve data structures and flows.
  • Process Ownership: Take ownership of assigned initiatives, break complex challenges into manageable components, and execute plans effectively with minimal supervision.

What we’re looking for:

  • Education: Bachelor’s or Master’s degree in Computer Science, Data Engineering, Information Systems, or a related field.
     
  • Experience: Minimum 5+ years of experience in Data Quality, Data Governance, or Data Engineering roles.Strong hands-on experience with Databricks, PySpark, Python, and SQL
     
  • Technical Skills:
    o Proficiency in SQL, Python, and modern data pipeline tools.
    o Familiarity with data governance and quality tools (e.g., Collibra, Informatica, Alation, Great Expectations).
    o Experience working with cloud platforms (AWS, Azure, or GCP).
    o Strong understanding of BI and reporting tools such as Power BITableau
     
  • Domain Expertise:
    o In-depth knowledge of data lifecycle managementdata lineage, and metadata management.
    o Awareness of current and emerging data governance and data management best practices.
     
  • Soft Skills:
    o Strong analytical and problem-solving mindset.
    o Excellent communication and stakeholder engagement abilities.
    o Proven capability to operate independently and deliver results in a dynamic environment.

Equal Opportunity Employer  

As a mission-led technology company that is helping to drive better healthcare outcomes, Abacus Insights believes that the best innovation and value we can bring to our customers comes from diverse ideas, thoughts, experiences, and perspectives. We are dedicated to building diverse teams and providing equal employment opportunities to all applicants. Abacus prohibits discrimination and harassment of any type regarding race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws. 

Top Skills

Alation
Spark
AWS
Azure
Collibra
Databricks
GCP
Great Expectations
Informatica
Power BI
Pyspark
Python
Salesforce
SQL
Tableau

Similar Jobs

5 Hours Ago
In-Office or Remote
San Francisco, CA, USA
123K-193K Annually
Junior
123K-193K Annually
Junior
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Develop and improve core customer experiences by building REST APIs, React components, and CI/CD pipelines while ensuring reliability and integration with content management systems.
Top Skills: CSSDockerEs6ExpressGitHTMLJavaScriptNginxNode.jsNpmReactSassTypescript
5 Hours Ago
In-Office or Remote
San Francisco, CA, USA
123K-193K Annually
Junior
123K-193K Annually
Junior
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
As a Backend Software Engineer, build REST APIs, configure monitoring, develop CICD pipelines, and create services with reliability in mind.
Top Skills: AWSDockerExpress/NodeFreemarkerGitGoJavaKotlinNginxNpmPythonRestRustScala
7 Hours Ago
Remote or Hybrid
United States
109K-181K Annually
Senior level
109K-181K Annually
Senior level
Automotive • Cloud • Greentech • Information Technology • Other • Software • Cybersecurity
Lead strategic growth initiatives for DealShield, enhancing engagement with partner auctions and driving product adoption. Build relationships, ensure customer satisfaction, minimize churn, and represent the company effectively.

What you need to know about the Charlotte Tech Scene

Ranked among the hottest tech cities in 2024 by CompTIA, Charlotte is quickly cementing its place as a major U.S. tech hub. Home to more than 90,000 tech workers, the city’s ecosystem is primed for continued growth, fueled by billions in annual funding from heavyweights like Microsoft and RevTech Labs, which has created thousands of fintech jobs and made the city a go-to for tech pros looking for their next big opportunity.

Key Facts About Charlotte Tech

  • Number of Tech Workers: 90,859; 6.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Lowe’s, Bank of America, TIAA, Microsoft, Honeywell
  • Key Industries: Fintech, artificial intelligence, cybersecurity, cloud computing, e-commerce
  • Funding Landscape: $3.1 billion in venture capital funding in 2024 (CED)
  • Notable Investors: Microsoft, Google, Falfurrias Management Partners, RevTech Labs Foundation
  • Research Centers and Universities: University of North Carolina at Charlotte, Northeastern University, North Carolina Research Campus

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account