The Principal Data Engineer designs, builds, implements, and maintains data pipelines for ETL processes and collaborates with various teams to ensure data quality and integrity.
Position Summary:
The Data Engineering subfamily is responsible for the design, build, implementation, and maintenance of data processes throughout the organization. The Principal Data Engineer will design, build, implement, and maintain data processing pipelines for the extraction, transformation, and loading (ETL) of data from a variety of data sources. The role will develop robust and scalable solutions that transform data into a useful format for analysis, enhance data flow, and enable end-users to consume and analyze data faster and easier.
Expected Duties:
Principal Data Engineers will design, build, implement, and maintain data processing pipelines for the extraction, transformation, and loading (ETL) of data from a variety of data sources
Expected to lead the writing of complex SQL queries to support analytics needs
Responsible for developing technical tools and programming that leverage artificial intelligence, machine learning, and big-data techniques to cleanse, organize and transform data and to maintain, defend and update data structures and integrity on an automated basis
Principal Data Engineers will evaluate and recommend tools and technologies for data infrastructure and processing. Collaborate with engineers, data scientists, data analysts, product teams, and other stakeholders to translate business requirements to technical specifications and coded data pipelines
The role will work with tools, languages, data processing frameworks, and databases such as R, Python, SQL, Databricks, Spark, Delta, APIs. Work with structured and unstructured data from a variety of data stores, such as data lakes, relational database management systems, and/or data warehouses
Qualifications: Knowledge, Skills, and Abilities
The role will include work on problems of diverse scope where analysis of information requires evaluation of identifiable factors. Work is expected to be done independently through independent judgment.
- Ability to assess unusual circumstances and uses sophisticated analytical and problem-solving techniques to identify the cause
- Ability to enhance relationships and networks with senior internal/external partners who are not familiar with the subject matter often requires persuasion
- Architect and scale our modern data platform to support real-time and batch processing for financial forecasting, risk analytics, and customer insights
- Enforce high standards for data governance, quality, lineage, and compliance
- Partner with stakeholders across engineering, finance, sales, and compliance to translate business requirements into reliable data models and workflows.
- Evaluate emerging technologies and lead POCs that shape the future of our data stack.
- Champion a culture of security, automation, and continuous delivery in all data workflows
Technical Qualifications:
- Deep expertise in Python, SQL, and distributed processing frameworks like Apache Spark, Databricks, Snowflake, Redshift, BigQuery.
- Proven experience with cloud-based data platforms (preferably AWS or Azure).
- Hands-on experience with data orchestration tools (e.g., Airflow, dbt) and data warehouses (e.g., Databricks, Snowflake, Redshift, BigQuery).
- Strong understanding of data security, privacy, and compliance within a financial services context.
- Experience working with structured and semi-structured data (e.g., Delta, JSON, Parquet, Avro) at scale.
- Familiarity with modelling datasets in Salesforce, Netsuite and Anaplan to solve business use cases required.
- Previous experience Democratizing data at scale for the enterprise a huge plus.
Educational Qualifications and Work experience
- Bachelor's or master's degree in computer science, Engineering, or a related field.
- 6-8 years of experience in data engineering, with a strong focus on financial systems on SaaS platforms.
MeridianLink has a wonderful culture where people value the work they do and appreciate each other for their contributions. We develop our employees so they can grow professionally by preferring to promote from within. We have an open-door policy with direct access to executives; we want to hear your ideas and what you think. Our company believes that to be productive in the long term, we must have a genuine work-life balance. We understand that employees have families and full lives outside of the office. To that end, we honor their personal commitments.
MeridianLink is an Equal Opportunity Employer. We do not discriminate based on race, religion, color, sex, age, national origin, disability, or any other characteristic protected by applicable law.
MeridianLink runs a comprehensive background check, credit check, and drug test as part of our offer process.
Salary range of $152,200 - $200,000 [It is not typical for offers to be made at or near the top of the range.] The actual salary will be determined based on experience and other job-related factors permitted by law including geographical location.
Meridianlink offers:
Stock options or other equity-based awards
Insurance coverage (medical, dental, vision, life, and disability)
Flexible paid time off
Paid holidays
401(k) plan with company match
Remote work
All compensation and benefits are subject to the terms and conditions of the underlying plans or programs, as applicable and as may be amended, terminated, or superseded from time to time.
#LI-REMOTE
Top Skills
Airflow
Spark
Avro
AWS
Azure
BigQuery
Databricks
Dbt
Delta
JSON
Parquet
Python
Redshift
Snowflake
SQL
Similar Jobs
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Lead engineering projects, architect database schemas, build scalable code, mentor colleagues, and integrate AI solutions for enhanced productivity.
Top Skills:
AIAngularJavaJavaScriptReactVue
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
The Senior Technical Consultant/Developer will provide technical expertise in ServiceNow Finance & Supply Chain solutions, leading customer engagements, optimizing solutions, and developing integrations while mentoring other team members.
Top Skills:
BootstrapCoupaCSSHTMLIvaluaJavaScriptJSONLdapOracle Procurement CloudRestSap AribaSap EccSap S/4HanaServicenowSsoWeb ServicesXML
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
The role involves maintaining automation test frameworks, analyzing quality metrics, collaborating on test strategies, developing test plans, and assisting with troubleshooting issues.
Top Skills:
EclipseGitJavaJavaScriptJenkinsJunitMavenSeleniumTestng
What you need to know about the Charlotte Tech Scene
Ranked among the hottest tech cities in 2024 by CompTIA, Charlotte is quickly cementing its place as a major U.S. tech hub. Home to more than 90,000 tech workers, the city’s ecosystem is primed for continued growth, fueled by billions in annual funding from heavyweights like Microsoft and RevTech Labs, which has created thousands of fintech jobs and made the city a go-to for tech pros looking for their next big opportunity.
Key Facts About Charlotte Tech
- Number of Tech Workers: 90,859; 6.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Lowe’s, Bank of America, TIAA, Microsoft, Honeywell
- Key Industries: Fintech, artificial intelligence, cybersecurity, cloud computing, e-commerce
- Funding Landscape: $3.1 billion in venture capital funding in 2024 (CED)
- Notable Investors: Microsoft, Google, Falfurrias Management Partners, RevTech Labs Foundation
- Research Centers and Universities: University of North Carolina at Charlotte, Northeastern University, North Carolina Research Campus