Top Data Engineer Jobs in Charlotte, NC

Design, implement, and manage advanced data ecosystems and scalable ETL/ELT pipelines. Analyze complex problems, deliver data warehousing and governance solutions, mentor junior staff, and build client relationships while maintaining high standards and business-context awareness.

Lead design and implementation of enterprise data architecture and cloud-based data solutions. Manage large data engineering projects, develop data models and pipelines, ensure governance and security compliance, advise clients strategically, and build high-performing inclusive teams.

Architect, deploy, and operate core data platform services (Airflow, Superset, Terraform). Build CI/CD pipelines, automate with Python, manage cloud infrastructure, implement security and compliance, develop dbt data models, catalog assets in OpenMetadata, and mentor junior engineers.

Lead the architecture and development of scalable AWS-based data ingestion, transformation, and orchestration pipelines. Build reliable data infrastructure using Python, SQL, Airflow, Lambda, ECS, SQS, and Terraform. Establish data modeling, quality, lineage, monitoring, testing, and observability practices while partnering with analysts, scientists, and backend engineers. Mentor senior engineers, guide technical decisions, and provide hands-on leadership for complex data platform initiatives.

Design, build, and own scalable data pipelines and evaluation systems that power production AI features and internal analytics. Ensure data quality across ingestion, modeling, and reporting, collaborate with ML and analytics teams, deploy and monitor ML systems, and establish standards for data work and evaluation.

Design, build, and maintain scalable Spark-based ETL pipelines and computed tables in a central data lake. Integrate structured and unstructured IoT, sensor, and external data for analytics, model training, and dashboards. Collaborate with Data Science, Analytics, and ML teams to ensure reliable, high-quality customer-facing datasets.

Configure and maintain Adobe Experience Platform and Real-Time CDP data pipelines, XDM schemas, datasets, identity resolution, Profile enablement, segmentation readiness, and destination activation. Validate data quality, troubleshoot ingestion and identity issues, manage sandboxes, and implement privacy, consent, governance, and access controls. Partner with architects, data engineers, consultants, analysts, data scientists, and marketing teams to support reporting, personalization, and machine learning readiness.

As a Principal Data Engineer, you will design and implement LLM, AI-powered security data platforms, mentor engineers, and drive the adoption of data solutions across teams.

Build, model, and maintain scalable BigQuery-based data solutions on GCP. Implement performant data models, storage partitioning/clustering, ETL improvements, data validation, and documentation. Collaborate with architects, data scientists, and engineers to deliver governed, high-quality data for reporting and AI initiatives.

Lead design and modernization of scalable, secure data systems and real-time pipelines for xOT cybersecurity. Create data contracts, observability, lineage, and cross-functional solutions supporting cloud and on-prem deployments, Kubernetes, and stream processing to enable threat detection and intelligence.

Develops enterprise data engineering and generative AI solutions, including data pipelines, transformation processes, LLM and RAG applications, AI agents, APIs, and microservices. Builds secure, scalable, governed AI systems with prompt optimization, guardrails, evaluation, observability, and compliance controls. Collaborates with engineering teams and business stakeholders to deliver data requirements, troubleshoot data issues, test solutions, manage risks, and prioritize AI use cases.

Leads the design, engineering, support, and modernization of mission-critical market data platforms, including LSEG TREP and related distribution systems. Builds low-latency, highly available infrastructure; validates feeds; improves resiliency, failover, monitoring, and recovery; troubleshoots data delivery issues; develops UNIX/Linux automation; collaborates on networking, security, upgrades, vendor integration, risk controls, and production support.

Design, build, and operate production AI and data systems for marketing: LLM/agent orchestration, retrieval pipelines, data pipelines, CDP and warehouse architecture, automation of manual workflows, data quality and reliability, stakeholder collaboration, and mentoring. Ship production-grade Python and SQL solutions and evaluate/monitor AI systems.

Build and maintain cloud cost monitoring, alerting, and optimization tooling. Develop automation, cost allocation/tagging, data pipelines, dashboards, and integrations with billing APIs. Support FinOps processes, implement cost guardrails, troubleshoot cost systems, participate in on-call rotation, and collaborate with senior engineers and product teams to drive cost-efficient infrastructure and reporting.

Designs, builds, and maintains scalable ETL/ELT pipelines and finance data models using Snowflake, AWS, dbt Core, Python, and SQL. Develops Medallion architecture data marts, integrates ERP systems, and partners with stakeholders on financial workflows. Implements data governance, RBAC, automated quality testing, observability, documentation, CI/CD, and secure deployments. Monitors Snowflake costs and optimizes queries while supporting Oracle EBS integrations and the migration to Workday.

Designs and develops complex cloud-native data solutions, scalable batch and real-time pipelines, APIs, data models, and enterprise data platforms. Implements data governance, quality, lineage, security, observability, CI/CD, automated testing, and operational reporting capabilities. Collaborates with architects, product owners, analysts, governance, security, and platform teams on technology strategy and cloud modernization. Mentors engineers, leads technical design discussions, presents recommendations, and supports AI-ready data products and emerging development tools.

Support the design, development, and maintenance of data pipelines, workflows, and cloud-based data platforms. Build reliable data assets through ingestion, transformation, profiling, validation, monitoring, and data modeling. Collaborate with cross-functional teams to support analytics, reporting, automation, machine learning, and AI initiatives. Interns will gain experience with Python, SQL, ETL/ELT, Snowflake, cloud technologies, GitHub, and AI tools while receiving mentorship and professional development.

Build and operate AWS GovCloud data infrastructure across development, preproduction, and production environments. Establish PostgreSQL platforms, infrastructure-as-code with Chef, BI infrastructure, identity integrations, monitoring, observability, CI/CD, and disaster recovery. Support data pipelines, troubleshoot incidents, optimize databases, and ensure FedRAMP and FISMA compliance. Collaborate with security, compliance, DevOps, and data engineering teams while delivering greenfield infrastructure from architecture through production.

Design, build, and maintain Keboola-based data pipelines integrating multiple business systems to deliver accurate, scalable data for supply chain, logistics, and transportation analytics; collaborate with analysts and engineers; support documentation, governance, and pipeline automation.

Own the design, development, maintenance, and performance of Microsoft Fabric data pipelines, centralized semantic models, DAX measures, and documentation. Ensure data quality, consistency, and trusted marketing metrics across sources. Partner with data engineering and BI teams on deployments and production issues, investigate model discrepancies, perform analytical work, mentor apprentices, and contribute to applied AI initiatives.

Designs and scales cloud-native data platforms and ingestion pipelines using AWS, Databricks, and Spark. Builds APIs, file-upload mechanisms, ETL/ELT workflows, data transformations, and Lakehouse architecture supporting analytics, machine learning, and operational use cases. Provides operational support for legacy C# .NET ingestion processes, troubleshoots pipelines, and promotes data governance, security, reliability, and documentation in a multi-tenant SaaS environment.

Design, build, and maintain Python-based data applications and scalable data pipelines using AWS Glue and PySpark; deploy containerized services on EKS; implement APIs with API Gateway and Lambda; integrate PostgreSQL, DynamoDB, and Kafka; follow TDD, CI/CD, and document work in Confluence and JIRA while collaborating in Agile teams.

Supports, maintains, troubleshoots, and optimizes production Databricks applications, Spark jobs, SQL queries, Delta Lake pipelines, clusters, workflows, and data quality processes. Responsibilities include platform configuration, observability, documentation, deployment support, technical testing, finance data engineering, stakeholder coordination, and incremental improvements. The role also contributes to reporting enablement, operational readiness, process improvement, and on-call support during EST business hours.

Designs and operates batch, streaming, and real-time data platforms and pipelines using Spark, Kafka, Iceberg, Airflow, and cloud infrastructure. Owns data lake evolution, data quality, observability, reliability, governance, event instrumentation, schema management, and privacy controls for PII, retention, deletion, and residency. Leads complex initiatives end-to-end, troubleshoots production issues, mentors engineers, and develops AI agent harnesses that enforce data engineering standards and quality gates.

Design and lead scalable data engineering solutions across Databricks and Microsoft Azure. Define enterprise data modeling standards, architect pipelines and integrations, establish engineering best practices, troubleshoot complex platform issues, and guide modernization and cloud migration initiatives. Provide technical leadership and mentorship while ensuring data platforms meet security, quality, governance, reliability, performance, and maintainability standards.