The Senior Data Engineer designs scalable data pipelines, collaborates with teams to address business needs, and ensures data infrastructure reliability.
Join a pioneering financial services company that is redefining homeownership through innovative, data-driven solutions. As a Senior Data Engineer, you will be instrumental in designing and building scalable data pipelines, transforming complex datasets, and ensuring the reliability of the data infrastructure. Working closely with data scientists and analysts, you will provide critical insights that shape strategic decisions. If you are passionate about data engineering and thrive in a fast-paced, collaborative environment, this role offers you the opportunity to contribute to cutting-edge projects and help shape the future of data architecture
Requirements
- 5+ years of Python development experience.
- Desirable experience with AWS, including services like DynamoDB, S3, EMR, Glue, Athena, and Redshift.
- Knowledge of distributed computing engines, such as Apache Spark.
- Proficiency in both relational and non-relational databases, along with data modeling expertise.
- Experience setting up code pipelines using CloudFormation or Terraform.
- Familiarity with ETL pipeline development in OLAP and Data Warehouse environments.
- Hands-on experience with orchestration tools like Airflow.
- Understanding of serverless architectures and scalable application design principles.
- Proficiency with version control systems, particularly Git.
- Experience with Node.js, DevOps, and CI/CD practices is a plus.
- Background in cloud technologies (AWS/ Azure / GCP) and fintech or banking is desirable.
Responsibilities
- Design and implement scalable data pipelines in a horizontally scaled environment.
- Collaborate with cross-functional teams to understand business needs and define transactional scenarios across multiple microservices.
- Write high-quality, maintainable code that meets established standards and best practices.
- Build strong relationships with clients by understanding their business model and delivering solutions that align with their goals.
- Influence and communicate effectively at all levels, including management and engineering teams.
- Utilize distributed computing systems to transform and manage large datasets efficiently.
- Work with cloud-based technologies such as AWS to support the company’s data infrastructure.
- Contribute to continuous integration/continuous delivery (CI/CD) pipelines and DevOps practices.
- Collaborate with data scientists to ensure the availability and accessibility of critical insights for decision-making.
Top Skills
Airflow
Spark
Athena
AWS
Ci/Cd
CloudFormation
DevOps
DynamoDB
Emr
ETL
Git
Glue
Node.js
Olap
Python
Redshift
S3
Terraform
Similar Jobs
.png)
eCommerce • Information Technology • On-Demand • Professional Services • Software
As a Senior Data Engineer, you will design and maintain data sets and warehouses, collaborate with teams to understand data needs, and drive data quality and best practices while creating the next generation of data products.
Top Skills:
Apache AirflowApache KafkaBigQueryDbtPythonSQL
AdTech • Digital Media • Marketing Tech • Mobile
The role involves optimizing and maintaining ETL/ELT pipelines, collaborating on data challenges, and ensuring operational efficiency in data systems.
Top Skills:
AirflowArgocdAWSDockerFlinkIcebergKafkaKubernetesPrometheusPythonSnowflakeSpark
Artificial Intelligence • Cloud • Sales • Security • Software • Cybersecurity • Data Privacy
As a Senior Data Engineer, you'll design scalable data solutions and build data sets for AI and analytics, contributing to AI-driven products.
Top Skills:
AirflowAWSCloudbeesDbtFeastJenkinsKafkaPythonQlikShell/BashSnowflakeSQLTableau
What you need to know about the Charlotte Tech Scene
Ranked among the hottest tech cities in 2024 by CompTIA, Charlotte is quickly cementing its place as a major U.S. tech hub. Home to more than 90,000 tech workers, the city’s ecosystem is primed for continued growth, fueled by billions in annual funding from heavyweights like Microsoft and RevTech Labs, which has created thousands of fintech jobs and made the city a go-to for tech pros looking for their next big opportunity.
Key Facts About Charlotte Tech
- Number of Tech Workers: 90,859; 6.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Lowe’s, Bank of America, TIAA, Microsoft, Honeywell
- Key Industries: Fintech, artificial intelligence, cybersecurity, cloud computing, e-commerce
- Funding Landscape: $3.1 billion in venture capital funding in 2024 (CED)
- Notable Investors: Microsoft, Google, Falfurrias Management Partners, RevTech Labs Foundation
- Research Centers and Universities: University of North Carolina at Charlotte, Northeastern University, North Carolina Research Campus
