As a Data Engineer, you will develop data pipelines and APIs, configure cloud resources in AWS, and translate business needs into technical specifications.
As a Data Engineer, you will be part of a talented team of engineers responsible for the deployment and configuration of cloud resources to meet individual client business needs in AWS. Client engagements cover a wide variety of business requirements and require our engineers to adapt quickly and stay on top of recent cloud technology trends. Candidates should be able to identify and remediate issues within cloud-based systems, based on their knowledge of industry standards and best practices.
Responsibilities
Responsibilities
- Work with the team to evaluate business needs and priorities, liaise with key business partners and address team needs related to data systems and management
- Translate business requirements into technical specifications; establish and define details, definitions, and requirements of applications, components and enhancements
- Participate in project planning; identifying milestones, deliverables and resource requirements; tracks activities and task execution
- Generate design, development, test plans, detailed functional specifications documents, user interface design, and process flow charts for execution of programming
- Develop data pipelines / APIs using a variety of tools, including but not limited to Python, SQL, Spark and various AWS services
- Use an analytical, data-driven approach to drive a deep understanding of fast changing business
- Build large-scale batch and real-time data pipelines with data processing frameworks in AWS
- Moving data from on-prem to cloud and cloud data conversions
- Experience in data engineering with an emphasis on data pipelines, analytics and reporting
- Exposure to the AWS Cloud Platform
- Experience in SQL, data transformations, and troubleshooting across at least one database Platform (Redshift, Amazon RDS, Cassandra, Snowflake, PostgreSQL, Databricks, etc.)
- Experience in the design and build of data extraction, transformation, and loading processes by writing custom data pipelines
- Experience in a scripting languages such as Python
- Experience designing and building solutions utilizing various Cloud services such as EC2, S3, EMR, Kinesis, RDS, Redshift/Spectrum, Lambda, Glue, Athena, API gateway, etc.
- AWS Certification - Solutions Architect Pro or Data Specialty
- Machine Learning experience
- Advanced GenAI experience
Compensation:
The expected base salary range for this position is $115,000 – $130,000 USD annually, plus eligibility for an annual performance bonus.
Actual compensation will depend on experience, skill set, and location.
Benefits:
We offer a comprehensive benefits package that includes medical, dental, and vision coverage, and paid time off.
Similar Jobs
Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
Design and build data infrastructure, pipelines, and transformations using Azure Data Factory, Azure Databricks, and Snowflake. Develop data architecture and modeling, maintain data lakes/warehouses, ensure data quality and security, optimize performance, and collaborate with clients to deliver tailored data solutions and governance.
Top Skills:
Azure Data FactoryAzureMicrosoft Azure DatabricksSnowflake
Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
Lead design and implementation of scalable data infrastructure, pipelines, and transformations using cloud platforms. Build and optimize data warehouses (Snowflake, Databricks), orchestrate workflows (Airflow, Hadoop), ensure data quality and security, and coach teams to deliver analytics solutions that drive tax practice insights and client outcomes.
Top Skills:
Apache AirflowAWSAzure Data FactoryDatabricksHadoopSnowflake
Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
Lead design and implementation of data infrastructure, pipelines, and warehouses using Azure Data Factory, Databricks, and Snowflake. Manage data modeling, quality, security, and analytics frameworks. Lead client accounts, mentor teams, and drive innovation to deliver data-driven business insights.
Top Skills:
Azure Data FactoryMicrosoft Azure DatabricksSnowflake
What you need to know about the Charlotte Tech Scene
Ranked among the hottest tech cities in 2024 by CompTIA, Charlotte is quickly cementing its place as a major U.S. tech hub. Home to more than 90,000 tech workers, the city’s ecosystem is primed for continued growth, fueled by billions in annual funding from heavyweights like Microsoft and RevTech Labs, which has created thousands of fintech jobs and made the city a go-to for tech pros looking for their next big opportunity.
Key Facts About Charlotte Tech
- Number of Tech Workers: 90,859; 6.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Lowe’s, Bank of America, TIAA, Microsoft, Honeywell
- Key Industries: Fintech, artificial intelligence, cybersecurity, cloud computing, e-commerce
- Funding Landscape: $3.1 billion in venture capital funding in 2024 (CED)
- Notable Investors: Microsoft, Google, Falfurrias Management Partners, RevTech Labs Foundation
- Research Centers and Universities: University of North Carolina at Charlotte, Northeastern University, North Carolina Research Campus
