Lead design and implementation of large-scale data platforms and pipelines using Redshift, ADF, Hadoop/Hive, Spark/Scala, Snowflake, Databricks, and GCP. Drive architecture decisions, performance tuning, and best practices for big data processing and storage.
Amazon Redshift; Azure Data Factory; BigData -Hadoop; BigData -Hive; Scala; Apache Spark; Snowflake; Databricks; Google Cloud Platform
Similar Jobs
Information Technology • Consulting
Senior Data Engineer responsible for Snowflake-based cloud data platform design, building data pipelines, integrations (batch/event/near-real-time), API integration, ensuring CI/CD and operational support, applying security best practices and IaC, and collaborating in Agile teams.
Top Skills:
Ci/CdCloud Data Engineering ServicesEncryptionIamInfrastructure As CodeMessaging/Event PlatformsRelational DatabasesRestful ApisSecrets ManagementSnowflake
Information Technology • Consulting
Design, build, and optimize end-to-end ETL/ELT pipelines using Python and PySpark for large structured and unstructured datasets. Ensure data quality through validation and reconciliation, troubleshoot performance issues, implement CI/CD and code review practices, and collaborate with IT and business stakeholders to translate requirements into scalable data solutions.
Top Skills:
AWSAzureBitbucketCi/CdData WarehousingDistributed ComputingEtl/EltGCPGitHadoopMicrosoft Sql ServerPysparkPythonSparkSQL
Cloud • Consulting
Remote Big Data Tech Lead supporting AWS data analytics projects: assist technical supervision, perform code reviews, estimate scope/LOE, design and prioritize data solutions, manage technical delivery, and clarify business context to maximize impact.
Top Skills:
Amazon RedshiftSparkAws AthenaAws EmrAws GlueHadoopJavaPythonScalaSQL
What you need to know about the Charlotte Tech Scene
Ranked among the hottest tech cities in 2024 by CompTIA, Charlotte is quickly cementing its place as a major U.S. tech hub. Home to more than 90,000 tech workers, the city’s ecosystem is primed for continued growth, fueled by billions in annual funding from heavyweights like Microsoft and RevTech Labs, which has created thousands of fintech jobs and made the city a go-to for tech pros looking for their next big opportunity.
Key Facts About Charlotte Tech
- Number of Tech Workers: 90,859; 6.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Lowe’s, Bank of America, TIAA, Microsoft, Honeywell
- Key Industries: Fintech, artificial intelligence, cybersecurity, cloud computing, e-commerce
- Funding Landscape: $3.1 billion in venture capital funding in 2024 (CED)
- Notable Investors: Microsoft, Google, Falfurrias Management Partners, RevTech Labs Foundation
- Research Centers and Universities: University of North Carolina at Charlotte, Northeastern University, North Carolina Research Campus
