Design, build, and maintain large-scale data pipelines and ETL processes using PySpark/Apache Spark, SQL/NoSQL stores, Hadoop, and Kafka. Work with cloud platforms (AWS/Azure/GCP), data lakes and warehouses, and Python for data manipulation. Lead projects, perform systems analysis, ensure delivery under deadlines, and collaborate across teams. CI/CD and containerization experience is a plus.
Requirements and Qualifications:
- 8+ years of relevant experience in the Data Engineering, ApacheSpark
- Strong proficiency in PySpark and Apache Spark.
- Solid experience with SQL, NoSQL databases (e.g., Hive, HBase, Cassandra).
- Hands-on experience with big data frameworks (Hadoop, Kafka, etc.).
- Expertise in cloud platforms (AWS, Azure, or GCP).
- Proficiency in Python programming and data manipulation.
- Knowledge of ETL tools, data lakes, and data warehouses.
- Experience in CI/CD, containerization (Docker, Kubernetes) is a plus.
- Strong problem-solving and analytical skills.
- Excellent communication and teamwork skills.
- Experience in systems analysis and programming of software applications
- Experience in managing and implementing successful projects
- Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements
Compensation, Benefits and Duration
Minimum Compensation: USD 46,000
Maximum Compensation: USD 161,000
Compensation is based on actual experience and qualifications of the candidate. The above is a reasonable and a good faith estimate for the role.
Medical, vision, and dental benefits, 401k retirement plan, variable pay/incentives, paid time off, and paid holidays are available for full time employees.
This position is not available for independent contractors
No applications will be considered if received more than 120 days after the date of this post
Similar Jobs
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Responsible for planning, deploying, and supporting the CrowdStrike platform. Engage with customers for implementation and troubleshoot issues across various environments.
Top Skills:
BashChefCrowdstrike Falcon PlatformGroup PolicyIbm BigfixLinuxmacOSMcafee EpoPowershellPuppetPythonSccmWindows
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Deliver proactive cybersecurity advisory engagements: assess and mature security and incident response programs, develop exercise scenarios, produce high-quality reports and recommendations, identify emerging threats, and contribute thought leadership and internal methodology development. Work closely with customer executives and support engagement leadership to ensure timely delivery.
Top Skills:
AI
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Deliver strategic advisory engagements to assess and mature cybersecurity and incident response programs, develop exercise scenarios, produce high-quality reports and recommendations, identify emerging trends, and contribute thought leadership and methodology development. Support engagement leadership, work independently and with teams, and travel to client sites up to 30% of the time. Utilize AI technologies to enhance decision-making and workflows.
Top Skills:
AICrowdstrike
What you need to know about the Charlotte Tech Scene
Ranked among the hottest tech cities in 2024 by CompTIA, Charlotte is quickly cementing its place as a major U.S. tech hub. Home to more than 90,000 tech workers, the city’s ecosystem is primed for continued growth, fueled by billions in annual funding from heavyweights like Microsoft and RevTech Labs, which has created thousands of fintech jobs and made the city a go-to for tech pros looking for their next big opportunity.
Key Facts About Charlotte Tech
- Number of Tech Workers: 90,859; 6.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Lowe’s, Bank of America, TIAA, Microsoft, Honeywell
- Key Industries: Fintech, artificial intelligence, cybersecurity, cloud computing, e-commerce
- Funding Landscape: $3.1 billion in venture capital funding in 2024 (CED)
- Notable Investors: Microsoft, Google, Falfurrias Management Partners, RevTech Labs Foundation
- Research Centers and Universities: University of North Carolina at Charlotte, Northeastern University, North Carolina Research Campus
