Build and optimize scalable data pipelines and cloud-based data solutions using Python, PySpark, SQL, and Snowflake. Integrate REST APIs and external data sources, develop ETL/ELT workflows, optimize Snowflake queries, and implement data quality, validation, monitoring, and automation. Collaborate with engineering and analytics teams to deliver reliable data platforms.
Job Description
Data Engineer - Python, PySpark, SQL, Snowflake & API Integration
Job Description:
We are seeking a skilled Data Engineer with strong hands-on experience in Python, PySpark, SQL, Snowflake, and API integrations to build scalable data pipelines and cloud-based data solutions.
Key Responsibilities:
- Design, develop, and optimize data pipelines using Python, PySpark, SQL, and Snowflake.
- Integrate REST APIs and external data sources into Snowflake-based data platforms.
- Build and maintain ETL/ELT workflows for data ingestion, transformation, and processing.
- Develop efficient SQL queries and optimize Snowflake performance.
- Implement data quality, validation, monitoring, and automation.
- Collaborate with engineering and analytics teams to deliver reliable data solutions.
Required Qualifications:
- 3+ years of experience in Data Engineering.
- Strong hands-on expertise in Python, PySpark, SQL, and Snowflake.
- Experience with REST APIs, JSON, and API-based data integration.
- Knowledge of ETL/ELT processes, data modeling, and data warehousing.
- Experience with cloud platforms such as AWS, Azure, or GCP is preferred.
Additional Information
All your information will be kept confidential according to EEO guidelines.
Similar Jobs
Artificial Intelligence • Information Technology • Machine Learning • Natural Language Processing • Productivity • Software • Generative AI
Build and operate high-throughput backend services for AI agent orchestration, calendar systems, real-time infrastructure, APIs, and data pipelines. Design scalable platform services, infrastructure as code, and highly available production systems using Go, PostgreSQL, Kubernetes, and cloud platforms. Collaborate with AI, product, and frontend teams to deliver AI-powered features, contribute to reliability and testing practices, and mentor junior engineers.
Top Skills:
AWSAzureCi/CdClaude CodeCursorGCPGithub CopilotGoInfrastructure As CodeKubernetesPostgres
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Leads an enterprise account executive team, setting sales strategy, revenue goals, performance metrics, and development plans. The role recruits and coaches sales professionals, manages key client relationships and negotiations, analyzes market and sales data, collaborates with internal partners, and reports performance to senior leadership. It also drives enterprise market expansion, optimizes sales processes, and promotes consultative, value-based selling.
Top Skills:
CRMPipeline ManagementSales Analytics Tools
Blockchain • eCommerce • Fintech • Payments • Software • Financial Services • Cryptocurrency
Leads and executes risk-based IT, technology, and cybersecurity audits for a regulated financial institution. Responsibilities include risk assessment, audit scoping, control testing, reporting, remediation validation, application and infrastructure reviews, third-party technology assessments, audit planning, methodology improvement, and coaching. The role requires translating complex technical risks for varied audiences and applying data analytics and AI throughout the audit lifecycle.
Top Skills:
Artificial IntelligenceCobitData AnalyticsNist
What you need to know about the Charlotte Tech Scene
Ranked among the hottest tech cities in 2024 by CompTIA, Charlotte is quickly cementing its place as a major U.S. tech hub. Home to more than 90,000 tech workers, the city’s ecosystem is primed for continued growth, fueled by billions in annual funding from heavyweights like Microsoft and RevTech Labs, which has created thousands of fintech jobs and made the city a go-to for tech pros looking for their next big opportunity.
Key Facts About Charlotte Tech
- Number of Tech Workers: 90,859; 6.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Lowe’s, Bank of America, TIAA, Microsoft, Honeywell
- Key Industries: Fintech, artificial intelligence, cybersecurity, cloud computing, e-commerce
- Funding Landscape: $3.1 billion in venture capital funding in 2024 (CED)
- Notable Investors: Microsoft, Google, Falfurrias Management Partners, RevTech Labs Foundation
- Research Centers and Universities: University of North Carolina at Charlotte, Northeastern University, North Carolina Research Campus
