Lead the design and development of Azure-based big data solutions, including batch and real-time ETL/ELT pipelines, data architecture, ingestion, curation, warehousing, and storage. Build solutions using Azure Data Factory, Databricks, Synapse, Spark, Python, SQL, and related Azure services. Support Salesforce migration and integration while applying strong RDBMS, data management, and big data design expertise.
Expertise on Azure platforms including Azure Databricks, ADLS, and its various components, • In-dept knowledge and hands-on experience in Microsoft Azure data stack i.e., Azure Data Factory, Azure SQL Database, Azure Functions, Logic apps, Spark and Python programming etc. • Expertise on Azure platforms including Azure Databricks and its various components, including Delta Lake. • Strong understanding of data architecture and data management principles. • In-dept knowledge and hands-on experience in Microsoft Azure data stack i.e., Azure Data Factory, Azure Synapse, Azure SQL Database, Azure Functions, Logic apps, Spark Knowledge etc. • In-depth Knowledge on designing of ETL Piplines for Batch and Real time in Azure data factory and Azure datafactory • Hands on experience on Function apps , Event Hubs,, Web apps , API M. • Good have to experience on Migration to Salesforce • Strong experience with designing ETL/ELT Pipelines/Data flows using Azure Data Factory as Primary skill and SSIS/Informatica as additional skills. • Proficiency in programming languages such as Python, SQL, Spark notebooks and Scala. • Must have strong development & design skills in leading RDBMS environments e.g. MS SQL Server and Oracle 10g. • Experience of Big data approach, architectural concepts, data sourcing/ ingestion/ curation and storage mechanisms. • Experience with real-time / near-real-time Data warehousing concepts and Design approaches.
Similar Jobs
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Architects, deploys, and operates scalable data platform infrastructure supporting analytics. Responsibilities include administering Airflow and Superset, managing Terraform infrastructure, building CI/CD pipelines, implementing security and compliance controls, developing dbt data models, cataloging assets in OpenMetadata, automating with Python, and mentoring engineers. The role requires extensive infrastructure and data engineering experience, cloud expertise, container orchestration, and eligibility for CJIS clearance.
Top Skills:
Ai TechnologiesApache AirflowApache SupersetAWSAzureCi/CdDbtDockerGCPIamKubernetesMachine Learning PipelinesOciOpenmetadataPythonSQLTerraform
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Build and lead production AI/ML, Generative AI, and data engineering solutions for healthcare analytics and patient safety platforms. Develop full-stack applications, microservices, APIs, data pipelines, dashboards, self-service analytics, RAG systems, and event-driven architectures using cloud-native technologies. Apply engineering best practices including testing, CI/CD, observability, security, and performance optimization. Mentor engineers, lead technical initiatives, and collaborate with product, analytics, business, and platform teams.
Top Skills:
Amazon KinesisAWSAzureAzure Event HubsCi/CdDatabricksDelta LakeGCPGenerative AiJavaJavaScriptKafkaLarge Language Models (Llms)Microsoft FabricMlopsPysparkPythonReactRest ApisRetrieval-Augmented Generation (Rag)SnowflakeSparkSpring BootSQLTypescriptVector Search
Artificial Intelligence • Insurance • Machine Learning • Software • Analytics
Build and maintain automated data quality testing for customer data pipelines. Responsibilities include developing dbt, Soda, and SQL checks; validating schemas, loads, sequencing, and downstream reconciliations; detecting anomalies; managing severity levels and customer overrides; reporting quality metrics; and partnering with engineering teams to embed testing into new pipelines. The role requires strong backend testing, SQL, Python, Airflow, and Databricks experience, along with excellent debugging and communication skills.
Top Skills:
Apache AirflowCi/CdCypressDatabricksDbtDelta LakeGitPlaywrightPythonSodaSpark SqlSQL
What you need to know about the Charlotte Tech Scene
Ranked among the hottest tech cities in 2024 by CompTIA, Charlotte is quickly cementing its place as a major U.S. tech hub. Home to more than 90,000 tech workers, the city’s ecosystem is primed for continued growth, fueled by billions in annual funding from heavyweights like Microsoft and RevTech Labs, which has created thousands of fintech jobs and made the city a go-to for tech pros looking for their next big opportunity.
Key Facts About Charlotte Tech
- Number of Tech Workers: 90,859; 6.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Lowe’s, Bank of America, TIAA, Microsoft, Honeywell
- Key Industries: Fintech, artificial intelligence, cybersecurity, cloud computing, e-commerce
- Funding Landscape: $3.1 billion in venture capital funding in 2024 (CED)
- Notable Investors: Microsoft, Google, Falfurrias Management Partners, RevTech Labs Foundation
- Research Centers and Universities: University of North Carolina at Charlotte, Northeastern University, North Carolina Research Campus
