Big Data Lead

Database Development & Management • Strong experience in SQL development and query optimization. • Hands-on experience with Snowflake (preferred), Oracle, or any relational database. • Understanding of database indexing, partitioning, and performance tuning. . ETL/ELT Development • Expertise in ETL/ELT development, preferably using Talend (or any other ETL tool). • Strong proficiency in Advanced SQL scripting for data transformation and processing. • Ability to design, develop, and optimize data pipelines for structured/unstructured data. • Experience in error handling, logging, and recovery mechanisms for ETL processes. Data Warehousing & Modeling • Understanding of Data Warehousing concepts, including Star Schema and Dimension Modeling. • Hands-on experience with Snowflake (preferred) or other cloud/on-prem data warehouses. • Ability to design and maintain Fact and Dimension tables for analytics and reporting. • Knowledge of data partitioning and performance tuning techniques in DWH environments. CI/CD & Version Control (Good to Have, Not Core Focus) • Experience using GIT for version control of ETL scripts and database objects. • Exposure to CI/CD tools like TeamCity (preferred), Jenkins, or Azure DevOps for ETL deployment automation. • Understanding of branching strategies, merging, and automated deployments for ETL processes. • Familiarity with scheduled job execution and monitoring via CI/CD tools. Cloud Exposure (Good to Have, Not Core Focus) • Basic familiarity with Azure or AWS cloud environments. • Understanding of Snowflake on Azure/AWS or Redshift on AWS (data storage, querying, and schema management). • Exposure to cloud storage solutions (Azure Blob, AWS S3) for data ingestion and staging. • Awareness of cloud-based ETL services (Azure Data Factory, AWS Glue) – preferred but not required.