The Senior Data Engineer will optimize data integrations for Retail, design ETL workflows, enhance BigQuery performance, and maintain data quality in a collaborative, growth-driven environment.
Softeta is an IT consulting and custom software development company that works with mid-sized and large businesses across Europe. We help clients modernize legacy systems, build tailored digital solutions, and prepare their data infrastructure for AI and automation.
We are looking for a skilled Data or Software Engineer to help improve, maintain, and optimize the data integrations used in reports for the Retail industry. Are you seeking a vibrant, open-minded space where your growth is nurtured and innovation thrives? Your opportunity could be just around the corner!
Responsibilities:
- Combine data from multiple sources such as APIs, databases, and third-party systems;
- Design and execute ETL/ELT workflows utilizing advanced data processing tools like Cloud Composer/Airflow, Dataflow;
- Develop robust and efficient data pipelines, implement processing logic, and perform data transformations;
- Enhance BigQuery queries and allocate resources effectively to minimize costs and boost performance;
- Maintain data quality, availability, and security by adhering to industry best practices.
Requirements
- Demonstrated experience as a Data or Software Engineer in Senior role;
- Prior experience with dbt and Python is advantageous;
- Familiarity with CI/CD systems like GitLab is required;
- Experience with any public Cloud service;
- Knowledge of Google Cloud and Cloud Data Warehousing is highly beneficial;
- Specifically, experience with BigQuery or Snowflake and their integration with dbt is preferred. Additionally, proficiency with Terraform is strongly desired.
Benefits
- Diverse and technically challenging projects;
- Flexible working hours and hybrid or remote workplace model;
- Flexible schedule and Agile/SCRUM environment;
- Technical equipment which you can choose.
Top Skills
Airflow
APIs
BigQuery
Cloud Composer
Cloud Data Warehousing
Databases
Dataflow
Dbt
Gitlab
GCP
Python
Snowflake
Terraform
Similar Jobs
Artificial Intelligence • Information Technology • Consulting
Design and maintain data pipelines and ML systems, implement MLOps practices, and collaborate with teams to address client challenges in AI and data projects.
Top Skills:
Apache AirflowSparkAWSBedrockClickhouseEcrGlueKafkaLambdaPythonRedshiftS3SagemakerSnowflakeSQL
Software
Develop and deliver data pipelines, manage deployments, ensure data quality, and support troubleshooting within the data delivery team.
Top Skills:
Azure Data FactoryCi/CdDbtGitSnowflakeSQL
Marketing Tech • Software
Lead the design and optimization of data pipelines and infrastructure, ensuring data availability and quality while collaborating with data scientists and adopting new technologies.
Top Skills:
AirflowDockerElkGCPGrafanaKubernetesLinuxPrometheusPythonSQLTerraformUnix
What you need to know about the Charlotte Tech Scene
Ranked among the hottest tech cities in 2024 by CompTIA, Charlotte is quickly cementing its place as a major U.S. tech hub. Home to more than 90,000 tech workers, the city’s ecosystem is primed for continued growth, fueled by billions in annual funding from heavyweights like Microsoft and RevTech Labs, which has created thousands of fintech jobs and made the city a go-to for tech pros looking for their next big opportunity.
Key Facts About Charlotte Tech
- Number of Tech Workers: 90,859; 6.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Lowe’s, Bank of America, TIAA, Microsoft, Honeywell
- Key Industries: Fintech, artificial intelligence, cybersecurity, cloud computing, e-commerce
- Funding Landscape: $3.1 billion in venture capital funding in 2024 (CED)
- Notable Investors: Microsoft, Google, Falfurrias Management Partners, RevTech Labs Foundation
- Research Centers and Universities: University of North Carolina at Charlotte, Northeastern University, North Carolina Research Campus
