Designs, builds, and operates scalable data platforms, data lakes, and high-volume batch and streaming ingestion pipelines. Manages Kubernetes infrastructure with KEDA autoscaling, provisions the data stack using Terraform, and develops distributed data solutions for analytics, applications, AI workloads, and model execution. Ensures data quality, compliance, governance, reliability, and performance while providing technical guidance and improving infrastructure, CI/CD, testing, and system design practices.
We are looking for a highly skilled Senior Data Platform Engineer to join our Data Platform team and play a key role in designing, building, and evolving the company’s data infrastructure.
This is a hands-on engineering position focused on developing scalable data platforms, high-volume ingestion pipelines, and the foundational data systems that power analytics, product applications, AI workloads, and large-scale model execution. You will help architect our data lake, build reliable ingestion capabilities at scale, and shape the core infrastructure that supports the company’s future growth.
This is an exciting opportunity to work with cutting-edge technologies and have a defining impact on the architecture and evolution of our data platform.
Requirements:- 5+ years of experience as a Data Platform/Infra Engineer
- Proven track record of building and operating scalable data infrastructure specifically within Data Lake architectures.
- Proven experience designing and operating large-scale data processing workloads on Kubernetes, including workload autoscaling with KEDA.
- Experience with Snowflake.
- Strong proficiency in Python and SQL.
- Hands-on experience with Infrastructure as Code, preferably Terraform.
- Experience with managing a data orchestration platform such as Airflow or Prefect
- Build complex, high-volume batch and near-real-time ingestion services while helping evolve the platform’s streaming capabilities.
- Design and implement data solutions for all application requirements in a distributed microservices environment
- Develop and optimize large-scale data pipelines for batch and streaming use cases.
- Ensure data quality, compliance, and governance.
- Manage and optimize Kubernetes infrastructure, utilizing KEDA to dynamically scale resources for large-scale data processing workloads.
- Own the full lifecycle of our data stack using Terraform and Kubernetes, from provisioning to application-level frameworks.
- Provide technical guidance for the team, drive best practices around infrastructure, CI/CD, testing, and system design.
- Deep-dive into memory management and performance tuning to ensure our large-scale distributed systems are both cost-effective and lightning-fast.
- Comfortable environment, challenging tasks and a long-term interesting project;
- Mobilization reservation available upon successful completion of the probation period (for Ukrainian colleagues).
- Covered 20 days of vacation;
- Working with top notch equipment;
- Bookkeeping by a professional accountant;
- Help and support from our caring HR-team;
Similar Jobs
Blockchain • Fintech • Payments • Financial Services • Cryptocurrency • Web3 • Infrastructure as a Service (IaaS)
Build and own Finance data models covering ledgers, settlements, transactions, invoicing, fees, and collateral. Reconcile internal and external systems, investigate discrepancies, support month-end close and audits, automate reporting, implement data quality tests, define reusable financial metrics, and create self-service reporting. Partner with Finance, Accounting, data, and platform engineering teams to maintain trusted, documented data systems.
Top Skills:
AirflowBigQueryDagsterDatastreamDbtFivetranLightdashLookerMeltanoOmniPythonRedshiftSnowflakeSQL
Blockchain • Fintech • Payments • Financial Services • Cryptocurrency • Web3 • Infrastructure as a Service (IaaS)
Build and maintain scalable batch and streaming data pipelines for payments, ledger, transaction, and blockchain data. Own ingestion from databases, files, APIs, and onchain sources; develop incremental dbt models; orchestrate workflows in Dagster; and implement data quality, freshness, reconciliation, monitoring, deduplication, and late-data handling. Partner with engineering, analytics, data science, and risk teams to support reliable reporting and machine-learning features.
Top Skills:
AirbyteAirflowApache BeamBigQueryCdcClickhouseDagsterDataflowDatastreamDbtDebeziumEvmFivetranFlinkGCPGcsKafkaMeltanoPub/SubPythonRustSftpSnowflakeSolanaSQL
Blockchain • Fintech • Payments • Financial Services • Cryptocurrency • Web3 • Infrastructure as a Service (IaaS)
Build and operate Rain’s scalable batch and streaming data platform, including BigQuery, streaming infrastructure, orchestration, BI, ML capabilities, governance, access controls, and infrastructure as code. Ensure reliable, secure, compliant, and cost-efficient data processing through monitoring, schema management, lineage, CI/CD, incident response, and automation. Support fraud and risk models with feature pipelines and advise engineering teams on event and CDC design.
Top Skills:
AirflowAWSAzureBigQueryCi/CdClickhouseDagsterDataflowDatastreamDebeziumFlinkGCPIamKafkaLightdashPub/SubPythonSnowflakeSQLTerraformVertex Ai
What you need to know about the Charlotte Tech Scene
Ranked among the hottest tech cities in 2024 by CompTIA, Charlotte is quickly cementing its place as a major U.S. tech hub. Home to more than 90,000 tech workers, the city’s ecosystem is primed for continued growth, fueled by billions in annual funding from heavyweights like Microsoft and RevTech Labs, which has created thousands of fintech jobs and made the city a go-to for tech pros looking for their next big opportunity.
Key Facts About Charlotte Tech
- Number of Tech Workers: 90,859; 6.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Lowe’s, Bank of America, TIAA, Microsoft, Honeywell
- Key Industries: Fintech, artificial intelligence, cybersecurity, cloud computing, e-commerce
- Funding Landscape: $3.1 billion in venture capital funding in 2024 (CED)
- Notable Investors: Microsoft, Google, Falfurrias Management Partners, RevTech Labs Foundation
- Research Centers and Universities: University of North Carolina at Charlotte, Northeastern University, North Carolina Research Campus

