Dynatrace Logo

Dynatrace

Sr Data Engineer

Posted One Month Ago
Remote or Hybrid
Hiring Remotely in Bangalore, Bengaluru Urban, Karnataka
Senior level
Remote or Hybrid
Hiring Remotely in Bangalore, Bengaluru Urban, Karnataka
Senior level
Designs and optimizes scalable data ingestion pipelines for product telemetry and enterprise business data. Builds automated pipelines using Fivetran, Python, APIs, S3 lakehouse architectures, Kafka, Spark, and Snowflake. Applies advanced SQL, incremental loading, CDC, micro-batching, and rate-limit handling to support reliable, analytics-ready datasets. Implements CI/CD and DevOps practices, monitors pipeline performance, and partners with analysts and platform teams to rapidly deliver data solutions.
The summary above was generated by AI
Your role at Dynatrace

We are seeking an experienced Data Engineer to design, build, and optimize scalable data ingestion pipelines for product telemetry and enterprise business applications data. This role operates in a fast‑paced environment, rapidly prototyping data pipelines to enable data exploration, analytics, and downstream consumption.

Responsibilities

  • Design and implement modern data ingestion pipelines for business systems data using Fivetran, Python and Bulk APIs, S3-based lakehouse architectures, and streaming ingestion (Kafka, Spark)
  • Build end-to-end automated pipelines from source systems to Snowflake, ensuring reliability, scalability, and observability
  • Apply advanced SQL in Snowflake for transformation, standardization, and preparation of analytics-ready datasets
  • Optimize ingestion performance for large-scale, high-volume datasets using API rate-limit handling, micro-batching, and incremental loading / CDC
  • Implement DevOps and CI/CD practices for data pipelines, including version control and deployment automation
  • Partner with analysts, SMEs, and platform teams to rapidly prototype pipelines supporting exploration and evolving requirements
  • Monitor, troubleshoot, and optimize ingestion jobs to ensure data freshness, accuracy, and performance
What will help you succeed

  • 6+ years of hands-on experience in data engineering and ingestion automation in cloud or hybrid environments
  • Proven experience ingesting business application data (CRM, ERP, financial, consumption, renewals systems)
  • Advanced proficiency with Python and Fivetran (or similar ETL/ELT tool) for pipelines, automation, orchestration, and validation
  • Expertise with Kafka, Spark, and S3 / lakehouse-style storage architectures
  • Strong proficiency with Snowflake, ingestion, transformation, and performance optimization
  • Deep understanding of ingestion optimization, rate limits, micro-batching, incremental loads, and CDC
  • Experience applying DevOps / CI/CD practices to data pipelines
  • Ability to work independently and deliver solutions rapidly in a fast-paced, iterative environment

Desirable:

  • Experience with additional open-source ingestion frameworks and connectors
  • Exposure to event-driven or telemetry-heavy architectures at scale
Why you will love being a Dynatracer
  • Dynatrace is a leader in unified observability and security.
  • We provide a culture of excellence with competitive compensation packages designed to recognize and reward performance.
  • Our employees work with the largest cloud providers, including AWS, Microsoft, and Google Cloud, and other leading partners worldwide to create strategic alliances.
  • You'll get to work at the forefront of innovation with Dynatrace Intelligence, the industry's first agentic operations system. Bringing together deterministic and agentic AI, it helps teams understand what's happening, why it matters, and what to do next, automatically.
  • Over 50% of the Fortune 100 companies are current customers of Dynatrace

Similar Jobs at Dynatrace

Yesterday
Remote or Hybrid
Senior level
Senior level
Artificial Intelligence • Big Data • Cloud • Information Technology • Software • Big Data Analytics • Automation
Partners with India sales leadership to improve forecasting, pipeline health, revenue analytics, territory planning, productivity, and operational execution. The role analyzes sales performance, identifies risks and opportunities, drives process and data quality improvements, manages Salesforce reporting and workflows, and delivers executive-ready recommendations. It also supports business reviews, sales system adoption, cross-functional initiatives, and the application of business intelligence, generative AI, and automation to improve operations.
Top Skills: Automation TechnologiesAWSBusiness IntelligenceGenerative AiGCPAzureExcelSalesforce
11 Days Ago
Remote or Hybrid
Senior level
Senior level
Artificial Intelligence • Big Data • Cloud • Information Technology • Software • Big Data Analytics • Automation
Designs and deploys production AI assistants, copilots, agents, RAG systems, and intelligent automations. Integrates LLMs with Snowflake, AWS, enterprise applications, and workflow platforms to automate business processes. Builds backend services and serverless workflows, implements observability and responsible AI controls, and scales validated prototypes into reliable production solutions. Partners with technical and business teams to improve decision-making, efficiency, quality, and cost performance.
Top Skills: AirflowAmazon Api GatewayAmazon BedrockAmazon EventbridgeAmazon S3Amazon SagemakerAnthropicAws LambdaAws Step FunctionsAzure OpenaiDbtGeminiGoMcpMicrosoft Power AutomateMlflowN8NOauthOpenaiPythonRbacSalesforceServicenowSnowflakeSnowflake Cortex SearchSnowflake Ml RegistrySnowparkSsoTypescriptUipathWeights & BiasesWorkato
18 Days Ago
Remote or Hybrid
Entry level
Entry level
Artificial Intelligence • Big Data • Cloud • Information Technology • Software • Big Data Analytics • Automation
Manages APAC payroll operations through an outsourced CloudPay model, ensuring accurate, timely, and compliant employee payments. Oversees payroll processing, reconciliations, statutory reporting, controls, vendor relationships, KPIs, SLAs, and payroll sign-off. Leads and develops the payroll team, coordinates projects, resolves issues, supports continuous improvement, and partners with P&C, Finance, HRIS, senior leadership, and external providers.
Top Skills: CloudpayExcelSfec HcmSox Compliance

What you need to know about the Charlotte Tech Scene

Ranked among the hottest tech cities in 2024 by CompTIA, Charlotte is quickly cementing its place as a major U.S. tech hub. Home to more than 90,000 tech workers, the city’s ecosystem is primed for continued growth, fueled by billions in annual funding from heavyweights like Microsoft and RevTech Labs, which has created thousands of fintech jobs and made the city a go-to for tech pros looking for their next big opportunity.

Key Facts About Charlotte Tech

  • Number of Tech Workers: 90,859; 6.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Lowe’s, Bank of America, TIAA, Microsoft, Honeywell
  • Key Industries: Fintech, artificial intelligence, cybersecurity, cloud computing, e-commerce
  • Funding Landscape: $3.1 billion in venture capital funding in 2024 (CED)
  • Notable Investors: Microsoft, Google, Falfurrias Management Partners, RevTech Labs Foundation
  • Research Centers and Universities: University of North Carolina at Charlotte, Northeastern University, North Carolina Research Campus

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account