Microsoft Logo

Microsoft

Principal Data Engineer

Reposted 2 Days Ago
Remote
Hiring Remotely in United States
143K-304K Annually
Senior level
Remote
Hiring Remotely in United States
143K-304K Annually
Senior level
Lead design and delivery of cloud-native, AI-powered data platforms, copilots, and enterprise-scale services. Architect LLM/RAG/agentic solutions, build AI-ready data foundations, create reusable frameworks/SDKs, establish Responsible AI and governance practices, and provide hands-on technical leadership and cross-team partnership to drive AI adoption and scale.
The summary above was generated by AI
Overview

MCAPS-Core accelerates customer outcomes and business growth. By uniting product, engineering, marketing, sales, customer success, and partners around a common customer mission, we help customers realize value faster and turn innovation into measurable business impact. Through deep technical expertise and differentiated go-to-market execution, we win competitively, capture market share, and scale repeatable growth motions. We differentiate through value creation - delivering world-class, AI-powered customer experiences that accelerate adoption, strengthen loyalty, and create sustainable competitive advantage, driving growth that outpaces the market.


MCAPS-Core Data & Applied AI (DAAI) is a centralized data and AI organization driving Microsoft's transformation through enterprise data platforms, advanced analytics, AI-powered solutions, automation, and governance. Our mission is to turn data into intelligence and intelligence into action, empowering teams across Microsoft to accelerate decision-making, increase productivity, and deliver exceptional customer outcomes through innovative customer-zero solutions.


MCAPS-Core DAAI is seeking a Principal Data Engineer to build the AI-powered platforms, intelligent agents, and data foundations that fuel Microsoft's transformation. This role combines deep software engineering, data engineering, and AI expertise to deliver scalable solutions powered by generative AI, LLMs, agentic workflows, and enterprise data platforms. The ideal candidate is a hands-on technical leader who thrives on solving complex engineering challenges and building intelligent systems that translate data into actionable business impact.


Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.


Responsibilities
  • Lead end-to-end development of cloud-native applications, APIs, and platform services, applying full-stack engineering principles across frontend, backend, integration, security, observability, testing, and continuous delivery disciplines.
  • Architect and deliver next-generation AI platforms, copilots, agentic systems, and intelligent applications powered by Generative AI, Large Language Models (LLMs), and advanced reasoning capabilities.
  • Design and build AI-ready data platforms and knowledge systems, scalable AI services, APIs, and orchestration frameworks that power autonomous agents, intelligent automation, and enterprise-scale workflows.
  • Drive the technical strategy and architecture for Applied AI solutions, partnering across engineering, data science, product, and business teams to accelerate AI innovation and adoption.
  • Create reusable AI frameworks, SDKs, and platform services that improve developer productivity, model performance, scalability, governance, and reliability.
  • Establish best practices for Responsible AI, AI governance, model evaluation, security, compliance, observability, and operational excellence.
  • Provide hands-on technical leadership through architecture reviews, code reviews, mentoring, and direct contribution to software, data, and AI solutions.
  • Partner with business and technology leaders to identify and deliver transformational AI opportunities that enhance productivity, decision-making, and customer experiences.
  • Champion customer-zero innovation by turning emerging AI technologies into scalable platforms, reusable services, and enterprise-wide solutions.

Qualifications
Required/minimum qualifications
  • Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 4+ years experience in business analytics, data science, software development, data modeling, or data engineering
    • OR Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 6+ years experience in business analytics, data science, software development, data modeling, or data engineering
    • OR equivalent experience.
  • 5+ years of demonstrated experience working in data-intensive Azure environments and translating business requirements into scalable data and AI solutions. Deep expertise with Microsoft technologies, including Microsoft Fabric, Azure AI Foundry, Azure Data Platform, Synapse Analytics, Azure App Service.
  • Hands-on experience developing solutions using Python and/or other modern programming languages such as C#, Java, Scala, or equivalent.
  • Proven experience designing and implementing Generative AI, Large Language Model (LLM), Retrieval-Augmented Generation (RAG), semantic search, vector database, and agentic AI solutions.

Additional or preferred qualifications
  • Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 8+ years experience in business analytics, data science, software development, data modeling, or data engineering
    • OR Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 12+ years experience in business analytics, data science, software development, data modeling, or data engineering
    • OR equivalent experience.
  • Experience building and deploying Copilots, intelligent agents, multi-agent systems, and enterprise AI applications.
  • Expertise in AI platform engineering, LLM orchestration, knowledge graphs, prompt engineering, model tuning, and AI evaluation frameworks.
  • Expertise in developing and operating cloud-scale services using modern software engineering and SRE practices, with a focus on reliability, observability, automation, and service excellence.
  • Experience with MLOps, LLMOps, AI observability, model governance, and production AI operations.
  • Proven success leading enterprise-scale cloud, data, analytics, and AI transformation initiatives.
  • Demonstrated ability to mentor engineers, foster innovation, and elevate engineering excellence across large, complex organizations.
  • Strong technical leadership skills with a track record of driving architecture decisions, engineering strategy, and cross-functional execution.

Ability to meet Microsoft, customer and / or government security screening requirements are required for this role.  These requirements include, but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud Background Check upon hire / transfer and every two years thereafter.


Data Engineering IC5 - The typical base pay range for this role across the U.S. is USD $142,800 - $274,800 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $188,000 - $304,200 per year.

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:
https://careers.microsoft.com/us/en/us-corporate-pay


This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.



Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.

Similar Jobs

15 Days Ago
Remote or Hybrid
United States
160K-260K Annually
Expert/Leader
160K-260K Annually
Expert/Leader
Artificial Intelligence • Cloud • Payments • Software • Business Intelligence • Generative AI • Automation
Define and govern enterprise-scale data architecture across batch, streaming, warehouse, lakehouse, transactional, and AI use cases. Establish standards for data quality, lineage, access, cataloging, governance, observability, and SLAs. Architect AI-enabled workflows, resolve complex architecture issues, influence roadmaps, and mentor engineers through hands-on technical leadership. The role requires 15+ years of software, data engineering, or architecture experience and expertise in large-scale data platforms and modeling.
Top Skills: AIBatch ProcessingBigQueryData CatalogsData WarehousesDbtFeature StoresGCPLakehousesOlapOltpStreaming ArchitecturesVector Stores
25 Days Ago
Easy Apply
Remote or Hybrid
United States
Easy Apply
Senior level
Senior level
Fintech • News + Entertainment • Software • Database • Financial Services
Lead the architecture and development of scalable AWS-based data ingestion, transformation, and orchestration pipelines. Build reliable data infrastructure using Python, SQL, Airflow, Lambda, ECS, SQS, and Terraform. Establish data modeling, quality, lineage, monitoring, testing, and observability practices while partnering with analysts, scientists, and backend engineers. Mentor senior engineers, guide technical decisions, and provide hands-on leadership for complex data platform initiatives.
Top Skills: Amazon EcsAmazon KinesisAmazon RedshiftAmazon S3Amazon SqsApache AirflowApache FlinkAWSAws GlueAws LambdaBeautifulsoupCi/CdDatabricksDockerGreat ExpectationsKafkaMonte CarloMwaaPythonScrapySnowflakeSQLTerraform
Yesterday
Remote
United States
100K-287K Annually
Expert/Leader
100K-287K Annually
Expert/Leader
eCommerce • Software
Principal Software Engineer responsible for setting engineering standards across Shippo’s data organization. Designs and builds interfaces between application services, ML systems, and data platforms; develops scalable, secure, observable production systems; guides technical architecture through RFCs and design reviews; productionizes analytical and prototype work; advises on ML workflows and agentic AI; and mentors engineers while driving cross-team technical direction.
Top Skills: APIsArtificial IntelligenceContainerizationDatabricksDistributed SystemsKubernetesMachine Learning

What you need to know about the Charlotte Tech Scene

Ranked among the hottest tech cities in 2024 by CompTIA, Charlotte is quickly cementing its place as a major U.S. tech hub. Home to more than 90,000 tech workers, the city’s ecosystem is primed for continued growth, fueled by billions in annual funding from heavyweights like Microsoft and RevTech Labs, which has created thousands of fintech jobs and made the city a go-to for tech pros looking for their next big opportunity.

Key Facts About Charlotte Tech

  • Number of Tech Workers: 90,859; 6.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Lowe’s, Bank of America, TIAA, Microsoft, Honeywell
  • Key Industries: Fintech, artificial intelligence, cybersecurity, cloud computing, e-commerce
  • Funding Landscape: $3.1 billion in venture capital funding in 2024 (CED)
  • Notable Investors: Microsoft, Google, Falfurrias Management Partners, RevTech Labs Foundation
  • Research Centers and Universities: University of North Carolina at Charlotte, Northeastern University, North Carolina Research Campus

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account