Senior Software Engineer

Senior Software Engineer

Overview

Microsoft Digital (MSD) builds and manages the critical products and services that Microsoft runs on. We boldly pursue big ideas that power transformational advances at Microsoft and for our customers, while helping Microsoft teams work smarter, faster, and more securely every day. Microsoft Digital employees have deep technical and business expertise, customer insights, and a clear point of view that comes from first-hand, large-scale experience with Microsoft and industry solutions. We are engineers, technology leaders and experts, digital transformation change agents, and customer advocates.

We have exciting opportunities for you to innovate, influence, transform, inspire, and grow within our organization and we encourage you to apply to learn more!

Build the trusted data foundation that helps Microsoft’s Field and Support organizations operate at scale.

As a Data Engineer, you will build, operate, and evolve the data platform that transforms large volumes of operational and business data into trusted, discoverable, and actionable data products. These products serve support engineers, product managers, finance partners, customer experience teams, IT managers, and service-delivery leaders across Microsoft.

The current platform supports hundreds of Power BI reports and thousands of measures across support domains such as incidents, support tickets, chats etc You will help modernize this environment and establishing curated lake house and semantic-model foundations that can support reporting, analytics, automation, and natural-language data experiences.

You will contribute across the full data lifecycle, including ingestion, transformation, modelling, orchestration, metadata management, monitoring, governance, and operational support. Working with Microsoft Fabric, Spark, Power BI, and Azure data services, you will deliver reliable and efficient data products while improving platform performance, resiliency, maintainability, and cost efficiency.

This is a data engineering position. You will prepare secure, well-described, and high-quality data for downstream applications, including AI-assisted and natural-language analytics experiences. You will collaborate with the teams building those applications, but you will not be responsible for developing AI agents or data science and machine learning models.

This opportunity will allow you to deepen your expertise in modern data engineering, work with Microsoft’s latest data technologies, and collaborate directly with engineering and business leaders to influence how data is used across one of the world’s largest enterprise environments. This role offers flexibility through Microsoft’s hybrid work model.

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.
#MSD 
#MSDJOBS 

Responsibilities

In this role, you will:

• Design, develop, and maintain scalable data pipelines, transformations, and models that convert complex operational and business data into trusted datasets.
• Build and operate data solutions using Microsoft Fabric, OneLake, Fabric Lakehouse and Warehouse, Spark, Power BI semantic models, and Azure data services.
• Ingest and curate data across support and field-service domains, including incidents, tickets, chats, problem management, quality analytics, user and inventory information, and customer survey data.
• Design dimensional models and reusable semantic models with consistent definitions, relationships, hierarchies, and business logic.
• Establish data products that support reporting, analytics, operational insights, automation, and downstream natural-language data experiences.
• Create scalable processes for onboarding new data fields without requiring extensive downstream report and measure changes.
• Implement automated data-quality controls for completeness, accuracy, freshness, schema changes, referential integrity, and business-rule validation.
• Develop and improve metadata-management capabilities, including technical descriptions, business definitions, data lineage, ownership, and discoverability.
• Partner with business stakeholders, product managers, program managers, engineers, and data consumers to translate requirements into scalable technical solutions.
• Define stable, secure, and well-documented data contracts for BI, analytics, automation, and downstream application teams.
• Implement security and governance controls, including role-based access, data privacy, retention, auditing, and appropriate access to sensitive information.
• Improve platform performance, processing efficiency, refresh latency, resiliency, maintainability, and Microsoft Fabric capacity utilization.
• Contribute to deployment automation, CI/CD pipelines, source-control practices, testing frameworks, and operational tooling.
• Support live-site operations by investigating data issues, responding to incidents, implementing corrective actions, and reducing recurring failures.
• Build monitoring and observability for pipelines, lakehouses, semantic models, refreshes, data quality, and service-level objectives.
• Analyze report, measure, and column usage to identify redundant or underused assets and support report-portfolio rationalization.
• Collaborate across teams to share goodpractices, improve engineering standards, evaluate emerging technologies, and drive adoption of modern data engineering capabilities.

Qualifications

Required Qualifications:

• SQL/Advanced SQL, Python, PySpark, ETL/ELT, Data Modeling, Data Transformation, Incremental Processing, Error Handling, Scalability, Edge Cases, Performance Optimization.
• Microsoft Fabric, OneLake, Lakehouse, Warehouse, Delta Tables, Batch & Streaming Pipelines, Spark Optimization, Security, Row-Level Security (RLS), Data Governance.
• LLM Fundamentals, Tool/Function Calling, RAG, SQL Grounding, Agent Orchestration, SDK/API Design, Evaluation Frameworks, Guardrails, Responsible AI.
  
  • OR equivalent experience.
• 4+ years experince in following:
  • Experience designing, developing, or operating production data pipelines and ETL/ELT processes.
  • Experience implementing CI/CD and automated deployment processes for cloud data platforms.
  • Proficiency in SQL and at least one data engineering language or framework, such as Python, PySpark, Spark, or Scala.
  • Understanding of data warehousing, dimensional modeling, and analytical data-consumption patterns.
  • Experience implementing data validation, testing, monitoring, and operational support for production data solutions.
  • Experience translating business requirements into scalable technical designs and data products.
  • Demonstrated ability to collaborate with engineering teams, product or program managers, business stakeholders, and data consumers.
  • Experience building enterprise data solutions with Microsoft Fabric, including OneLake, Lakehouse, Warehouse, notebooks, pipelines, Dataflows Gen2, or Direct Lake.
  • Knowledge of enterprise security and governance practices, including role-based access control, row-level security, privacy, auditing, and retention.
  • Knowledge of Microsoft Fabric capacity management, performance tuning, and cloud cost optimization.

Preferred Qualifications:

• Familiarity with preparing curated, documented data for downstream natural-language analytics or AI-assisted applications.
• Experience developing and maintaining Power BI semantic models, including DAX, shared business definitions, and model optimization.
• Knowledge of Delta Lake, medallion architecture, schema evolution, and reusable data-product or data-contract patterns.
• Familiarity with Microsoft Purview or comparable metadata catalog, lineage, and governance capabilities.
• Experience supporting business-critical data platforms through live-site incident response, root-cause analysis, and resiliency improvements.
• Experience modernizing or rationalizing a large reporting and analytics estate.
• Familiarity with enterprise support, customer experience, service management, finance, or field-service data.

This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.

Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.

Experience Level

Senior Level