About this role
<b>Overview</b><br><p><span style="font-size: 10pt; font-family: arial, helvetica, sans-serif;">Security represents the most critical priorities for our customers in a world awash in digital threats, regulatory scrutiny, and estate complexity. Microsoft Security aspires to make the world a safer place for all. We want to reshape security and empower every user, customer, and developer with a security cloud that protects them with end to end, simplified solutions. The Microsoft Security organization accelerates Microsoft’s mission and bold ambitions to ensure that our company and industry is securing digital technology platforms, devices, and clouds in our customers’ heterogeneous environments, as well as ensuring the security of our own internal estate. Our culture is centered on embracing a growth mindset, a theme of inspiring excellence, and encouraging teams and leaders to bring their best each day. In doing so, we create life-changing innovations that impact billions of lives around the world. The Microsoft Purview Agents Platform team comprises of talented engineers dedicated to developing innovative software Agents using cutting-edge technologies such as Generative Pre-trained Transformers (GPTs), Large Language Models (LLM), and Artificial Intelligence (AI). Our mission is to empower customers to harness the power of AI and GPTs to meet their digital data security and compliance needs, more efficiently. As a large-scale cloud service, we leverage state-of-the-art Azure technology to deliver robust, reliable, and scalable solutions. Our team collaborates closely, employing innovative technologies and methodologies to streamline workflows and enhance productivity. We prioritize quality, security, and privacy, ensuring that every feature meets the highest standards. We look forward to leading the transformation in how organizations safeguard and manage their data. Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.</span></p><br><br><b>Responsibilities</b><br><div><span style="font-size: 10pt; font-family: arial, helvetica, sans-serif;">We are seeking a hands-on Data & AI Automation Engineer II to build and operate shared data, automation, and AI capabilities for the Msec Unified data platform. You will develop reliable data pipelines, automate operational workflows, integrate copilots and intelligent agents, and create reusable services that make governed Platform data easier to discover and use .</span></div><div><strong><span style="font-size: 10pt; font-family: arial, helvetica, sans-serif; color: black;">Key Responsibilities</span></strong></div><div><strong><span style="font-size: 10pt; font-family: arial, helvetica, sans-serif;">Data and Platform Engineering</span></strong></div><div><span style="font-size: 10pt; font-family: arial, helvetica, sans-serif;">• Design and operate batch and near-real-time pipelines using Azure data services, Fabric ,Kusto, SQL, Python, and APIs.</span></div><div><span style="font-size: 10pt; font-family: arial, helvetica, sans-serif;">• Build governed ingestion, transformation, allocation, and serving layers for cost, spend, utilization, efficiency, customer, and operational data.</span></div><div><span style="font-size: 10pt; font-family: arial, helvetica, sans-serif;">• build intelligent systems for data quality, schema validation, lineage, reconciliation, metadata, freshness monitoring, and performance optimization.</span></div><div><span style="font-size: 10pt; font-family: arial, helvetica, sans-serif;">• Create reusable data products, semantic models, APIs, and self-service interfaces with clear definitions and ownership.</span></div><div><span style="font-size: 10pt; font-family: arial, helvetica, sans-serif;">• Redesign existing workflows into AI native /Integrated workflow</span></div><div><strong><span style="font-size: 10pt; font-family: arial, helvetica, sans-serif;">Automation and Software Development</span></strong></div><div><span style="font-size: 10pt; font-family: arial, helvetica, sans-serif;">• Develop Python services, APIs, command-line tools, scheduled jobs, and event-driven workflows.</span></div><div><span style="font-size: 10pt; font-family: arial, helvetica, sans-serif;">• Automate pipeline monitoring, data validation, failure investigation, reporting, notifications, and approved recovery actions.</span></div><div><span style="font-size: 10pt; font-family: arial, helvetica, sans-serif;">• Replace spreadsheet-dependent and repetitive operational processes with governed automation.</span></div><div><span style="font-size: 10pt; font-family: arial, helvetica, sans-serif;">• Apply and automate source control, testing, code reviews, CI/CD, secure configuration, documentation, and production-readiness practices.</span></div><div><strong><span style="font-size: 10pt; font-family: arial, helvetica, sans-serif;">AI, Copilot, and Agent Integration</span></strong></div><div><span style="font-size: 10pt; font-family: arial, helvetica, sans-serif;">• Build copilots and agents grounded in governed Platform data and connected to Kusto, APIs, knowledge sources, and operational systems. Enabling near real time support to platform users and responses on bugs .</span></div><div><span style="font-size: 10pt; font-family: arial, helvetica, sans-serif;">• Develop retrieval, prompt orchestration, agent tools, MCP integrations, reusable AI services, and evaluation frameworks.</span></div><div><span style="font-size: 10pt; font-family: arial, helvetica, sans-serif;">• Enable AI-assisted failure analysis &amp; action for Data orchestrations layer</span></div><div><span style="font-size: 10pt; font-family: arial, helvetica, sans-serif;">• Ensure AI solutions are secure, observable, evaluated, cost-conscious, and compliant with data and responsible-AI requirements.</span></div><div><strong><span style="font-size: 10pt; font-family: arial, helvetica, sans-serif;">Reliability and Operational Excellence</span></strong></div><div><span style="font-size: 10pt; font-family: arial, helvetica, sans-serif;">• Implement telemetry, health dashboards, alerts, data-freshness controls, anomaly detection, and automated status reporting.</span></div><div><span style="font-size: 10pt; font-family: arial, helvetica, sans-serif;">• Investigate incidents, missing or stale data, schema changes, performance issues, and pipeline failures; drive root-cause remediation.</span></div><div><span style="font-size: 10pt; font-family: arial, helvetica, sans-serif;">• Improve platform availability, scalability, supportability, and cost efficiency while reducing manual operational effort.</span></div><div><strong><span style="font-size: 10pt; font-family: arial, helvetica, sans-serif;">Partnership and Ownership</span></strong></div><div><span style="font-size: 10pt; font-family: arial, helvetica, sans-serif;">• Translate business and operational needs into scalable technical designs and independently deliver medium-complexity solutions.</span></div><div><span style="font-size: 10pt; font-family: arial, helvetica, sans-serif;">• Communicate architecture decisions, trade-offs, risks, and recommendations to technical and non-technical stakeholders.</span></div><div><span style="font-size: 10pt; font-family: arial, helvetica, sans-serif;">• Coordinate with platform and source-system owners, validate requirements, and promote shared components over one-off implementations.</span></div><div><span style="font-size: 10pt; font-family: arial, helvetica, sans-serif;">• High level of accountability and responsiveness for the assigned work item</span></div><br><br><b>Qualifications</b><br><div><div>• <span style="font-size: 10pt; font-family: arial, helvetica, sans-serif;">Bachelor's degree in Computer Science, Engineering, Data Science, Information Systems, or equivalent practical experience.</span></div><div><span style="font-size: 10pt; font-family: arial, helvetica, sans-serif;">• Approximately 3–6 years of experience in data, software, AI, or automation engineering.</span></div><div><span style="font-size: 10pt; font-family: arial, helvetica, sans-serif;">• Strong Python and SQL skills with experience building production data pipelines or cloud-based processing systems.</span></div><div><span style="font-size: 10pt; font-family: arial, helvetica, sans-serif;">• Experience integrating systems through APIs or SDKs and applying testing, source control, CI/CD, and deployment practices.</span></div><div><span style="font-size: 10pt; font-family: arial, helvetica, sans-serif;">• Understanding of data modeling, quality, lineage, monitoring, security, and operational support.</span></div><div><span style="font-size: 10pt; font-family: arial, helvetica, sans-serif;">• Strong analytical, problem-solving, collaboration, and communication skills.</span></div><strong><span style="font-size: 10pt; font-family: arial, helvetica, sans-serif;">Preferred Qualifications</span></strong></div><div><span style="font-size: 10pt; font-family: arial, helvetica, sans-serif;">• Experience with Azure Synapse, Kusto/ADX and KQL, Microsoft Fabric, Azure Data Lake Storage, Databricks, or Spark.</span></div><div><span style="font-size: 10pt; font-family: arial, helvetica, sans-serif;">• Experience building GenAI applications, copilots, agents, RAG solutions, or Model Context Protocol integrations.</span></div><div><span style="font-size: 10pt; font-family: arial, helvetica, sans-serif;">• Familiarity with Azure OpenAI, Microsoft Foundry, agent frameworks, embeddings, vector or hybrid search, and AI evaluation.</span></div><div><span style="font-size: 10pt; font-family: arial, helvetica, sans-serif;">• Experience with FastAPI, Azure DevOps, Teams integrations, telemetry, incident management, and workflow automation.</span></div><div><span style="font-size: 10pt; font-family: arial, helvetica, sans-serif;">• Knowledge of managed identity, RBAC, secret management, data governance, privacy, compliance, and responsible AI.</span></div><div><strong><span style="font-size: 10pt; font-family: arial, helvetica, sans-serif;">Success Expectations</span></strong></div><div><span style="font-size: 10pt; font-family: arial, helvetica, sans-serif;">• Independently owns features, automation workflows, services, or data domains from design through production.</span></div><div><span style="font-size: 10pt; font-family: arial, helvetica, sans-serif;">• Produces secure, maintainable, tested, observable, and scalable solutions with minimal supervision.</span></div><div><span style="font-size: 10pt; font-family: arial, helvetica, sans-serif;">• Identifies risks and dependencies early, delivers predictably, and resolves root causes rather than symptoms.</span></div><div><span style="font-size: 10pt; font-family: arial, helvetica, sans-serif;">• Builds reusable capabilities, measures automation value, and checks for existing solutions before creating new ones.</span></div><div><span style="font-size: 10pt; font-family: arial, helvetica, sans-serif;">• Connects data, AI, governance, infrastructure, and operations to deliver measurable business value.</span></div><div><span style="font-size: 10pt; font-family: arial, helvetica, sans-serif;">• Collaborates effectively and communicates clearly with engineering, product, and business stakeholders.</span></div> <br><p>This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.</p><br><hr><br><p>Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about <a href="https://careers.microsoft.com/v2/global/en/accessibility.html"><b><u>requesting accommodations.</u></b></a></p>