Principal Software Engineer - CoreAI
$143k - $275k • United States, Washington, Redmond • Full-time
Posted 1mo ago
About the job
The Core AI organization at Microsoft builds the end-to-end Azure AI stack/PaaS, which is central to Azure's innovation. Within Core AI, the Azure AI Knowledge team powers rich search experiences for applications and serves as a knowledge service for LLMs, integrating Microsoft AI for content understanding and search relevance. This role focuses on developing cutting-edge retrieval systems through Azure AI Search, a critical component for Copilot-style applications that blend large language models with external data. The position offers a unique opportunity to lead the development of pivotal features for an Azure service at the forefront of AI innovation, operating at the intersection of AI, Information Retrieval, and Cloud Services.
Responsibilities
- Lead the architecture, design, implementation, and delivery of large-scale cloud services and AI-powered products.
- Author design proposals, drive engineering execution, and ensure quality through comprehensive testing, automation, and security compliance.
- Partner with stakeholders, customers, and cross-functional teams to understand requirements and define success metrics.
- Design and build secure, permission-aware retrieval and knowledge systems integrated with enterprise identity and authorization platforms.
- Drive service scalability, reliability, performance, and operational excellence across globally distributed cloud infrastructure.
- Establish telemetry, monitoring, and diagnostics to proactively identify and resolve issues.
- Mentor and grow engineers through technical leadership, code reviews, and engineering best practices.
- Lead project planning, experimentation, and deployment strategies, evaluating technical tradeoffs and optimizing solutions.
- Own live-site operations, incident response, and root cause analysis, developing operational playbooks.
- Collaborate with product managers, applied scientists, architects, and partner teams to deliver AI experiences and platform capabilities.
- Analyze production telemetry, customer feedback, and usage patterns to identify improvement opportunities.
- Contribute to the architecture and evolution of foundational services powering AI agents and next-generation retrieval platforms.
- Champion engineering excellence through automation and continuous process improvement, ensuring compliance with security and privacy requirements.
- Drive cross-team collaboration to resolve dependencies and align technical strategy for integrated solutions.
Requirements
- Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including C, C++, C#, Java, JavaScript, or Python, OR equivalent experience.
- Ability to meet Microsoft, customer and/or government security screening requirements.
- Experience designing and building large-scale distributed systems in a cloud environment.
- Strong software engineering skills in C#, Java, C++, Rust, or a comparable language.
- Experience developing highly available services with a focus on reliability, performance, and maintainability.
- Knowledge of cloud-native architectures, storage systems, networking, and service operations.
- Excellent problem-solving, collaboration, and communication skills.
- Experience with search technologies, information retrieval, ranking systems, vector databases, or recommendation systems.
- Experience with AI/ML systems, LLMs, retrieval systems.
