Software Engineer 2 - CoreAI
$102k - $202k • United States, Washington, Redmond • Full-time
Posted 10d ago
Job Location
United States, Washington, Redmond
Tech Stack
Remote Work Policy
On-site
Employment Type
Full-time
Categories
AI Engineer
About the job
The AI Gateway Team is seeking a Software Engineer 2 to join their growing team, focusing on managing the full API lifecycle for AI Tools. This platform supports thousands of developers globally in building and managing various application types, including Agentic, Web, Mobile, Event-Driven, and IoT. It also powers key Microsoft services, enabling rich developer and consumer experiences. The role presents challenging engineering opportunities in scalability, high-density, multi-tenancy, high availability, user experience, and developer tools, especially with the rise of generative AI. You will help shape the future of AI developer and application workloads.
Responsibilities
- Lead system design and architecture discussions, author design documents, and ensure systems meet security, compliance, and scalability requirements.
- Write extensible, maintainable, and performant code, debug and optimize complex systems, and uphold engineering standards through rigorous code reviews.
- Lead project planning and experimentation, validate the impact of changes, and ensure safe, reliable deployments across distributed environments.
- Maintain live site health, develop incident response playbooks, lead root cause analyses, and implement systemic improvements.
- Identify and build developer tools, apply automation in production workflows, and stay current with emerging technologies.
- Influence the product roadmap by aligning technical direction with business goals, leveraging customer feedback, data insights, and competitive analysis.
- Collaborate with partner teams to deliver cohesive end-to-end experiences and ensure shared ownership of technical direction.
- Design and develop foundational platform components and reusable building blocks.
Requirements
- Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including C, C++, C#, Java, JavaScript, or Python, OR equivalent experience.
- 4+ years of experience designing, building, and operating production-grade software and services at scale.
- Proven experience in designing and building distributed systems and cloud-based services.
- Deep understanding of cloud platforms such as Azure, AWS, or GCP.
- Hands-on experience developing in AI-enhanced environments using tools like GitHub Copilot or similar.
- Hands-on experience with generative AI API platforms such as Azure AI Foundry, OpenAI, Claude, or similar.
- Familiarity with Authorization, Authentication and OAuth standard protocols is a plus.
- Familiarity with agentic protocols such as MCP or A2A is a plus.
