New: upload your resume and get matched to AI jobs. Free to start →

Software Engineer II - AI/ML Infrastructure CoreAI

India, Karnataka, Bangalore • Full-time

Posted 11d ago

Remote Work Policy

On-site

Employment Type

Full-time

Categories

AI Infrastructure Engineer

About the job

The AI Platform organization at Microsoft CoreAI is seeking individuals to help build the cutting-edge platform that powers Azure's innovation and Microsoft's flagship products. The mission is to empower every AI application, focusing on designing systems that enable AI to learn, improve, and scale in production. This role involves tackling industry challenges to make frontier models accessible, efficient, and cost-effective, by developing pre-training, mid-training, and post-training solutions. You will gain end-to-end ownership and exposure, from high-level APIs to granular reinforcement learning controls, and from Azure ML flexibility to deploying LoRA models and inferencing at scale, supported by Azure's infrastructure.

Responsibilities

  • Create necessary abstractions, infrastructure, and interfaces to train, test, validate, scale, and optimize machine learning algorithms.
  • Implement features for data cleaning, model training, and hyperparameter tuning at massive, distributed scale.
  • Drive the incorporation of customer-inspired innovations into software.
  • Take holistic ownership of features.
  • Independently use appropriate AI agents, skills, and practices across the software development lifecycle.
  • Collaborate with internal stakeholders to understand customer/user requirements.
  • Create a clear test strategy, execute test plans, and build testable code.
  • Create extensible and maintainable product feature code with minimal defects.
  • Review product feature code to ensure correct test coverage and adherence to team standards.
  • Implement debugging tools, tests, logs, and telemetry to verify assumptions.
  • Strive for automation within production deployment, aiming for zero-touch operations.
  • Apply security best practices for security hardening across product features.

Requirements

  • Bachelor's/Master's Degree in Computer Science or related technical field AND 4+ years of technical engineering experience with coding in languages including C#, Java, or Python, or equivalent experience.
  • Experience with day-to-day AI agents and tool use.
  • Experience writing production code in building internet-scale services and distributed systems.
  • Ability to debug, read code, and work on a large and increasing codebase.
  • Excellent communication and presentation skills.
  • Experience collaborating with developers and other stakeholders as a team player.