New: upload your resume and get matched to AI jobs. Free to start →

Specialist in machine learning engineering

Remote • India • Full-time

Posted 8d ago

Remote Work Policy

Fully remote

Employment Type

Full-time

Categories

AI Infrastructure Engineer

About the job

This role focuses on ensuring the reliability, performance, and operational excellence of critical AI infrastructure, specifically large-scale machine learning services in production. The work involves a blend of hands-on engineering, automation, incident management, and collaboration with various teams. You will be responsible for operating, scaling, and optimizing multi-tenant LLM inference, model-serving, VectorDB/RAG, and Model Context Protocol (MCP) platforms across global cloud and GPU clusters. This includes establishing and monitoring service levels, developing automation for deployments and scaling, and optimizing GPU utilization and inference performance.

Responsibilities

  • Operate, scale, and optimize LLM inference, model-serving, VectorDB/RAG, and MCP platforms.
  • Establish and monitor SLOs, SLIs, automated health checks, and observability dashboards.
  • Develop automation for deployment rollouts, autoscaling, canary releases, self-healing systems, and disaster recovery.
  • Optimize GPU utilization and inference performance using Kubernetes, vLLM, and Ray.
  • Lead complex production incident responses and conduct root-cause investigations.
  • Collaborate with AI researchers, product developers, and platform engineering teams.
  • Participate in an on-call rotation and improve operational practices and system resilience.

Requirements

  • Bachelor's degree in Computer Science, Engineering, or related field with 5+ years of experience, or Master's degree with 3+ years of experience.
  • 3+ years of software development experience using Python, Go, or Java.
  • Strong experience operating distributed and containerized production systems using Kubernetes, microservices, and CI/CD.
  • Proven background in Site Reliability Engineering, production operations, distributed systems troubleshooting, and observability.
  • Practical experience with monitoring and observability tools like Prometheus, Grafana, Splunk, or OpenTelemetry.
  • Working knowledge of at least one major cloud platform: AWS, Azure, or GCP.
  • Hands-on experience with LLM inference and serving frameworks (vLLM, TensorRT-LLM, Ray Serve, KServe) is highly desirable.
  • Familiarity with GPU orchestration, capacity planning, model parallelism, and performance profiling.
  • Experience managing vector databases, search engines, or distributed caching solutions (Milvus, Pinecone, Redis).
  • Understanding of generative AI architectures, including RAG pipelines, model routing, MCP, and agent runtimes.
  • Strong problem-solving, analytical, communication, and collaboration skills.

Benefits

  • Fully remote working arrangement.
  • Full-time employment opportunity.
  • Opportunity to work on large-scale AI infrastructure and advanced generative AI technologies.
  • Exposure to distributed systems, GPU computing, and modern machine learning platforms.
  • Collaboration with experienced professionals across AI research, software development, and platform engineering.
  • Opportunities for continuous technical learning, innovation, and professional development.
  • Contribute to mission-critical AI services with global reach and impact.