Senior Software Engineer, Model Serving
5d ago
Databricks' Model Serving product offers enterprises a unified, scalable, and governed platform for deploying and managing AI/ML models, including traditional ML and large language models. It provides real-time, low-latency inference, governance, monitoring, and lineage, making it a core pillar for customers operationalizing models at scale with strong SLAs and cost efficiency. As a Senior Engineer, you will be instrumental in shaping both the product experience and the foundational infrastructure of Model Serving. You will design and build high-throughput, low-latency inference systems for CPU and GPU workloads, influence architectural direction, and collaborate with cross-functional teams to deliver a world-class serving platform.
$166k - $225k
San Francisco, California remote Model ServingMLOpsGPU +7 more
