Anyscale

Anyscale is seeking a Software Engineer for its ML Developer Experience (MLDevX) team. This role focuses on the user-facing interfaces of the Anyscale platform, enabling users and coding agents to discover, configure, run, observe, debug, and productionize AI workloads. You will work across the full stack, from developer tooling to cloud infrastructure and the Ray runtime, making complex distributed systems more intuitive and manageable for developers. This is a high-impact individual contributor role with end-to-end ownership, involving direct collaboration with users and field teams to identify problems, shape product and technical design, and build and operate solutions. The scope covers the entire AI workload and developer loop, from data preparation and fine-tuning to code submission, monitoring, and optimization.

$226k - $283k

Anyscale is seeking a Customer Engineer to join their team and support customers in their post-sale journey. This role involves helping customers onboard, adopt, and grow on the Anyscale platform, troubleshooting and resolving tickets, and driving consumption. You will work closely with engineering teams to debug complex issues, making this an exciting opportunity for technically curious individuals passionate about ML/AI, LLMs, and vLLMs. The role offers a chance to make a significant impact in a fast-paced, collaborative environment while contributing to a new segment in the AI space.

$170k - $199k

Anyscale is seeking a Distributed LLM Inference Engineer to develop systems and optimizations that push the boundaries of performance for large-scale inference. This critical role will contribute to Anyscale's market-leading position in AI infrastructure. You will work closely with product teams to deliver end-to-end solutions for batch and online inference, integrating Ray Data and LLM engines to achieve cost-effective, large-scale ML inference. You will also integrate with open-source software like vLLM, contribute to Anyscale's solutions, and improve open-source projects. Staying abreast of the latest advancements in open-source and research is key to implementing and extending best practices.

$170k - $245k