Staff Applied AI Engineer
Tel Aviv - IL • Full-time
Posted 12d ago
Remote Work Policy
On-site
Employment Type
Full-time
Categories
AI Engineer
About the job
As an Applied AI Engineer on Managed Inference at Crusoe, you will partner directly with strategic customers to deploy, optimize, and scale their models into production. You will own the technical journey end to end, from benchmark POCs that win deals to production endpoints serving billions of tokens daily with optimal latency, throughput, and cost. This role bridges deep inference engineering with customer-facing technical leadership, helping shape Crusoe's core AI platform.
Responsibilities
- Scope workloads, define metrics (TTFT, throughput, cost/token), build benchmarks, and lead technical POCs.
- Serve as the technical lead for customer engineering teams through architecture reviews and rollout planning.
- Tune inference engines (KV cache, speculative decoding, parallelism, quantization) to hit aggressive performance targets.
- Profile and diagnose bottlenecks at the engine level to deliver production fixes.
- Own end-to-end customer onboarding, deployment, autoscaling, capacity planning, and SLO monitoring.
- Optimize configurations for base, custom, and fine-tuned models to accelerate time-to-value.
- Feed field insights back into product roadmaps and contribute code to our inference engine and tooling.
- Publish reference architectures, cookbooks, and technical blogs.
Requirements
- 5+ years in a technical role with strong programming and production skills (Kubernetes, Docker, GPU servers).
- Proven ability to lead technical discussions with customer engineers and leadership.
- Hands-on experience with inference engines (vLLM, SGLang, TensorRT-LLM) and performance profiling.
- Strong command of KV-cache tuning, batching, parallelism, quantization, and related cost math.
- Solid knowledge of the open-source model landscape and hardware-model matching.
- Experience as an FDE, solutions engineer, or inference engineer at an AI cloud, lab, or provider.
- Hands-on background in fine-tuning/post-training (LoRA, SFT, DPO) or contributions to open-source engines.
Benefits
- Competitive benefits package designed to support financial security, health, and overall well-being.
- Benefits tailored to local market standards.
- Core offerings such as pension contributions.
- Additional perks to support work-life balance.
