Senior ML engineer optimizing large language model inference at scale.
Lead LLM inference optimization projects covering model compression, quantization, distributed serving, and performance tuning across latency, throughput, and cost metrics. You'll evaluate inference engines, design request routing and scheduling systems, implement speculative decoding and KV-cache optimizations, and collaborate with kernel and platform teams to resolve production bottlenecks. Strong PyTorch and transformer architecture knowledge required; experience with vLLM, SGLang, or TensorRT-LLM essential.
Membership is €29/month, cancel anytime: every rate, every original listing link, and a daily alert for roles matching your filters.
Found at a specialist agency · listed 25 September 2026 · InsideJobs links you to the original posting.