Rolewise

Cloud Inference Engineer

Luminal · San Francisco · On-site

USD 150,000–250,000 / year

Apply on the employer's site ↗
Company
Luminal
Location
San Francisco
Work mode
On-site
Open to applicants from
On-site/hybrid: local candidates
Level
Not specified
Employment
Full-time
Field
Software Engineering / Software engineer (general)
Stated pay
USD 150,000–250,000 / year
Posted
2026-11-07 (8 days ago)
Visa sponsorship mentioned
Not mentioned
Listing source
Ashby

LLM

About the role

QUALIFICATIONS - CUDA + GPU inference optimization - vLLM, SGLang, or TensorRT-LLM experience - KV caching, paged attention, batching, token streaming, etc. - Distributed compute (with GPUs is a super plus) - No degree required COMPANY Luminal (YC S25) builds an AI compiler and serving stack that makes models 10x faster and production ready with one line. ROLE Founding, on site in downtown SF. Ship low latency, high throughput model serving on Luminal Cloud. Day to day responsibilities: - Deploy and tune models with optimizations like KV caching, paged attention, sequence packing, etc. - Conducting model performance reviews - Improve scheduler, batcher, autoscaling; profile latency, cost,…

Excerpt only. Read the full description and apply at the original posting on Ashby. We list jobs from public job-board feeds and do not alter employer content beyond this excerpt.

Similar roles