Rolewise

(Senior/Junior AI Inference Reliability Engineer, Compute Infra

Together AI · San Francisco · Office location (mode not stated)

USD 160,000–280,000 / year

Apply on the employer's site ↗
Company
Together AI
Location
San Francisco
Work mode
Office location (mode not stated)
Open to applicants from
On-site/hybrid: local candidates
Level
Junior
Employment
Not stated
Field
Data & AI / Machine learning & AI
Stated pay
USD 160,000–280,000 / year
Posted
2026-10-27 (19 days ago)
Visa sponsorship mentioned
Not mentioned
Listing source
Greenhouse

KubernetesSalesforceMachine learning AI / ML engineering & research

About the role

About the Role We're looking for a software engineer, reliability-minded but still a builder, to own what happens in production to the Kubernetes-native control plane that provisions and runs our GPU inference fleet. The platform team builds the manifest-driven API and controllers that let the inference team declare what they need, a cluster, a model deployment, a capacity change, and get it reconciled underneath. Your job is to keep that promise true in the real world: triaging InfiniBand issues when prefill and decode nodes stall exchanging KV cache over RDMA, diagnosing hero-model and LoRA-serving faults that don't show up in generic health checks, and extending the automated…

Excerpt only. Read the full description and apply at the original posting on Greenhouse. We list jobs from public job-board feeds and do not alter employer content beyond this excerpt.

Similar roles