Rolewise

ML Engineer

Litellm · San Francisco · On-site

USD 200,000–250,000 / year

Apply on the employer's site ↗
Company
Litellm
Location
San Francisco
Work mode
On-site
Open to applicants from
On-site/hybrid: local candidates
Level
Junior
Employment
Full-time
Field
Data & AI / Machine learning & AI
Stated pay
USD 200,000–250,000 / year
Posted
2026-11-11 (4 days ago)
Visa sponsorship mentioned
Not mentioned
Listing source
Ashby

LLMPythonRedis AI / ML engineering & research

About the role

LiteLLM is the world's most popular AI Gateway, trusted by companies like Adobe, Netflix, and NASA. We're building the next generation of infrastructure for AI applications—and now we're building our second product. WHAT YOU WILL BE WORKING ON Skills: Python, LLM APIs, FastAPI As the ML Engineer, you'll be responsible for ensuring LiteLLM unifies the format for calling LLM APIs in the broader OpenAI + Anthropic spec. This involves writing transformations to convert API requests from OpenAI/Anthropic spec to various LLM provider formats, building provider-agnostic unification functionality (e.g. session management across non-openai models for /v1/responses API, etc.). You'll work directly…

Excerpt only. Read the full description and apply at the original posting on Ashby. We list jobs from public job-board feeds and do not alter employer content beyond this excerpt.

Similar roles