YC-backed startup building the universal gateway for LLM APIs

Director / Head of Engineering

San FranciscoOn-site$250K - $300K5 - 10 years
You'll spend your mornings reviewing Rust and Python code that routes millions of API calls between enterprises and a dozen different model providers. Afternoons go to unblocking the team, refining architecture decisions, and deciding when to patch versus when to rebuild. This is hands-on leadership at a small shop where the SDK is the product and uptime is the brand.

What they're looking for

  • 5-10 years shipping software, with at least 2 leading infrastructure or platform teams
  • Deep fluency in Python and Rust; comfort tracing bugs through FastAPI and async systems
  • Experience running on-call for production APIs serving paying enterprise customers
  • Familiarity with the OpenAI API ecosystem and at least one major provider (Azure, Anthropic, Google, open-weight)
  • Willing to work on-site in San Francisco and build culture by presence, not process

Tech stack

PythonRustFastAPIOpenAIAzure

Apply for this role

We use AI to help match your experience to the roles where you fit best. A member of our team reviews every application, and all hiring decisions are made by people.

This role is one we're recruiting for on behalf of a client company; the client's identity is kept confidential at this stage. A Fluency recruiter will follow up with details.

Share this role