YC-backed startup building the universal gateway for LLM APIs

Director / Head of Engineering

San FranciscoOn-site$250K - $300K5 - 10 years
You'll spend your mornings reviewing Rust and Python code that routes millions of API calls between enterprises and a dozen different model providers. Afternoons go to unblocking the team, refining architecture decisions, and deciding when to patch versus when to rebuild. This is hands-on leadership at a small shop where the SDK is the product and uptime is the brand.

What they're looking for

  • 5-10 years shipping software, with at least 2 leading infrastructure or platform teams
  • Deep fluency in Python and Rust; comfort tracing bugs through FastAPI and async systems
  • Experience running on-call for production APIs serving paying enterprise customers
  • Familiarity with the OpenAI API ecosystem and at least one major provider (Azure, Anthropic, Google, open-weight)
  • Willing to work on-site in San Francisco and build culture by presence, not process

Tech stack

PythonRustFastAPIOpenAIAzure

Apply for this role

This role is one we're recruiting for on behalf of a client company; the client's identity is kept confidential at this stage. A Fluency recruiter will follow up with details.