Early-stage AI infrastructure team unifying large language model APIs under a single standard.
Rust Engineer
You are a systems programmer who finds elegance in low-latency concurrency and gets energized by the chaos of integrating disparate AI models. Your days will focus on architecting high-throughput backend services in Rust that normalize requests across providers like Anthropic and Hugging Face into a seamless OpenAI-compatible format. This is not a wrapper job; you will solve hard distributed systems problems involving Redis caching, PostgreSQL persistence, and complex error handling for a rapidly growing developer platform.
What they're looking for
- 2 to 5 years of professional experience writing production-grade Rust with a focus on performance and memory safety.
- Deep familiarity with Python ecosystems and modern web frameworks like FastAPI for building robust API layers.
- Proven track record designing scalable data architectures using PostgreSQL and Redis in high-traffic environments.
- Strong understanding of LLM providers, tokenization strategies, and the nuances of working with generative AI APIs.
- Ability to thrive in a small, on-site San Francisco team where direct ownership of critical infrastructure is expected.