Early-stage AI infrastructure team unifying large language model APIs under a single standard.
Rust Engineer
Referral bonus eligible. Know someone who would be great for this role? Refer them to a Fluency Digital recruiter. If they're placed, you may be eligible for a referral bonus of up to $5,000 (terms apply). Refer someone for this role
You are a systems programmer who finds elegance in low-latency concurrency and gets energized by the chaos of integrating disparate AI models. Your days will focus on architecting high-throughput backend services in Rust that normalize requests across providers like Anthropic and Hugging Face into a seamless OpenAI-compatible format. This is not a wrapper job; you will solve hard distributed systems problems involving Redis caching, PostgreSQL persistence, and complex error handling for a rapidly growing developer platform.
What they're looking for
- 2 to 5 years of professional experience writing production-grade Rust with a focus on performance and memory safety.
- Deep familiarity with Python ecosystems and modern web frameworks like FastAPI for building robust API layers.
- Proven track record designing scalable data architectures using PostgreSQL and Redis in high-traffic environments.
- Strong understanding of LLM providers, tokenization strategies, and the nuances of working with generative AI APIs.
- Ability to thrive in a small, on-site San Francisco team where direct ownership of critical infrastructure is expected.