An open marketplace optimizing and democratizing access to AI computing power

Staff Software Engineer, AI Inference Gateway

Remote (U.S. only)$225K - $300K7 - 20 yearsReferral bonus eligible
Referral bonus eligible. Know someone who would be great for this role? Refer them to a Fluency Digital recruiter. If they're placed, you may be eligible for a referral bonus of up to $5,000 (terms apply). Refer someone for this role
We're looking for a seasoned software engineer to strengthen our AI inference gateway in a rapidly growing company. In this role, you'll apply your backend and infrastructure skills to build and maintain APIs that connect and optimize access to GPU computing resources. Your work will ensure that buyers and sellers of AI infrastructure can reliably discover and contract computing power in real-time. You might be defining the future of analytics, or building a security system that prevents improper usage of GPUs, or even architecting scalable blockchain infrastructure.

What they're looking for

  • 7 to 20 years of experience in backend engineering, infrastructure, or SRE roles
  • Proficient in Go, Rust, or Python
  • Experience with Kubernetes and low-latency, high-availability systems
  • A background in blockchain or protocol engineering, or a strong interest in learning the field
  • Ability to work in a remote or hybrid environment from one of many US cities

Tech stack

GoRustPythonKubernetes

Apply for this role

We use AI to help match your experience to the roles where you fit best. A member of our team reviews every application, and all hiring decisions are made by people.

This role is one we're recruiting for on behalf of a client company; the client's identity is kept confidential at this stage. A Fluency recruiter will follow up with details.

Share this role