Founding Engineer – Rust / Systems
We’re supporting a stealth\-stage AI startup backed by world\-class investors and led by a highly technical founding team. Their mission is to transform how developers train, deploy, and optimize large language models — building the infrastructure that powers AI in the real world.
They're looking for a
Founding Engineer
with deep Rust experience to help architect and scale the backend systems of a next\-gen LLM developer platform — focused on performance, observability, and modularity.
What You’ll Be Building:
Core backend services written in
Rust
for high\-throughput, low\-latency LLM interaction
Infrastructure that supports
dynamic in\-context learning
,
prompt evaluation
, and
fine\-tuning orchestration
Scalable APIs and serverless components using
AWS Lambda
,
ECS
, and
S3
Real\-time logging, metrics, and evaluation pipelines to surface model behavior and performance
Modular systems that can evolve into an open\-source foundation for the LLM infra ecosystem
Tech Stack:
Languages
: Rust (heavily), TypeScript (frontend), Python (light)
Infra
: AWS (Lambda, ECS, S3\), Docker, Terraform
Datastores
: MySQL, Postgres, S3
Frontend
: Svelte, Tailwind (you'll collaborate, not build here)
LLM Integrations
: OpenAI, fine\-tuning, prompt chaining, eval harnesses
Why You Should Join:
Founding team impact
— define the backend architecture, roadmap, and engineering culture
Modern, open tooling
— much of the platform is designed to be open\-source and community\-facing
Well\-capitalized
— backed by elite investors with years of runway
Mission\-aligned
— build the infrastructure that helps AI become more transparent, reliable, and usable