Lead/Principal Backend Engineer – GenAI Infra

Lead/Principal Backend Engineer – GenAI Infra

Company details

Description of the offer

Okareo – Real-Time Error Tracking and Robustness for GenAI
We are building a modern platform for developers to safely deploy GenAI through real-time error tracking, robust adversarial simulations, and deep agentic evaluation. Real-time LLM error tracking is built into the core of GenAI development—so teams can instantly catch scope violations, failed LLM tool calls, and broken flows as they happen in production. Agentic evaluation brings visibility into agent planning, memory management, and decision-making to catch failures before they reach users. We help teams deploy LLM-based autonomous agents, function-calling frameworks, and retrieval-augmented generation (RAG) pipelines at scale.

About the Role
We’re building the foundational infrastructure for the next generation of LLM-powered software—and we’re looking for a senior backend engineer to help lead the way. As a key early team member, you’ll play a central role in shaping our product, architecture, and engineering culture. If you care deeply about building for other developers, have strong opinions on modern software development, and want your work to define the future of GenAI tooling, we’d love to talk.

What You’ll Do

• Partner directly with the founding team to define core product capabilities and backend architecture
• Overall technical ownership and definition of product architecture with opportunity to leverage the best of modern technical stack
• Design and evolve infrastructure that supports LLM evaluations, simulations, and real-time observability at scale
• Collaborate with customers’ engineering teams to integrate into their LLM pipelines and solve real-world infra challenges
• Set the technical tone: mentor engineers, establish best practices, and lead by example

What We’re Looking For

• 8+ years of backend or infrastructure engineering experience, ideally building developer-facing or platform products
• Proven track record of leading development on high-impact projects with large surface area
• Deep experience with cloud platforms (GCP, AWS) and strong system design fundamentals
• Comfortable thinking independently, shipping rapidly, and navigating ambiguity
• Strong mentorship instincts and desire to shape a high-performing engineering culture

Nice to Have

• Contributor or maintainer of open-source developer tools or infra projects
• Experience with ML or LLM infra (model serving, eval frameworks, vector DBs, etc.)
• Full-cycle development of ML-powered systems at significant scale
• Background in observability stacks, CI/CD systems, or IDE/dev tooling

Location of employment

How to apply?