Job Description

Why Join Inworld

Inworld is the leading provider of AI technology for real-time interactive experiences, with a $500 million valuation and backing from top tier investors including Intel Capital, Microsoft’s M12 fund, Lightspeed Venture Partners, Section 32, BITKRAFT Ventures, Kleiner Perkins, Founders Fund, and First Spark Ventures.

Inworld provides the market’s best framework for building production ready interactive experiences, coupled with dedicated services to optimize specific stages of development – from design and development, to ML pipeline optimization and custom compute infrastructure. We help developers bring their AI engines in-house with a framework optimized for real-time data ingestion, low latency, and massive scale. Inworld powers experiences built by Ubisoft, NVIDIA, Niantic, NetEase Games and LG, among others, and has partnerships with key industry players such as Microsoft Xbox, Epic Games, and Unity.

Inworld was recognized by CB Insights as one of the 100 most promising AI companies in the world in 2024 and was named among LinkedIn’s Top Startups of 2024 in the USA.

Join our dynamic team as a Platform Engineer and play a pivotal role in building, securing, and scaling our cutting-edge AI engine for games. Collaborate with backend and ML engineers to plan, deploy, and maintain services across major cloud providers using Terraform, ArgoCD and other tooling. As part of our small, collaborative team, your contributions will significantly shape our operations and innovation.

About the role

As a Staff Platform Engineer (MLOps), you'll work closely with backend and ML Engineering teams to design, deploy, and maintain reliable, high-performance, and secure cloud infrastructure for our AI Engine and Studio.

What you’ll do

• Develop, manage, and optimize the ML model lifecycle in production using the Inworld AI platform and Nvidia CUDA, implementing CI/CD systems for ML workflows, monitoring models to identify issues and inefficiencies, and designing MLOps tools and frameworks to enhance automation and efficiency.
• Facilitate a "you build it, you run it" culture by providing the necessary tools and processes for monitoring the reliability, availability, and performance of services.
• Manage CI/CD pipelines to ensure smooth and efficient code integration and deployment.
• Identify and implement opportunities to enhance engineering speed and efficiency.
• Conduct root cause analysis to identify critical issues and develop automated solutions to prevent recurrence.
• Develop and share best practices to improve automation and efficiency across our engineering teams.

Requirements

• 7+ years of experience in software engineering.
• 5 years of experience with infrastructure-as-code.
• Proficiency in managing Kubernetes clusters and applications, including creating Helm charts/Kustomize manifests for new applications.
• Experience in creating and maintaining CI/CD pipelines for both applications and infrastructure deployments (using tools like Terraform/Terragrunt, ArgoCD, GitHub Actions, Ansible, etc.).
• Deep knowledge of at least one major cloud provider (Google Cloud Platform, Microsoft Azure, Oracle Cloud).
• Proficient in at least one backend programming/scripting languages such as Golang, Python, and Bash.
• Familiarity with open source LLM and open source serving solution (e.g. vLLM or llama.cpp, kserve, etc) is a plus.
• Experience with SLURM
• Experience with data pipeline and workflow management tools
• Experience with bare metal GPUs (optional)

Candidates must be based in the SF Bay Area or willing to relocate (you will be working on-site in our South Bay office a few days a week).

The base salary range for this full-time position is between $180,000 - $280,000 + bonus + equity + benefits. Your recruiter can share more about the specific salary range for your targeted location during the hiring process.

Job Tags

Similar Jobs