vectara · US Remote - Bay Area Preferred
Skills: Python, Java, SQL, AWS, Docker, CI/CD
Platform Engineer Vectara is the Enterprise Agent Platform that enables businesses to build and deploy governed, grounded, auditable AI agents across SaaS, VPC, and on-prem. We have developed our own models, observability and orchestration layers, guardrails, and context management systems in order to provide our customers with the greatest levels of AI agent accuracy, security, and explainability. Our founding members include industry veterans and experts in neural information retrieval and distributed systems from Google. We’re a passionate team that’s hyper-focused on solving enterprise-level technology and business problems with AI. Join us! The Role You'll own the infrastructure that runs our deploy anywhere platform — from Kubernetes clusters serving ML inference at scale to the CI/CD pipelines, IaC, and observability stack that keep it all reliable. This is a hands-on role: you'll write Helm charts and Terraform one day, debug a Kafka consumer lag issue the next, and ship a backend service feature the day after. You'll deploy across AWS, GCP, and on-premises (including air-gapped environments), and you'll participate in an on-call rotation supporting enterprise customers. What You’ll Do Build and maintain infrastructure-as-code (Terraform, Helm) for our AWS EKS and GCP GKE clusters, plus on-premises deployments (including Tanzu and air-gapped environments). Own CI/CD pipelines (GitHub Actions, Bazel, ArgoCD) and drive GitOps adoption. Deploy, scale, and optimize ML/NLP inference workloads (vLLM, PyTorch, GPU scheduling with various Kubernetes scalers). Build and improve observability: Prometheus, Grafana, Datadog,, and OpenTelemetry. Collaborate with Field Engineering to support PoCs and platform deployments in customer cloud VPCs and on-prem environments. Contribute to backend services (Java 21, Python, gRPC) and platform features. Improve system reliability, scalability, and developer experience across the engineering org. What You’ll Bring (Required): 5+ y…
Sign in to see the original posting
Browse more developer jobs on RoleBurst