mayflower · Limassol, Lemesos, Cyprus
Skills: Docker, CI/CD
We are looking for a hands-on DevOps Engineer with strong Kubernetes and data platform experience to join our DWH infrastructure team. You will help develop and operate our data platform. It runs on Kubernetes and is built on Airflow, Spark, Trino and Iceberg. We are primarily looking for someone with a Kubernetes/Linux/automation background who also has practical experience with data tooling. Our platform serves hundreds of thousands of requests per second, and the data platform behind it handles the analytics and reporting for the whole business. We are therefore looking for someone who is already comfortable working with high-load, business-critical production systems, rather than someone whose experience has been limited to small-scale or early-stage environments. CORE STACK Kubernetes / OKD (OKD is the upstream of OpenShift); Helm / Helmfile; GitLab CI/CD; Argo CD; Apache Airflow; Apache Spark (Spark Operator, Spark Connect, Spark History Server); Trino; Apache Iceberg (Iceberg Catalog); Data governance / data catalog tooling; VictoriaMetrics / VictoriaLogs / Grafana; Tableau; Linux. Our dedicated platform teams operate the underlying Kubernetes platform, while your team owns and operates the data workloads running on top of it. You will not be responsible for maintaining the cluster control plane, but you should be comfortable deploying, operating, and troubleshooting stateful and compute-heavy workloads in Kubernetes. Job Responsibilities Typical tasks in this role include: Deploy, operate, and evolve Airflow on Kubernetes and its integration with Spark, including DAG delivery, executors, connections, and secrets; Operate and tune Spark on Kubernetes: Spark Operator, Spark Connect, and Spark History Server, including resource management, scheduling, and troubleshooting failed or slow jobs; Administer Trino, including catalogs, access control, resource groups, and query performance tuning; Maintain and extend the Iceberg Catalog and the lakehouse storage layer…
Sign in to see the original posting
Browse more developer jobs on RoleBurst