Senior Systems Software Engineer - Accelerated Spark Applications at NVIDIA

Senior Systems Software Engineer - Accelerated Spark Applications at NVIDIANVIDIA

Workplace: Remote

Skills: Python, Java, AWS, DockerNVIDIA(https://himalayas.app/companies/nvidia) has been transforming computer graphics, PC gaming, and accelerated computing for more than 25 years. It’s a unique legacy of innovation that’s fueled by great technology—and amazing people. Today, we’re tapping into the unlimited potential of AI to define the next era of computing. An era in which our GPU acts as the brains of computers, robots, and self-driving cars that can understand the world. Doing what’s never been done before takes vision, innovation, and the world’s best talent. As an NVIDIA(https://himalayas.app/companies/nvidia)N, you’ll be immersed in a diverse, supportive environment where everyone is inspired to do their best work. Come join the team and see how you can make a lasting impact on the world.NVIDIA(https://himalayas.app/companies/nvidia) is seeking a Senior Systems Software Engineer for the Apache Spark Acceleration group. GPU accelerated data processing has moved from proof of concept to production deployments. Enterprises now recognize the need for accelerated computing to handle large data processing needs. Multi-node GPU deployments reduce cloud computing costs and lower the latency of batch ETL workloads. At NVIDIA(https://himalayas.app/companies/nvidia), we accelerate Apache Spark with an open source plugin that speeds up Spark applications on GPUs without code changes, and our cuDF Spark library is integrated with AWS EMR, Databricks, Google Dataproc, Oracle Cloud Data Flow, Bytedance Volcengine, Tencent Cloud and Cloudera. This role is on the team that runs that acceleration as a handled Spark service inside NVIDIA(https://himalayas.app/companies/nvidia). The service accomplishes production data pipelines for NVIDIA(https://himalayas.app/companies/nvidia)’s internal data platform at thousands of jobs an hour on Kubernetes and AWS, under a customer SLA. It packages the cuDF Spark plugin and a CPU/GPU workload router into an API-based service built on Spark Connect, Kyuubi, Helm and Flux…Sign in to see the original postingBrowse more developer jobs on RoleBurst