samsungsemiconductor · San Jose, California, United States
Skills: Python
Please Note: To provide the best candidate experience amidst our high application volumes, each candidate is limited to 10 applications across all open jobs within a 6-month period. Advancing the World’s Technology Together Our technology solutions power the tools you use every day--including smartphones, electric vehicles, hyperscale data centers, IoT devices, and so much more. Here, you’ll have an opportunity to be part of a global leader whose innovative designs are pushing the boundaries of what’s possible and powering the future. We believe innovation and growth are driven by an inclusive culture and a diverse workforce. We’re dedicated to empowering people to be their true selves. Together, we’re building a better tomorrow for our employees, customers, partners, and communities. What You'll Learn Project Overview: Build a cost-model-guided auto-tuning framework for PyTorch and Triton kernels on Samsung’s compute-near-memory AI accelerator, and make it placement-aware, so that each kernel is tuned for where its data lives. You’ll connect it to torch.compile and measure the gains on LLM inference. Skills You’ll Learn: Performance optimisation for a cache-less, DMA-driven accelerator: search spaces, legality rules and cost models PyTorch compiler internals (torch.compile, FX, Inductor autotuning) and Triton kernel compilation Benchmarking and profiling LLM inference kernels (GEMM, attention) on simulators and hardware What You’ll Do Our ML Compiler team builds the software that runs PyTorch models on Samsung’s compute-near-memory AI accelerator: a PyTorch device and compiler backend, a Triton-based kernel compiler and an LLVM back end. We work closely with the runtime and hardware teams and with the PyTorch and Triton open-source communities. Over the summer you’ll own one piece of making ordinary PyTorch models fast on new memory-centric hardware, from research idea to merged, measured code. Location: Daily onsite presence at our San Jose Headquarters in alignme…
Sign in to see the original posting
Browse more developer jobs on RoleBurst