opswat · Ho Chi Minh City, Ho Chi Minh City, Vietnam
Skills: Python, AWS, CI/CD
OPSWAT , a global leader in IT, OT , and ICS critical infrastructure cybersecurity, delivers an end-to-end platform that gives public and private sector organizations and enterprises the critical advantage needed to protect their complex networks, secure their devices, and ensure compliance. Over the last 20 years our commitment to innovative technology has earned the trust of more than 1,700 organizations, governments, and institutions globally, solidifying our role in protecting the world’s critical infrastructure and securing our way of life. The Position OPSWAT is committed to harnessing the power of AI to drive meaningful advancements across all areas of our business. We are currently seeking a highly skilled Senior AI Engineer to lead the deployment and optimization of Large Language Models for efficient, high performance inference on GPU hardware. In this role, you will own the infrastructure layer that turns our AI models into fast, cost effective, production grade services. You will work closely with the AI/ML Team, the Enterprise & Data Team, and Infrastructure to design local LLM serving environments, maximize GPU utilization, and apply model compression techniques such as quantization from FP32 down to FP8/FP4. This is a chance to work at the deep intersection of models, serving software, and hardware within a global cybersecurity company, delivering the performance that powers OPSWAT's AI products at scale. What You Will Do Local LLM Deployment & Hardware Setup: Design and build local LLM serving environments on GPU hardware, selecting GPU configurations based on VRAM, memory bandwidth, and workload. Install and maintain the full inference stack (NVIDIA drivers, CUDA, cuDNN, inference engines) across single and multi GPU deployments, including tensor and pipeline parallelism. Inference Optimization & Model Compression: Optimize LLM models for efficient GPU serving, balancing latency, throughput, memory, and cost. Apply quantization from FP32 to FP16/BF1…
Sign in to see the original posting
Browse more developer jobs on RoleBurst