Senior Deep Learning Software Engineer, Inference

Senior Software Engineer specializing in Deep Learning Inference at NVIDIA. Design, build, and optimize GPU-accelerated software for AI applications. Develop and maintain high-performance deep learning frameworks including SGLang and vLLM. Work on performance optimization and tuning of deep learning models in domains like LLM, Multimodal and Generative AI. Implement and optimize model serving pipelines using tools like CUTLASS, OAI Triton, NCCL, and CUDA kernels. Contribute features and code to NVIDIA's inference libraries. Scale performance across different NVIDIA accelerators from datacenter GPUs to edge SoCs. Collaborate with cross-functional teams on frameworks, NVIDIA libraries and inference optimization solutions.