Staff Software Engineer, GPU Inference

About this kind of role

What a Staff Software Engineer, GPU Inference usually does. The employer's own details are in the listing.

Typically does: Designs, develops, tests, and maintains software for graphics processing unit (GPU) inference applications. This often involves optimizing algorithms and code to maximize performance and efficiency on GPU hardware. Responsibilities can include working with machine learning frameworks and collaborating with hardware engineers. Debugging and profiling GPU code to identify and resolve bottlenecks are also common tasks.

Tools and skills: Proficiency in C++, Python, CUDA, and experience with machine learning frameworks like TensorFlow or PyTorch are generally required, alongside strong understanding of GPU architecture and parallel programming.

Good fit for: Individuals with a strong background in computer science, software engineering, or a related field, and a passion for high-performance computing and machine learning, often thrive in this role.