📋 Job Overview

The Inference Framework R&D Engineer role at Tencent focuses on developing and optimizing large model inference engines and PD-separated inference scheduling systems to enhance the efficiency of large-scale distributed inference systems. The position involves supporting mainstream GPUs and heterogeneous AI chips while optimizing large model inference performance to achieve ultimate performance-cost advantages. This role is crucial for advancing AI inference technologies in a high-performance computing environment.