📋 Job Overview

The Inference Framework Engineer role at Tencent involves developing and optimizing large model inference engines and PD-separated inference scheduling systems. The position focuses on supporting mainstream GPUs and heterogeneous AI chips to enhance large model inference performance. The goal is to create extreme performance-cost advantages for AI applications.