元宝-LLM大模型推理工程师
Tencent
元宝-LLM大模型推理工程师
Job Description
元宝-LLM大模型推理工程师
📋 Job Overview
The role of LLM Large Model Inference Engineer at Tencent involves deploying, maintaining, and optimizing large language models for service business scenarios. Responsibilities include implementing inference acceleration techniques such as model pruning, quantization, and dynamic batching. The position also entails researching cutting-edge technologies to integrate sparse, heterogeneous, and distributed inference into search business applications.
📍 Location: Beijing, China
🏢 Business Unit: CSIG
📄 Full Description
2.负责推理加速方法的工程实现和落地，包括但不限于模型剪枝、模型量化、动态batch等方法；
3.调研前沿技术，推动稀疏化推理、异构推理、分布式推理等技术在搜索业务中的集成应用。
🎯 Key Responsibilities
- Participate in the deployment, operation and maintenance, and inference optimization development of LLM large models in service business scenarios.
- Responsible for the engineering implementation and deployment of inference acceleration methods, including but not limited to model pruning, model quantization, dynamic batching, etc.
- Research frontier technologies and promote the integration and application of sparse inference, heterogeneous inference, distributed inference, and other technologies in search business.
Locations
- Beijing, China
Salary
300,000 - 800,000 CNY / yearly
Source: ai estimated
* This is an estimated range based on market data and may vary based on experience and qualifications.
Responsibilities
- Participate in the deployment, operation and maintenance, and inference optimization development of LLM large models in service business scenarios.
- Responsible for the engineering implementation and deployment of inference acceleration methods, including but not limited to model pruning, model quantization, dynamic batching, etc.
- Research frontier technologies and promote the integration and application of sparse inference, heterogeneous inference, distributed inference, and other technologies in search business.
Tags & Categories
Answer 10 quick questions to check your fit for 元宝-LLM大模型推理工程师 @ Tencent.
Related Books and Jobs
元宝-LLM大模型推理工程师
Tencent
元宝-LLM大模型推理工程师
Job Description
元宝-LLM大模型推理工程师
📋 Job Overview
The role of LLM Large Model Inference Engineer at Tencent involves deploying, maintaining, and optimizing large language models for service business scenarios. Responsibilities include implementing inference acceleration techniques such as model pruning, quantization, and dynamic batching. The position also entails researching cutting-edge technologies to integrate sparse, heterogeneous, and distributed inference into search business applications.
📍 Location: Beijing, China
🏢 Business Unit: CSIG
📄 Full Description
2.负责推理加速方法的工程实现和落地，包括但不限于模型剪枝、模型量化、动态batch等方法；
3.调研前沿技术，推动稀疏化推理、异构推理、分布式推理等技术在搜索业务中的集成应用。
🎯 Key Responsibilities
- Participate in the deployment, operation and maintenance, and inference optimization development of LLM large models in service business scenarios.
- Responsible for the engineering implementation and deployment of inference acceleration methods, including but not limited to model pruning, model quantization, dynamic batching, etc.
- Research frontier technologies and promote the integration and application of sparse inference, heterogeneous inference, distributed inference, and other technologies in search business.
Locations
- Beijing, China
Salary
300,000 - 800,000 CNY / yearly
Source: ai estimated
* This is an estimated range based on market data and may vary based on experience and qualifications.
Responsibilities
- Participate in the deployment, operation and maintenance, and inference optimization development of LLM large models in service business scenarios.
- Responsible for the engineering implementation and deployment of inference acceleration methods, including but not limited to model pruning, model quantization, dynamic batching, etc.
- Research frontier technologies and promote the integration and application of sparse inference, heterogeneous inference, distributed inference, and other technologies in search business.
Tags & Categories
Answer 10 quick questions to check your fit for 元宝-LLM大模型推理工程师 @ Tencent.
Related Books and Jobs