2026 ML Compiler Software Engineer PEY Co-op (12-16 months), AWS Neuron, Annapurna Labs
Amazon
2026 ML Compiler Software Engineer PEY Co-op (12-16 months), AWS Neuron, Annapurna Labs
Job Description
At AWS, our mission is to make deep learning accessible to every developer by democratizing access to cutting-edge infrastructure. To achieve this, we’ve built custom silicon (AWS Inferentia and Trainium) and the AWS Neuron SDK that together deliver high-performance, cost-effective machine learning in the cloud.The AWS Neuron SDK includes a compiler, runtime, debugger, and libraries integrated with popular frameworks such as PyTorch and TensorFlow. It is preinstalled in AWS Deep Learning AMIs and Containers so customers can quickly get started with training and inference on AWS ML accelerators.The Neuron Toronto team focuses on performance, kernels, and tooling—analyzing and optimizing end-to-end ML workloads, developing and maintaining highly optimized kernels, and building performance modeling, profiling, and accuracy debugging tools. Together, these efforts ensure that Neuron delivers best-in-class performance, flexibility, and usability for customers deploying large-scale machine learning models.As a student intern, you will contribute to the efforts that make Neuron best-in-class for ML workloads. You’ll gain hands-on experience building business-critical features, analyzing performance, developing compiler or kernel optimizations, and building tools that provide deep insights into model execution. You’ll be mentored by experienced engineers while working on technology that directly accelerates customer workloads at scale.
Locations
- Canada, ON, Toronto, Toronto, ON, Canada
Salary
Estimated Salary Rangehigh confidence
75,000 - 95,000 USD / yearly
Source: ai estimated
* This is an estimated range based on market data and may vary based on experience and qualifications.
Skills Required
- - Strong interests and academic qualifications/research focus in two of the following: 1. Knowledge of code generation, compute graph optimization, resource scheduling 2. Compiler - Optimizing compilers (internals of LLVM, clang, etc) 3. Machine Learning frameworks (PyTorch, JAX) and Machine Learning (Experience with XLA, TVM, MLIR, LLVM) 4. Kernel development—experience writing CUDA kernels, OpenCL kernels, or ML-specific kernelsintermediate
Required Qualifications
- - Are enrolled in a academic program that is physically located in Canada (experience)
- - Are enrolled in a Bachelor's degree or higher in Computer Science, Engineering Science, Computer Engineering, Electrical Engineering, or majors relating to these fields with an anticipated graduation date between May 2027 - May 2028 (degree in a bachelor)
- - Strong interests and academic qualifications/research focus in two of the following: 1. Knowledge of code generation, compute graph optimization, resource scheduling 2. Compiler - Optimizing compilers (internals of LLVM, clang, etc) 3. Machine Learning frameworks (PyTorch, JAX) and Machine Learning (Experience with XLA, TVM, MLIR, LLVM) 4. Kernel development—experience writing CUDA kernels, OpenCL kernels, or ML-specific kernels (experience)
- - Available for a 12-16-month internship starting May 2026 (experience)
Preferred Qualifications
- - Previous technical internship(s) related to the areas of interest / research focus listed above (experience)
- - Experience in optimization mathematics such as linear programming and nonlinear optimization (experience)
- - Academic coursework in Compiler Design/Construction, Programming Language Theory, Computer Architecture, Advanced Algorithms & Data Structures (experience)
Tags & Categories
Answer 10 quick questions to check your fit for 2026 ML Compiler Software Engineer PEY Co-op (12-16 months), AWS Neuron, Annapurna Labs @ Amazon.
10 Questions
~2 Minutes
Instant Score
Related Books and Jobs
2026 ML Compiler Software Engineer PEY Co-op (12-16 months), AWS Neuron, Annapurna Labs
Amazon
2026 ML Compiler Software Engineer PEY Co-op (12-16 months), AWS Neuron, Annapurna Labs
Job Description
At AWS, our mission is to make deep learning accessible to every developer by democratizing access to cutting-edge infrastructure. To achieve this, we’ve built custom silicon (AWS Inferentia and Trainium) and the AWS Neuron SDK that together deliver high-performance, cost-effective machine learning in the cloud.The AWS Neuron SDK includes a compiler, runtime, debugger, and libraries integrated with popular frameworks such as PyTorch and TensorFlow. It is preinstalled in AWS Deep Learning AMIs and Containers so customers can quickly get started with training and inference on AWS ML accelerators.The Neuron Toronto team focuses on performance, kernels, and tooling—analyzing and optimizing end-to-end ML workloads, developing and maintaining highly optimized kernels, and building performance modeling, profiling, and accuracy debugging tools. Together, these efforts ensure that Neuron delivers best-in-class performance, flexibility, and usability for customers deploying large-scale machine learning models.As a student intern, you will contribute to the efforts that make Neuron best-in-class for ML workloads. You’ll gain hands-on experience building business-critical features, analyzing performance, developing compiler or kernel optimizations, and building tools that provide deep insights into model execution. You’ll be mentored by experienced engineers while working on technology that directly accelerates customer workloads at scale.
Locations
- Canada, ON, Toronto, Toronto, ON, Canada
Salary
Estimated Salary Rangehigh confidence
75,000 - 95,000 USD / yearly
Source: ai estimated
* This is an estimated range based on market data and may vary based on experience and qualifications.
Skills Required
- - Strong interests and academic qualifications/research focus in two of the following: 1. Knowledge of code generation, compute graph optimization, resource scheduling 2. Compiler - Optimizing compilers (internals of LLVM, clang, etc) 3. Machine Learning frameworks (PyTorch, JAX) and Machine Learning (Experience with XLA, TVM, MLIR, LLVM) 4. Kernel development—experience writing CUDA kernels, OpenCL kernels, or ML-specific kernelsintermediate
Required Qualifications
- - Are enrolled in a academic program that is physically located in Canada (experience)
- - Are enrolled in a Bachelor's degree or higher in Computer Science, Engineering Science, Computer Engineering, Electrical Engineering, or majors relating to these fields with an anticipated graduation date between May 2027 - May 2028 (degree in a bachelor)
- - Strong interests and academic qualifications/research focus in two of the following: 1. Knowledge of code generation, compute graph optimization, resource scheduling 2. Compiler - Optimizing compilers (internals of LLVM, clang, etc) 3. Machine Learning frameworks (PyTorch, JAX) and Machine Learning (Experience with XLA, TVM, MLIR, LLVM) 4. Kernel development—experience writing CUDA kernels, OpenCL kernels, or ML-specific kernels (experience)
- - Available for a 12-16-month internship starting May 2026 (experience)
Preferred Qualifications
- - Previous technical internship(s) related to the areas of interest / research focus listed above (experience)
- - Experience in optimization mathematics such as linear programming and nonlinear optimization (experience)
- - Academic coursework in Compiler Design/Construction, Programming Language Theory, Computer Architecture, Advanced Algorithms & Data Structures (experience)
Tags & Categories
Answer 10 quick questions to check your fit for 2026 ML Compiler Software Engineer PEY Co-op (12-16 months), AWS Neuron, Annapurna Labs @ Amazon.
10 Questions
~2 Minutes
Instant Score
Related Books and Jobs