Snowflake: Senior/Staff Software Engineer - Machine Learning Platform (Inference)

Role Overview

Snowflake is revolutionizing the data landscape, empowering enterprises to unlock the full potential of their data. We are seeking a highly skilled and motivated Senior/Staff Software Engineer to join our Machine Learning Platform team, focusing on inference. In this role, you will be instrumental in building the next-generation platform that enables our customers to seamlessly integrate machine learning and deep learning workloads into Snowflake. You will tackle challenges related to infrastructure optimization, orchestration, performance, and security, ultimately delivering a secure, simple, and integrated solution for end-to-end ML workflows. This is an exceptional opportunity to define strategies, set technical directions, and drive innovation in the rapidly evolving field of AI.

Day in the Life

As a Senior/Staff Software Engineer on the Machine Learning Platform team, your day will be dynamic and impactful. You will collaborate closely with senior architects, product managers, and team leaders to define and own the roadmap for our ML platform. A typical day might involve:

• Participating in technical design discussions and contributing to the overall architecture of the ML platform.
• Writing high-quality code to implement new features and improve existing functionality.
• Conducting code reviews and providing constructive feedback to other team members.
• Working with inference engines like vLLM, TensorRT-LLM, TEI, and SGLang, understanding their tradeoffs, and optimizing them for performance.
• Serving fine-tuned LLMs (PEFT, DPO, RL) and experimenting with different optimization techniques.
• Collaborating with data scientists to understand their needs and build tools to support their workflows.
• Monitoring and troubleshooting production systems to ensure reliability and performance.
• Researching and evaluating new technologies and techniques in the field of machine learning.
• Presenting your work to the team and other stakeholders.
• Mentoring junior engineers and providing guidance on technical challenges.

Why Menlo Park/Bellevue?

This position is based in either Menlo Park, CA, or Bellevue, WA, both vibrant hubs for technology and innovation. Menlo Park, located in the heart of Silicon Valley, offers unparalleled access to a thriving ecosystem of startups, established tech companies, and venture capital firms. Bellevue, WA, is a rapidly growing tech center with a strong concentration of cloud computing and software companies. Both locations offer a high quality of life, with access to excellent schools, diverse cultural attractions, and abundant outdoor recreational opportunities.

Menlo Park, CA:

• Proximity to Silicon Valley: Be at the epicenter of technological innovation, with countless networking and learning opportunities.
• Vibrant Culture: Enjoy a diverse and stimulating environment with a mix of tech professionals and academics.
• Access to Funding: Be close to venture capital firms and potential investors, fostering opportunities for entrepreneurial ventures.
• Career Growth: Benefit from the concentration of tech companies, offering numerous career advancement prospects.

Bellevue, WA:

• Growing Tech Hub: Be part of a rapidly expanding technology scene with a focus on cloud computing.
• High Quality of Life: Enjoy a balance between urban amenities and access to stunning natural landscapes.
• Strong Education System: Benefit from excellent schools and universities, fostering a talented workforce.
• Outdoor Recreation: Explore numerous hiking trails, parks, and waterfront activities.

Career Path

At Snowflake, we are committed to providing our employees with opportunities for growth and development. As a Senior/Staff Software Engineer, you can advance your career along several paths, including:

• Technical Leadership: Become a Principal Engineer or Architect, leading technical direction and mentoring other engineers.
• Management: Transition into a management role, leading a team of engineers and driving the execution of key projects.
• Specialization: Deepen your expertise in a specific area of machine learning, such as inference optimization or distributed training.
• Product Management: Move into a product management role, defining the vision and strategy for our ML platform.

Salary & Benefits

Snowflake offers a competitive salary and benefits package, including:

• Competitive Salary: We offer salaries commensurate with experience and skills.
• Equity: You will receive equity in the company, aligning your interests with the success of Snowflake.
• Health Insurance: Comprehensive medical, dental, and vision insurance plans.
• Paid Time Off: Generous vacation, sick leave, and holidays.
• Parental Leave: Paid parental leave for new parents.
• 401(k): 401(k) plan with company matching.
• Professional Development: Opportunities for training, conferences, and certifications.
• Wellness Programs: Resources to support your physical and mental well-being.
• Employee Perks: Free snacks, drinks, and other employee perks.

Innovation Culture

Snowflake fosters a culture of innovation, collaboration, and impact. We encourage our employees to challenge ordinary thinking, push the boundaries of technology, and make a real difference for our customers. We believe that our success depends on the diversity of our people, ideas, and perspectives. We are committed to creating an inclusive environment where everyone feels valued and empowered to contribute their best work.

How to Apply

If you are passionate about machine learning, have a strong technical background, and are looking for an opportunity to make a significant impact, we encourage you to apply! Please submit your resume and cover letter through our online application portal. We look forward to hearing from you.

FAQ

What is Snowflake's core business?

Snowflake provides a cloud-based data platform that enables customers to store, process, and analyze vast amounts of data.

What are the key responsibilities of this role?

Defining the ML platform roadmap, incorporating new ML advances, ensuring operational excellence, and collaborating with other ML teams.

What qualifications are essential for this position?

7+ years of industry experience, a strong ML background, experience with LLMs and inference engines, and a BS/MS/PhD in Computer Science or related field.

What frameworks are beneficial to know?

SKLearn, XGBoost, PyTorch, Tensorflow, and MLflow are considered a plus.

Is experience with batch and real-time ML serving systems required?

Previous experience in building batch and real-time ML serving systems is preferred.

Where are the primary locations for this role?

This position is based in Menlo Park, CA, and Bellevue, WA.

What kind of culture does Snowflake promote?

Snowflake fosters a culture of innovation, collaboration, and impact.

What are some benefits of working at Snowflake?

Competitive salary, equity package, comprehensive health insurance, generous paid time off, and professional development opportunities.

How can I apply for this position?

Submit your resume and cover letter through our online application portal.

What opportunities for career growth are available?

You can advance into technical leadership, management, specialization, or product management roles.