Senior Software Engineer, Managed AI at Crusoe

Crusoe's mission is to accelerate the abundance of energy and intelligence. We’re crafting the engine that powers a world where people can create ambitiously with AI — without sacrificing scale, speed, or sustainability.

Be a part of the AI revolution with sustainable technology at Crusoe. Here, you'll drive meaningful innovation, make a tangible impact, and join a team that’s setting the pace for responsible, transformative cloud infrastructure.

About This Role

The Crusoe Cloud Managed AI team seeks an ambitious and experienced Senior Software Engineer to join their team. You'll have a pivotal role in shaping the architecture and scalability of our next-generation AI inference platform. You will lead the design and implementation of core systems for our AI services, including resilient fault-tolerant queues, model catalogs, and scheduling mechanisms optimized for cost and performance. This role gives you the opportunity to build and scale infrastructure capable of handling millions of API requests per second across thousands of customers.

From day one, you'll own critical subsystems for managed AI inference, helping to serve large language models (LLMs) to a global audience. As part of a dynamic, fast-growing team, you’ll collaborate cross-functionally, influence the long-term vision of the platform, and contribute to cutting-edge AI technologies. This is a unique opportunity to build a high-performance AI product that will be central to Crusoe's business growth.

This is an on-site role based in San Francisco, CA, or Sunnyvale, CA, requiring in-office presence.

What You’ll Be Working On

• Design and develop core infrastructure for the Managed AI platform:
  • Lead the design and implementation of resilient fault-tolerant queues, model catalogs, and scheduling mechanisms.
  • Build and optimize systems for high-volume AI inference, handling millions of API requests per second.
  • Develop and maintain core services for AI model deployment and management.
• Collaborate with cross-functional teams:
  • Work closely with product managers, data scientists, and other engineers to define and deliver AI services.
  • Integrate with other Crusoe Cloud services to provide a seamless user experience.
  • Collaborate with research and development teams to explore and implement new AI technologies.
• Ensure high availability and performance:
  • Design and implement systems with high availability, low latency, and fault tolerance.
  • Optimize performance across all stages of the AI inference pipeline, including model loading, execution, and response handling.
  • Continuously monitor and improve the performance and reliability of AI services.

What You’ll Bring to the Team

• Strong Engineering Foundations:
  • Advanced degree in Computer Science, Engineering, or a related field.
  • Proven experience in distributed systems design and implementation.
  • Expertise in using cloud-based services, such as elastic compute, object storage, virtual private networks, managed databases, etc.
  • Experience with container runtimes (e.g., Kubernetes) and microservices architectures.
  • Experience using REST APIs and common communication protocols, such as gRPC.
  • Demonstrated experience in the software development cycle and familiarity with CI/CD tools.
• AI/ML Expertise:
  • Experience in Generative AI (Large Language Models, Multimodal).
• Technical Skills:
  • Proficiency in Go, or a similar systems programming language.

A Day in the Life of a Senior Software Engineer at Crusoe

Imagine starting your day by reviewing the performance metrics of the AI inference platform. You'll analyze dashboards and identify potential bottlenecks or areas for optimization. Next, you might participate in a design meeting to discuss the architecture of a new feature for the model catalog. You'll collaborate with other engineers to brainstorm solutions and ensure the design aligns with the overall platform vision.

In the afternoon, you'll focus on coding and implementing a new scheduling mechanism for AI model deployment. You'll write clean, efficient code, and thoroughly test your changes before deploying them to production. You'll also participate in code reviews, providing feedback to your colleagues and ensuring code quality.

Throughout the day, you'll collaborate with product managers, data scientists, and other engineers to ensure the AI platform meets the needs of Crusoe's customers. You'll also stay up-to-date on the latest advancements in AI technology, exploring new tools and techniques that can improve the performance and capabilities of the platform.

Why San Francisco?

San Francisco is a global hub for technology and innovation, making it an ideal location for Crusoe's Managed AI team. The city boasts a vibrant ecosystem of startups, established tech companies, and research institutions, providing access to a wealth of talent and resources. San Francisco's proximity to Silicon Valley also allows for close collaboration with other industry leaders and access to cutting-edge technologies.

Beyond the professional benefits, San Francisco offers a high quality of life, with a diverse culture, world-class dining, and abundant outdoor activities. The city's mild climate and beautiful scenery make it an attractive place to live and work.

Career Path at Crusoe

Crusoe is committed to providing its employees with opportunities for growth and advancement. As a Senior Software Engineer, you'll have the opportunity to take on increasing levels of responsibility and leadership. You can progress to roles such as Staff Engineer, Principal Engineer, or Engineering Manager, depending on your interests and skills.

Crusoe also encourages its employees to pursue professional development opportunities, such as attending conferences, taking online courses, and participating in mentorship programs. The company is dedicated to fostering a culture of learning and growth, ensuring that its employees have the skills and knowledge they need to succeed.

Salary & Benefits

Crusoe offers a competitive salary and benefits package, commensurate with experience and qualifications. The salary range for this position in San Francisco is estimated to be $180,000 - $250,000 annually.

In addition to a competitive salary, Crusoe offers a comprehensive benefits package, including:

• Comprehensive health, dental, and vision insurance
• Generous paid time off and holidays
• 401(k) plan with company match
• Professional development opportunities
• Company-sponsored events and activities
• Commuter benefits
• Healthy snacks and drinks provided
• Employee assistance program

Crusoe Culture

Crusoe is a company that values innovation, collaboration, and sustainability. The company's culture is built on a foundation of respect, integrity, and a commitment to making a positive impact on the world. Crusoe's employees are passionate about using technology to solve some of the world's most pressing challenges.

The company fosters a collaborative and supportive work environment, where employees are encouraged to share ideas, learn from each other, and challenge the status quo. Crusoe is also committed to diversity and inclusion, creating a workplace where everyone feels welcome and valued.

How to Apply

If you are a highly motivated and experienced Senior Software Engineer with a passion for AI and a desire to make a difference, we encourage you to apply for this position. Please submit your resume and cover letter through the Crusoe careers website.

Frequently Asked Questions (FAQ)

1. What is Crusoe's mission? Crusoe's mission is to accelerate the abundance of energy and intelligence.
2. What is the location of this role? This is an on-site role based in San Francisco, CA, or Sunnyvale, CA.
3. What are the key responsibilities of this role? Designing and developing core infrastructure for the Managed AI platform, collaborating with cross-functional teams, and ensuring high availability and performance.
4. What skills are required for this role? Strong engineering foundations, AI/ML expertise, and proficiency in Go or a similar language.
5. What is the salary range for this position? The estimated salary range is $180,000 - $250,000 annually.
6. What benefits does Crusoe offer? Crusoe offers a comprehensive benefits package, including health, dental, and vision insurance, paid time off, and a 401(k) plan.
7. What is Crusoe's culture like? Crusoe has a culture of innovation, collaboration, and sustainability.
8. What are the career path opportunities at Crusoe? Employees can progress to roles such as Staff Engineer, Principal Engineer, or Engineering Manager.
9. How do I apply for this position? Please submit your resume and cover letter through the Crusoe careers website.
10. What is Crusoe Cloud Managed AI? Crusoe Cloud Managed AI provides cloud computing solutions, focused on AI applications, with sustainable, transformative cloud infrastructure.