Overview

As a Principal Software Engineer (IC4) at Oracle, you will design and implement scalable, distributed systems powering LLMs and agent-based workflows. Collaborate with applied scientists, ML engineers, and software teams to deliver high-performance AI infrastructure. This high-impact role offers growth in large-scale systems and advanced AI technologies.

Responsibilities

• Architect scalable distributed systems for LLM inference and agent orchestration.
• Lead design and implementation of high-throughput, low-latency AI services.
• Optimize system performance for massive-scale AI workloads.
• Collaborate with ML teams to integrate models into production environments.
• Develop robust APIs and microservices for AI platform extensibility.
• Mentor engineers and drive technical best practices across teams.
• Implement fault-tolerant systems with advanced monitoring and observability.
• Contribute to open-source projects and internal tools for AI infrastructure.

Qualifications

• 10+ years of software engineering experience in distributed systems.
• Expertise in cloud platforms (OCI, AWS, GCP) and container orchestration (Kubernetes).
• Strong proficiency in Java, Python, Go, or C++ for high-performance systems.
• Experience with LLMs, vector databases, and agentic AI workflows.
• Proven track record scaling systems to millions of users/requests.
• Excellent problem-solving and cross-functional collaboration skills.

Benefits

• Competitive salary and equity in Oracle's high-growth AI division.
• Comprehensive health, dental, and vision insurance.
• 401(k) matching and employee stock purchase program.
• Flexible PTO and remote/hybrid work options across US locations.
• Professional development stipend and conference attendance.