Senior / Staff Software Engineer (Spark, Kafka, Iceberg), Apple Data Platform
Apple
Senior / Staff Software Engineer (Spark, Kafka, Iceberg), Apple Data Platform
Job Description
Seeking extraordinary software engineers with deep experience in scalable streaming processing systems. You will have a passion to push the limits of distributed stateful streaming computing frameworks to get every ounce of performance out of them. Looking for engineers with in depth knowledge of systems like Spark, Beam, Kafka, Iceberg and other existing frameworks. Also someone who will be passionate by the prospect of working reciprocally with other groups internal to Apple and also communities outside Apple. As an engineer on our team, you will advance our data infrastructure, driving innovation by implementing cutting-edge capabilities and tools that will power Apple Services Engineering. You’ll collaborate closely with a dedicated team of open source data experts (including Spark, Kafka, Iceberg committers amongst others) to enhance and automate our infrastructure, ensuring seamless management across both data centers and cloud services. Your work will directly contribute to the resilience, scalability, and performance of the systems that support millions of users worldwide.
Locations
- Cupertino, California, United States 95014
Salary
Estimated Salary Rangemedium confidence
40,000,000 - 80,000,000 INR / yearly
Source: ai estimated
* This is an estimated range based on market data and may vary based on experience and qualifications.
Skills Required
- experience in scalable streaming processing systemsintermediate
- passion for distributed stateful streaming computing frameworksintermediate
- knowledge of Sparkintermediate
- knowledge of Beamintermediate
- knowledge of Kafkaintermediate
- knowledge of Icebergintermediate
- working reciprocally with internal groupsintermediate
- working with external communitiesintermediate
- advancing data infrastructureintermediate
- driving innovationintermediate
- implementing cutting-edge capabilitiesintermediate
- collaborating with open source data expertsintermediate
- enhancing infrastructureintermediate
- automating infrastructureintermediate
- ensuring seamless management across data centers and cloud servicesintermediate
- contributing to system resilienceintermediate
- contributing to system scalabilityintermediate
- contributing to system performanceintermediate
Required Qualifications
- 8+ years of professional experience professional experience. (experience, 8 years)
- A successful track-record or demonstrated aptitude as an engineer who has worked on distributed systems. (experience)
- Experienced Poweruser (at least 2 years of running production applications) of Apache Spark or Committer to Apache Spark. (experience, 2 years)
- BS or MS degree in computer science or equivalent (degree in ms degree in computer science or equivalent)
Preferred Qualifications
- Good knowledge of Apache Iceberg and Apache Kafka. (experience)
- Experience working on or building connectors from Spark to any of the data sources. (experience)
- Knowledge of Yarn, Kubernetes or other compute substrate. (experience)
Responsibilities
- As an engineer on our team, you will advance our data infrastructure, driving innovation by implementing cutting-edge capabilities and tools that will power Apple Services Engineering. You’ll collaborate closely with a dedicated team of open source data experts (including Spark, Kafka, Iceberg committers amongst others) to enhance and automate our infrastructure, ensuring seamless management across both data centers and cloud services. Your work will directly contribute to the resilience, scalability, and performance of the systems that support millions of users worldwide.
- What you can expect to do and contribute to:
- Develop and deploy new features of Apple’s internal data platform.
- Regularly contribute to open source.
- Collaborate with cross-functional teams to design and implement automation tools that streamline operations and reduce manual intervention.
- Optimize our cloud-based services to ensure they scale effectively, handling increasing loads while maintaining high performance.
- Innovate on API development and integration, enabling seamless communication between our applications and services
- This is an opportunity to join a dynamic and evolving team where your contributions will shape the future of our Apple’s technology landscape.
Tags & Categories
Senior / Staff Software Engineer (Spark, Kafka, Iceberg), Apple Data Platform
Apple
Senior / Staff Software Engineer (Spark, Kafka, Iceberg), Apple Data Platform
Job Description
Seeking extraordinary software engineers with deep experience in scalable streaming processing systems. You will have a passion to push the limits of distributed stateful streaming computing frameworks to get every ounce of performance out of them. Looking for engineers with in depth knowledge of systems like Spark, Beam, Kafka, Iceberg and other existing frameworks. Also someone who will be passionate by the prospect of working reciprocally with other groups internal to Apple and also communities outside Apple. As an engineer on our team, you will advance our data infrastructure, driving innovation by implementing cutting-edge capabilities and tools that will power Apple Services Engineering. You’ll collaborate closely with a dedicated team of open source data experts (including Spark, Kafka, Iceberg committers amongst others) to enhance and automate our infrastructure, ensuring seamless management across both data centers and cloud services. Your work will directly contribute to the resilience, scalability, and performance of the systems that support millions of users worldwide.
Locations
- Cupertino, California, United States 95014
Salary
Estimated Salary Rangemedium confidence
40,000,000 - 80,000,000 INR / yearly
Source: ai estimated
* This is an estimated range based on market data and may vary based on experience and qualifications.
Skills Required
- experience in scalable streaming processing systemsintermediate
- passion for distributed stateful streaming computing frameworksintermediate
- knowledge of Sparkintermediate
- knowledge of Beamintermediate
- knowledge of Kafkaintermediate
- knowledge of Icebergintermediate
- working reciprocally with internal groupsintermediate
- working with external communitiesintermediate
- advancing data infrastructureintermediate
- driving innovationintermediate
- implementing cutting-edge capabilitiesintermediate
- collaborating with open source data expertsintermediate
- enhancing infrastructureintermediate
- automating infrastructureintermediate
- ensuring seamless management across data centers and cloud servicesintermediate
- contributing to system resilienceintermediate
- contributing to system scalabilityintermediate
- contributing to system performanceintermediate
Required Qualifications
- 8+ years of professional experience professional experience. (experience, 8 years)
- A successful track-record or demonstrated aptitude as an engineer who has worked on distributed systems. (experience)
- Experienced Poweruser (at least 2 years of running production applications) of Apache Spark or Committer to Apache Spark. (experience, 2 years)
- BS or MS degree in computer science or equivalent (degree in ms degree in computer science or equivalent)
Preferred Qualifications
- Good knowledge of Apache Iceberg and Apache Kafka. (experience)
- Experience working on or building connectors from Spark to any of the data sources. (experience)
- Knowledge of Yarn, Kubernetes or other compute substrate. (experience)
Responsibilities
- As an engineer on our team, you will advance our data infrastructure, driving innovation by implementing cutting-edge capabilities and tools that will power Apple Services Engineering. You’ll collaborate closely with a dedicated team of open source data experts (including Spark, Kafka, Iceberg committers amongst others) to enhance and automate our infrastructure, ensuring seamless management across both data centers and cloud services. Your work will directly contribute to the resilience, scalability, and performance of the systems that support millions of users worldwide.
- What you can expect to do and contribute to:
- Develop and deploy new features of Apple’s internal data platform.
- Regularly contribute to open source.
- Collaborate with cross-functional teams to design and implement automation tools that streamline operations and reduce manual intervention.
- Optimize our cloud-based services to ensure they scale effectively, handling increasing loads while maintaining high performance.
- Innovate on API development and integration, enabling seamless communication between our applications and services
- This is an opportunity to join a dynamic and evolving team where your contributions will shape the future of our Apple’s technology landscape.
Tags & Categories