Senior Big Data Engineer with Spark
IBM
Senior Big Data Engineer with Spark
Job Description
Senior Big Data Engineer with Spark
📋 Job Overview
Join IBM as a Senior Big Data Engineer with Spark in our IT Digital Marketing Solutions team. You will develop dynamic software solutions and work in our Consulting Client Innovation Centers, delivering technical expertise to a global clientele. Drive innovation and adoption of new technology in this dynamic role.
📍 Location: Multiple Locations (Remote/Hybrid)
💼 Career Level: Professional
🎯 Key Responsibilities
- Writing effective and scalable data processing code using Spark with Scala or Java
- Debugging applications to ensure low-latency and high-availability using Docker or Kubernetes
- Interfacing with developed API and building Rest API
- Implementing and refactoring ETL processes with Airflow
- Implementing security and data protection with HVault
- Accommodating various data storage solutions including COS API and Cassandra
✅ Required Qualifications
- Proficiency in data processing with Apache Spark using Scala or Java
- Experience in implementing and refactoring ETL processes with Airflow or Python
- Experience in implementing security and data protection with HVault
- Previous work experience with SQL, COS API, Cassandra
🛠️ Required Skills
- Apache Spark
- Scala
- Java
- Docker
- Kubernetes
- Rest API
- ETL
- Airflow
- Python
- HVault
- SQL
- COS API
- Cassandra
- Data processing
- Security
- Data protection
- Data storage solutions
🎁 Benefits & Perks
- Opportunity to learn and develop career
- Encouragement to be courageous and experiment daily
- Continuous trust and support in a thriving environment
- Flexible working patterns
- Equal-opportunity employment
Locations
- Multiple Locations, India (Remote)
Salary
Estimated Salary Rangemedium confidence
2,500,000 - 4,200,000 INR / yearly
Source: ai estimated
* This is an estimated range based on market data and may vary based on experience and qualifications.
Skills Required
- Apache Sparkintermediate
- Scalaintermediate
- Javaintermediate
- Dockerintermediate
- Kubernetesintermediate
- Rest APIintermediate
- ETLintermediate
- Airflowintermediate
- Pythonintermediate
- HVaultintermediate
- SQLintermediate
- COS APIintermediate
- Cassandraintermediate
- Data processingintermediate
- Securityintermediate
- Data protectionintermediate
- Data storage solutionsintermediate
Required Qualifications
- Proficiency in data processing with Apache Spark using Scala or Java (experience)
- Experience in implementing and refactoring ETL processes with Airflow or Python (experience)
- Experience in implementing security and data protection with HVault (experience)
- Previous work experience with SQL, COS API, Cassandra (experience)
Responsibilities
- Writing effective and scalable data processing code using Spark with Scala or Java
- Debugging applications to ensure low-latency and high-availability using Docker or Kubernetes
- Interfacing with developed API and building Rest API
- Implementing and refactoring ETL processes with Airflow
- Implementing security and data protection with HVault
- Accommodating various data storage solutions including COS API and Cassandra
Benefits
- general: Opportunity to learn and develop career
- general: Encouragement to be courageous and experiment daily
- general: Continuous trust and support in a thriving environment
- general: Flexible working patterns
- general: Equal-opportunity employment
Tags & Categories
Senior Big Data Engineer with Spark
IBM
Senior Big Data Engineer with Spark
Job Description
Senior Big Data Engineer with Spark
📋 Job Overview
Join IBM as a Senior Big Data Engineer with Spark in our IT Digital Marketing Solutions team. You will develop dynamic software solutions and work in our Consulting Client Innovation Centers, delivering technical expertise to a global clientele. Drive innovation and adoption of new technology in this dynamic role.
📍 Location: Multiple Locations (Remote/Hybrid)
💼 Career Level: Professional
🎯 Key Responsibilities
- Writing effective and scalable data processing code using Spark with Scala or Java
- Debugging applications to ensure low-latency and high-availability using Docker or Kubernetes
- Interfacing with developed API and building Rest API
- Implementing and refactoring ETL processes with Airflow
- Implementing security and data protection with HVault
- Accommodating various data storage solutions including COS API and Cassandra
✅ Required Qualifications
- Proficiency in data processing with Apache Spark using Scala or Java
- Experience in implementing and refactoring ETL processes with Airflow or Python
- Experience in implementing security and data protection with HVault
- Previous work experience with SQL, COS API, Cassandra
🛠️ Required Skills
- Apache Spark
- Scala
- Java
- Docker
- Kubernetes
- Rest API
- ETL
- Airflow
- Python
- HVault
- SQL
- COS API
- Cassandra
- Data processing
- Security
- Data protection
- Data storage solutions
🎁 Benefits & Perks
- Opportunity to learn and develop career
- Encouragement to be courageous and experiment daily
- Continuous trust and support in a thriving environment
- Flexible working patterns
- Equal-opportunity employment
Locations
- Multiple Locations, India (Remote)
Salary
Estimated Salary Rangemedium confidence
2,500,000 - 4,200,000 INR / yearly
Source: ai estimated
* This is an estimated range based on market data and may vary based on experience and qualifications.
Skills Required
- Apache Sparkintermediate
- Scalaintermediate
- Javaintermediate
- Dockerintermediate
- Kubernetesintermediate
- Rest APIintermediate
- ETLintermediate
- Airflowintermediate
- Pythonintermediate
- HVaultintermediate
- SQLintermediate
- COS APIintermediate
- Cassandraintermediate
- Data processingintermediate
- Securityintermediate
- Data protectionintermediate
- Data storage solutionsintermediate
Required Qualifications
- Proficiency in data processing with Apache Spark using Scala or Java (experience)
- Experience in implementing and refactoring ETL processes with Airflow or Python (experience)
- Experience in implementing security and data protection with HVault (experience)
- Previous work experience with SQL, COS API, Cassandra (experience)
Responsibilities
- Writing effective and scalable data processing code using Spark with Scala or Java
- Debugging applications to ensure low-latency and high-availability using Docker or Kubernetes
- Interfacing with developed API and building Rest API
- Implementing and refactoring ETL processes with Airflow
- Implementing security and data protection with HVault
- Accommodating various data storage solutions including COS API and Cassandra
Benefits
- general: Opportunity to learn and develop career
- general: Encouragement to be courageous and experiment daily
- general: Continuous trust and support in a thriving environment
- general: Flexible working patterns
- general: Equal-opportunity employment
Tags & Categories