Big Data Engineer with Spark
IBM
Big Data Engineer with Spark
Job Description
Big Data Engineer with Spark
📋 Job Overview
Join IBM as a Big Data Engineer with Spark in our IT Digital Marketing Solutions team. You will develop dynamic software solutions and work in our Consulting Client Innovation Centers, delivering technical expertise to a global client base. Drive innovation and adoption of new technology in this role.
📍 Location: Multiple Locations (Remote/Hybrid)
💼 Career Level: Professional
🎯 Key Responsibilities
- Writing effective and scalable data processing code using Spark with Scala or Java
- Debugging applications to ensure low-latency and high-availability using Docker or Kubernetes
- Interfacing with developed API and building Rest API
- Implementing and refactoring ETL processes with Airflow
- Implementing security and data protection with HVault
- Accommodating various data storage solutions including COS API and Cassandra
✅ Required Qualifications
- Proficiency in data processing with Apache Spark using Scala or Java
- Experience in implementing and refactoring ETL processes with Airflow or Python
- Experience in implementing security and data protection with HVault
- Previous work experience with SQL, COS API, Cassandra
🛠️ Required Skills
- Apache Spark
- Scala
- Java
- Docker
- Kubernetes
- Rest API
- ETL
- Airflow
- Python
- HVault
- SQL
- COS API
- Cassandra
- Data processing
- Security
- Data protection
- Data storage solutions
🎁 Benefits & Perks
- Opportunity to learn and develop career
- Encouragement to be courageous and experiment daily
- Continuous trust and support in a thriving environment
- Flexible working patterns
- Equal-opportunity employment
Locations
- Multiple Locations, India (Remote)
Salary
Estimated Salary Rangemedium confidence
2,500,000 - 4,200,000 INR / yearly
Source: ai estimated
* This is an estimated range based on market data and may vary based on experience and qualifications.
Skills Required
- Apache Sparkintermediate
- Scalaintermediate
- Javaintermediate
- Dockerintermediate
- Kubernetesintermediate
- Rest APIintermediate
- ETLintermediate
- Airflowintermediate
- Pythonintermediate
- HVaultintermediate
- SQLintermediate
- COS APIintermediate
- Cassandraintermediate
- Data processingintermediate
- Securityintermediate
- Data protectionintermediate
- Data storage solutionsintermediate
Required Qualifications
- Proficiency in data processing with Apache Spark using Scala or Java (experience)
- Experience in implementing and refactoring ETL processes with Airflow or Python (experience)
- Experience in implementing security and data protection with HVault (experience)
- Previous work experience with SQL, COS API, Cassandra (experience)
Responsibilities
- Writing effective and scalable data processing code using Spark with Scala or Java
- Debugging applications to ensure low-latency and high-availability using Docker or Kubernetes
- Interfacing with developed API and building Rest API
- Implementing and refactoring ETL processes with Airflow
- Implementing security and data protection with HVault
- Accommodating various data storage solutions including COS API and Cassandra
Benefits
- general: Opportunity to learn and develop career
- general: Encouragement to be courageous and experiment daily
- general: Continuous trust and support in a thriving environment
- general: Flexible working patterns
- general: Equal-opportunity employment
Tags & Categories
Big Data Engineer with Spark
IBM
Big Data Engineer with Spark
Job Description
Big Data Engineer with Spark
📋 Job Overview
Join IBM as a Big Data Engineer with Spark in our IT Digital Marketing Solutions team. You will develop dynamic software solutions and work in our Consulting Client Innovation Centers, delivering technical expertise to a global client base. Drive innovation and adoption of new technology in this role.
📍 Location: Multiple Locations (Remote/Hybrid)
💼 Career Level: Professional
🎯 Key Responsibilities
- Writing effective and scalable data processing code using Spark with Scala or Java
- Debugging applications to ensure low-latency and high-availability using Docker or Kubernetes
- Interfacing with developed API and building Rest API
- Implementing and refactoring ETL processes with Airflow
- Implementing security and data protection with HVault
- Accommodating various data storage solutions including COS API and Cassandra
✅ Required Qualifications
- Proficiency in data processing with Apache Spark using Scala or Java
- Experience in implementing and refactoring ETL processes with Airflow or Python
- Experience in implementing security and data protection with HVault
- Previous work experience with SQL, COS API, Cassandra
🛠️ Required Skills
- Apache Spark
- Scala
- Java
- Docker
- Kubernetes
- Rest API
- ETL
- Airflow
- Python
- HVault
- SQL
- COS API
- Cassandra
- Data processing
- Security
- Data protection
- Data storage solutions
🎁 Benefits & Perks
- Opportunity to learn and develop career
- Encouragement to be courageous and experiment daily
- Continuous trust and support in a thriving environment
- Flexible working patterns
- Equal-opportunity employment
Locations
- Multiple Locations, India (Remote)
Salary
Estimated Salary Rangemedium confidence
2,500,000 - 4,200,000 INR / yearly
Source: ai estimated
* This is an estimated range based on market data and may vary based on experience and qualifications.
Skills Required
- Apache Sparkintermediate
- Scalaintermediate
- Javaintermediate
- Dockerintermediate
- Kubernetesintermediate
- Rest APIintermediate
- ETLintermediate
- Airflowintermediate
- Pythonintermediate
- HVaultintermediate
- SQLintermediate
- COS APIintermediate
- Cassandraintermediate
- Data processingintermediate
- Securityintermediate
- Data protectionintermediate
- Data storage solutionsintermediate
Required Qualifications
- Proficiency in data processing with Apache Spark using Scala or Java (experience)
- Experience in implementing and refactoring ETL processes with Airflow or Python (experience)
- Experience in implementing security and data protection with HVault (experience)
- Previous work experience with SQL, COS API, Cassandra (experience)
Responsibilities
- Writing effective and scalable data processing code using Spark with Scala or Java
- Debugging applications to ensure low-latency and high-availability using Docker or Kubernetes
- Interfacing with developed API and building Rest API
- Implementing and refactoring ETL processes with Airflow
- Implementing security and data protection with HVault
- Accommodating various data storage solutions including COS API and Cassandra
Benefits
- general: Opportunity to learn and develop career
- general: Encouragement to be courageous and experiment daily
- general: Continuous trust and support in a thriving environment
- general: Flexible working patterns
- general: Equal-opportunity employment
Tags & Categories