Azure Databricks Engineer
Capgemini
Azure Databricks Engineer
Job Description
Azure Databricks Engineer
📋 Job Overview
The Azure Databricks Engineer role at Capgemini involves designing and developing end-to-end data pipelines using Azure technologies like Data Factory, Databricks, and PySpark. The position focuses on building and optimizing ETL workflows, ensuring data quality, and managing secure access in an Agile environment. This role offers opportunities to work on innovative projects within a collaborative, inclusive company committed to technology-driven sustainability.
📍 Location: Bangalore
💼 Experience Level: Experienced Professionals
🏢 Business Unit: I and D Global Business Line
🎯 Key Responsibilities
- Designing and developing end-to-end data pipelines using Azure Data Factory and Databricks, PySpark, SQL, Delta Lake, Azure Data Lake
- Building and optimizing ETL workflows for ingestion, transformation, and loading of structured and semi-structured data into Azure Synapse Analytics and ADLS
- Implementing data validation and quality frameworks to ensure data reliability
- Writing efficient PySpark and SQL code for complex transformations, aggregations, and performance tuning
- Managing secure access using Azure Key Vault, role-based permissions, and compliance best practices
- Working in an Agile/Scrum environment, delivering solutions aligned with business needs
✅ Required Qualifications
- 4+ years of experience in Azure Databricks with strong PySpark experience
- Experience with Azure Data Bricks, Data Factory
- Experience with Azure Data components such as Azure SQL Database, Azure SQL Warehouse, Synapse Analytics
- Experience in Python/PySpark/Scala/Hive Programming
- Experience with Azure Databricks/ADB
- Experience with building CI/CD pipelines in Data environments
🛠️ Required Skills
- Azure Databricks
- PySpark
- SQL
- Delta Lake
- Azure Data Lake
- Azure Data Factory
- Azure Synapse Analytics
- ADLS
- Azure SQL Database
- Azure SQL Warehouse
- Python
- Scala
- Hive Programming
- Azure Key Vault
- Role-based permissions
- Compliance best practices
- CI/CD pipelines
- Agile/Scrum
- Judgement skills
- Collaboration skills
- Interaction with multi-cultural and multi-functional teams
🎁 Benefits & Perks
- Opportunity to make a difference for leading businesses and society
- Support to shape your career
- Part of a diverse collective of free-thinkers, entrepreneurs, and experts
- Exponential career growth through innovative projects and extensive Learning & Development programs
- Inclusive, safe, healthy, and flexible work environment
- Active role in Corporate Social Responsibility and Sustainability initiatives
Locations
- Bangalore, India
Salary
Estimated Salary Rangemedium confidence
2,500,000 - 4,200,000 INR / yearly
Source: ai estimated
* This is an estimated range based on market data and may vary based on experience and qualifications.
Skills Required
- Azure Databricksintermediate
- PySparkintermediate
- SQLintermediate
- Delta Lakeintermediate
- Azure Data Lakeintermediate
- Azure Data Factoryintermediate
- Azure Synapse Analyticsintermediate
- ADLSintermediate
- Azure SQL Databaseintermediate
- Azure SQL Warehouseintermediate
- Pythonintermediate
- Scalaintermediate
- Hive Programmingintermediate
- Azure Key Vaultintermediate
- Role-based permissionsintermediate
- Compliance best practicesintermediate
- CI/CD pipelinesintermediate
- Agile/Scrumintermediate
- Judgement skillsintermediate
- Collaboration skillsintermediate
- Interaction with multi-cultural and multi-functional teamsintermediate
Required Qualifications
- 4+ years of experience in Azure Databricks with strong PySpark experience (experience)
- Experience with Azure Data Bricks, Data Factory (experience)
- Experience with Azure Data components such as Azure SQL Database, Azure SQL Warehouse, Synapse Analytics (experience)
- Experience in Python/PySpark/Scala/Hive Programming (experience)
- Experience with Azure Databricks/ADB (experience)
- Experience with building CI/CD pipelines in Data environments (experience)
Responsibilities
- Designing and developing end-to-end data pipelines using Azure Data Factory and Databricks, PySpark, SQL, Delta Lake, Azure Data Lake
- Building and optimizing ETL workflows for ingestion, transformation, and loading of structured and semi-structured data into Azure Synapse Analytics and ADLS
- Implementing data validation and quality frameworks to ensure data reliability
- Writing efficient PySpark and SQL code for complex transformations, aggregations, and performance tuning
- Managing secure access using Azure Key Vault, role-based permissions, and compliance best practices
- Working in an Agile/Scrum environment, delivering solutions aligned with business needs
Benefits
- general: Opportunity to make a difference for leading businesses and society
- general: Support to shape your career
- general: Part of a diverse collective of free-thinkers, entrepreneurs, and experts
- general: Exponential career growth through innovative projects and extensive Learning & Development programs
- general: Inclusive, safe, healthy, and flexible work environment
- general: Active role in Corporate Social Responsibility and Sustainability initiatives
Tags & Categories
Answer 10 quick questions to check your fit for Azure Databricks Engineer @ Capgemini.
10 Questions
~2 Minutes
Instant Score
Related Books and Jobs
Azure Databricks Engineer
Capgemini
Azure Databricks Engineer
Job Description
Azure Databricks Engineer
📋 Job Overview
The Azure Databricks Engineer role at Capgemini involves designing and developing end-to-end data pipelines using Azure technologies like Data Factory, Databricks, and PySpark. The position focuses on building and optimizing ETL workflows, ensuring data quality, and managing secure access in an Agile environment. This role offers opportunities to work on innovative projects within a collaborative, inclusive company committed to technology-driven sustainability.
📍 Location: Bangalore
💼 Experience Level: Experienced Professionals
🏢 Business Unit: I and D Global Business Line
🎯 Key Responsibilities
- Designing and developing end-to-end data pipelines using Azure Data Factory and Databricks, PySpark, SQL, Delta Lake, Azure Data Lake
- Building and optimizing ETL workflows for ingestion, transformation, and loading of structured and semi-structured data into Azure Synapse Analytics and ADLS
- Implementing data validation and quality frameworks to ensure data reliability
- Writing efficient PySpark and SQL code for complex transformations, aggregations, and performance tuning
- Managing secure access using Azure Key Vault, role-based permissions, and compliance best practices
- Working in an Agile/Scrum environment, delivering solutions aligned with business needs
✅ Required Qualifications
- 4+ years of experience in Azure Databricks with strong PySpark experience
- Experience with Azure Data Bricks, Data Factory
- Experience with Azure Data components such as Azure SQL Database, Azure SQL Warehouse, Synapse Analytics
- Experience in Python/PySpark/Scala/Hive Programming
- Experience with Azure Databricks/ADB
- Experience with building CI/CD pipelines in Data environments
🛠️ Required Skills
- Azure Databricks
- PySpark
- SQL
- Delta Lake
- Azure Data Lake
- Azure Data Factory
- Azure Synapse Analytics
- ADLS
- Azure SQL Database
- Azure SQL Warehouse
- Python
- Scala
- Hive Programming
- Azure Key Vault
- Role-based permissions
- Compliance best practices
- CI/CD pipelines
- Agile/Scrum
- Judgement skills
- Collaboration skills
- Interaction with multi-cultural and multi-functional teams
🎁 Benefits & Perks
- Opportunity to make a difference for leading businesses and society
- Support to shape your career
- Part of a diverse collective of free-thinkers, entrepreneurs, and experts
- Exponential career growth through innovative projects and extensive Learning & Development programs
- Inclusive, safe, healthy, and flexible work environment
- Active role in Corporate Social Responsibility and Sustainability initiatives
Locations
- Bangalore, India
Salary
Estimated Salary Rangemedium confidence
2,500,000 - 4,200,000 INR / yearly
Source: ai estimated
* This is an estimated range based on market data and may vary based on experience and qualifications.
Skills Required
- Azure Databricksintermediate
- PySparkintermediate
- SQLintermediate
- Delta Lakeintermediate
- Azure Data Lakeintermediate
- Azure Data Factoryintermediate
- Azure Synapse Analyticsintermediate
- ADLSintermediate
- Azure SQL Databaseintermediate
- Azure SQL Warehouseintermediate
- Pythonintermediate
- Scalaintermediate
- Hive Programmingintermediate
- Azure Key Vaultintermediate
- Role-based permissionsintermediate
- Compliance best practicesintermediate
- CI/CD pipelinesintermediate
- Agile/Scrumintermediate
- Judgement skillsintermediate
- Collaboration skillsintermediate
- Interaction with multi-cultural and multi-functional teamsintermediate
Required Qualifications
- 4+ years of experience in Azure Databricks with strong PySpark experience (experience)
- Experience with Azure Data Bricks, Data Factory (experience)
- Experience with Azure Data components such as Azure SQL Database, Azure SQL Warehouse, Synapse Analytics (experience)
- Experience in Python/PySpark/Scala/Hive Programming (experience)
- Experience with Azure Databricks/ADB (experience)
- Experience with building CI/CD pipelines in Data environments (experience)
Responsibilities
- Designing and developing end-to-end data pipelines using Azure Data Factory and Databricks, PySpark, SQL, Delta Lake, Azure Data Lake
- Building and optimizing ETL workflows for ingestion, transformation, and loading of structured and semi-structured data into Azure Synapse Analytics and ADLS
- Implementing data validation and quality frameworks to ensure data reliability
- Writing efficient PySpark and SQL code for complex transformations, aggregations, and performance tuning
- Managing secure access using Azure Key Vault, role-based permissions, and compliance best practices
- Working in an Agile/Scrum environment, delivering solutions aligned with business needs
Benefits
- general: Opportunity to make a difference for leading businesses and society
- general: Support to shape your career
- general: Part of a diverse collective of free-thinkers, entrepreneurs, and experts
- general: Exponential career growth through innovative projects and extensive Learning & Development programs
- general: Inclusive, safe, healthy, and flexible work environment
- general: Active role in Corporate Social Responsibility and Sustainability initiatives
Tags & Categories
Answer 10 quick questions to check your fit for Azure Databricks Engineer @ Capgemini.
10 Questions
~2 Minutes
Instant Score
Related Books and Jobs