Skill: Azure Databricks with Pyspark

Experience: 6 to 13 Yrs

Location: AIA Kolkata

Job description

Responsibilities:

• Designing, building, and deploying data pipelines and workflows using Databricks.
• Developing and optimizing Apache Spark applications for data processing and analytics.
• Integrating Databricks with various data sources and platforms.
• Implementing data quality checks and monitoring processes.
• Managing and configuring the Databricks environment, including clusters and notebooks.
• Troubleshooting and resolving issues related to Databricks performance and functionality.
• Collaborating with data scientists and analysts to implement machine learning models.
• Staying up-to-date with the latest Databricks features and best practices.

Qualifications:

• Strong proficiency in Python or Scala programming languages.
• Experience with Apache Spark and big data processing frameworks.
• Knowledge of cloud platforms like AWS, Azure, or GCP.
• Familiarity with data warehousing and ETL processes.
• Understanding of machine learning concepts and algorithms.
• Strong problem-solving and analytical skills.

Additional Skills (depending on the specific role):

• Experience with Databricks Delta Lake or MLflow.
• Knowledge of infrastructure as code (IaC) tools like Terraform.
• Familiarity with CI/CD pipelines for data and machine learning workflows.
• Experience with containerization technologies like Docker.

The Cognizant community:
We are a high caliber team who appreciate and support one another. Our people uphold an energetic, collaborative and inclusive workplace where everyone can thrive.

• Cognizant is a global community with more than 300,000 associates around the world.
• We don’t just dream of a better way – we make it happen.
• We take care of our people, clients, company, communities and climate by doing what’s right.
• We foster an innovative environment where you can build the career path that’s right for you.

About us:
Cognizant is one of the world's leading professional services companies, transforming clients' business, operating, and technology models for the digital era. Our unique industry-based, consultative approach helps clients envision, build, and run more innovative and efficient businesses. Headquartered in the U.S., Cognizant (a member of the NASDAQ-100 and one of Forbes World’s Best Employers 2025) is consistently listed among the most admired companies in the world. Learn how Cognizant helps clients lead with digital at www.cognizant.com

Cognizant is an equal opportunity employer. Your application and candidacy will not be considered based on race, color, sex, religion, creed, sexual orientation, gender identity, national origin, disability, genetic information, pregnancy, veteran status or any other characteristic protected by federal, state or local laws.

If you have a disability that requires reasonable accommodation to search for a job opening or submit an application, please email CareersNA2@cognizant.com with your request and contact information.

Disclaimer:
Compensation information is accurate as of the date of this posting. Cognizant reserves the right to modify this information at any time, subject to applicable law.

Applicants may be required to attend interviews in person or by video conference. In addition, candidates may be required to present their current state or government issued ID during each interview.