Specialist Data/AI Engineering (Azure Databricks platform engineer)
AT&T
Specialist Data/AI Engineering (Azure Databricks platform engineer)
Job Description
Job Description:
Roles & Responsibilities
- Minimum 6+ years of experience in the fundamental technology work of architecting/designing/building/managing/Optimizing the core frameworks for our cloud-based system platforms and end-to-end solutions.
- Responsible for optimization of cloud infrastructure, including Databricks, ADLS, Blob, VMs etc.,
- Conduct Proof-of-Concept activities in support of advanced use cases.
- Must have architectural focus for ensuring availability, reliability and scalability are necessary
- Responsible for documenting the technical solutions
- Administer and manage Azure Databricks workspaces, clusters, and jobs with a focus on maximizing efficiency and performance.
- Implement and manage Unity Catalog to provide centralized governance and fine-grained access control across data assets.
- Design and execute cost optimization strategies, including monitoring cluster usage, autoscaling, and resource allocation to minimize cloud expenses.
- Collaborate with data engineers and security teams to enforce data governance, compliance, and security policies using Unity Catalog.
- Automate deployment, scaling, and monitoring tasks using scripting and cloud-native tools.
- Troubleshoot and resolve issues related to Databricks clusters, jobs, and Unity Catalog configurations.
- Responsible for working with international teams spread across multiple time zones.
Must Have:
- 6 to 8 years of hands-on experience administering Azure Databricks in cloud environments.
- In-depth knowledge and experience with Unity Catalog for data governance and security.
- Proven expertise in cost optimization for Databricks clusters and cloud resources.
- Strong understanding of Databricks architecture, cluster management, and job orchestration.
- experience in RDBMS, ANSI SQL/PL SQL, Hadoop, Python and/or Java,spark/Pyspark.
- Proficiency in Spark architecture, including cluster management, job scheduling, and performance tuning.
- Experience in Azure DevOps, Git/Github.
- Azure Event Hub/ Azure Event Grid / Kafka
- Hands-on experience with scripting languages such as Python, Scala, or SQL.
- Experience with infrastructure-as-code tools like Terraform or ARM templates.
- Solid understanding of data security, governance, and compliance standards.
- Excellent problem-solving skills and ability to work in a collaborative environment.
- Strong communication skills and ability to explain technical concepts to non-technical stakeholders.
Additional experience:
- Hadoop Administration and/or Azure cloud Administration
- Working with Object storage ( ADLS/Blob or S3), Kubernetes (preferably AKS)
- Azure AD/ OpenID /OAuth/ SAML
- NSG /Firewall deployment and usage
- DNS configuration and management
- Automation through Ansible or Teraform or Azure DevOps
- Basic Linux administration and Shell scripting (Bash)
- Good documentation skills
- Ability to troubleshoot to isolate and diagnose common technical problems
- Monitoring and use of monitoring tools for managing critical infrastructure
Preferred Certifications:
- Microsoft Certified: Azure Administrator Associate/ Microsoft Certified: Azure Solutions Architect Expert
- Databricks Accredited Platform Administrator Accreditation
Weekly Hours:
40Time Type:
RegularLocation:
IND:KA:Bengaluru / Innovator Building, Itpb, Whitefield Rd - Adm: Intl Tech Park, Innovator BldgIt is the policy of AT&T to provide equal employment opportunity (EEO) to all persons regardless of age, color, national origin, citizenship status, physical or mental disability, race, religion, creed, gender, sex, sexual orientation, gender identity and/or expression, genetic information, marital status, status with regard to public assistance, veteran status, or any other characteristic protected by federal, state or local law. In addition, AT&T will provide reasonable accommodations for qualified individuals with disabilities. AT&T is a fair chance employer and does not initiate a background check until an offer is made.
Locations
- Bangalore, Karnataka, India
Salary
Estimated Salary Rangemedium confidence
25,000 - 55,000 USD / yearly
Source: ai estimated
* This is an estimated range based on market data and may vary based on experience and qualifications.
Skills Required
- Azure Databricks administrationintermediate
- Unity Catalogintermediate
- Cost optimizationintermediate
- Databricks architectureintermediate
- Cluster managementintermediate
- Job orchestrationintermediate
- RDBMSintermediate
- ANSI SQL/PL SQLintermediate
- Hadoopintermediate
- Pythonintermediate
- Javaintermediate
- Spark/Pysparkintermediate
- Spark architectureintermediate
- Job schedulingintermediate
- Performance tuningintermediate
- Azure DevOpsintermediate
- Git/Githubintermediate
- Azure Event Hubintermediate
- Azure Event Gridintermediate
- Kafkaintermediate
- Scripting languages (Python, Scala, SQL)intermediate
- Infrastructure-as-code (Terraform, ARM templates)intermediate
- Data securityintermediate
- Governanceintermediate
- Compliance standardsintermediate
- Problem-solvingintermediate
- Collaborationintermediate
- Communicationintermediate
- Hadoop Administrationintermediate
- Azure cloud Administrationintermediate
- Object storage (ADLS/Blob, S3)intermediate
- Kubernetes (AKS)intermediate
- Azure ADintermediate
- OpenIDintermediate
- OAuthintermediate
- SAMLintermediate
- NSGintermediate
- Firewallintermediate
- DNS configurationintermediate
- Automation (Ansible, Terraform, Azure DevOps)intermediate
- Linux administrationintermediate
- Shell scripting (Bash)intermediate
- Documentationintermediate
- Troubleshootingintermediate
- Monitoring toolsintermediate
Required Qualifications
- 6 to 8 years of hands-on experience administering Azure Databricks in cloud environments (experience)
- In-depth knowledge and experience with Unity Catalog for data governance and security (experience)
- Proven expertise in cost optimization for Databricks clusters and cloud resources (experience)
- Strong understanding of Databricks architecture, cluster management, and job orchestration (experience)
- Experience in RDBMS, ANSI SQL/PL SQL, Hadoop, Python and/or Java, Spark/Pyspark (experience)
- Proficiency in Spark architecture, including cluster management, job scheduling, and performance tuning (experience)
- Experience in Azure DevOps, Git/Github (experience)
- Azure Event Hub/ Azure Event Grid / Kafka (experience)
- Hands-on experience with scripting languages such as Python, Scala, or SQL (experience)
- Experience with infrastructure-as-code tools like Terraform or ARM templates (experience)
- Solid understanding of data security, governance, and compliance standards (experience)
- Excellent problem-solving skills and ability to work in a collaborative environment (experience)
- Strong communication skills and ability to explain technical concepts to non-technical stakeholders (experience)
Preferred Qualifications
- Hadoop Administration and/or Azure cloud Administration (experience)
- Working with Object storage ( ADLS/Blob or S3), Kubernetes (preferably AKS) (experience)
- Azure AD/ OpenID /OAuth/ SAML (experience)
- NSG /Firewall deployment and usage (experience)
- DNS configuration and management (experience)
- Automation through Ansible or Teraform or Azure DevOps (experience)
- Basic Linux administration and Shell scripting (Bash) (experience)
- Good documentation skills (experience)
- Ability to troubleshoot to isolate and diagnose common technical problems (experience)
- Monitoring and use of monitoring tools for managing critical infrastructure (experience)
- Microsoft Certified: Azure Administrator Associate/ Microsoft Certified: Azure Solutions Architect Expert (experience)
- Databricks Accredited Platform Administrator Accreditation (experience)
Responsibilities
- Minimum 6+ years of experience in the fundamental technology work of architecting/designing/building/managing/Optimizing the core frameworks for our cloud-based system platforms and end-to-end solutions
- Responsible for optimization of cloud infrastructure, including Databricks, ADLS, Blob, VMs etc.
- Conduct Proof-of-Concept activities in support of advanced use cases
- Must have architectural focus for ensuring availability, reliability and scalability are necessary
- Responsible for documenting the technical solutions
- Administer and manage Azure Databricks workspaces, clusters, and jobs with a focus on maximizing efficiency and performance
- Implement and manage Unity Catalog to provide centralized governance and fine-grained access control across data assets
- Design and execute cost optimization strategies, including monitoring cluster usage, autoscaling, and resource allocation to minimize cloud expenses
- Collaborate with data engineers and security teams to enforce data governance, compliance, and security policies using Unity Catalog
- Automate deployment, scaling, and monitoring tasks using scripting and cloud-native tools
- Troubleshoot and resolve issues related to Databricks clusters, jobs, and Unity Catalog configurations
- Responsible for working with international teams spread across multiple time zones
Tags & Categories
Answer 10 quick questions to check your fit for Specialist Data/AI Engineering (Azure Databricks platform engineer) @ AT&T.
10 Questions
~2 Minutes
Instant Score
Related Books and Jobs
Specialist Data/AI Engineering (Azure Databricks platform engineer)
AT&T
Specialist Data/AI Engineering (Azure Databricks platform engineer)
Job Description
Job Description:
Roles & Responsibilities
- Minimum 6+ years of experience in the fundamental technology work of architecting/designing/building/managing/Optimizing the core frameworks for our cloud-based system platforms and end-to-end solutions.
- Responsible for optimization of cloud infrastructure, including Databricks, ADLS, Blob, VMs etc.,
- Conduct Proof-of-Concept activities in support of advanced use cases.
- Must have architectural focus for ensuring availability, reliability and scalability are necessary
- Responsible for documenting the technical solutions
- Administer and manage Azure Databricks workspaces, clusters, and jobs with a focus on maximizing efficiency and performance.
- Implement and manage Unity Catalog to provide centralized governance and fine-grained access control across data assets.
- Design and execute cost optimization strategies, including monitoring cluster usage, autoscaling, and resource allocation to minimize cloud expenses.
- Collaborate with data engineers and security teams to enforce data governance, compliance, and security policies using Unity Catalog.
- Automate deployment, scaling, and monitoring tasks using scripting and cloud-native tools.
- Troubleshoot and resolve issues related to Databricks clusters, jobs, and Unity Catalog configurations.
- Responsible for working with international teams spread across multiple time zones.
Must Have:
- 6 to 8 years of hands-on experience administering Azure Databricks in cloud environments.
- In-depth knowledge and experience with Unity Catalog for data governance and security.
- Proven expertise in cost optimization for Databricks clusters and cloud resources.
- Strong understanding of Databricks architecture, cluster management, and job orchestration.
- experience in RDBMS, ANSI SQL/PL SQL, Hadoop, Python and/or Java,spark/Pyspark.
- Proficiency in Spark architecture, including cluster management, job scheduling, and performance tuning.
- Experience in Azure DevOps, Git/Github.
- Azure Event Hub/ Azure Event Grid / Kafka
- Hands-on experience with scripting languages such as Python, Scala, or SQL.
- Experience with infrastructure-as-code tools like Terraform or ARM templates.
- Solid understanding of data security, governance, and compliance standards.
- Excellent problem-solving skills and ability to work in a collaborative environment.
- Strong communication skills and ability to explain technical concepts to non-technical stakeholders.
Additional experience:
- Hadoop Administration and/or Azure cloud Administration
- Working with Object storage ( ADLS/Blob or S3), Kubernetes (preferably AKS)
- Azure AD/ OpenID /OAuth/ SAML
- NSG /Firewall deployment and usage
- DNS configuration and management
- Automation through Ansible or Teraform or Azure DevOps
- Basic Linux administration and Shell scripting (Bash)
- Good documentation skills
- Ability to troubleshoot to isolate and diagnose common technical problems
- Monitoring and use of monitoring tools for managing critical infrastructure
Preferred Certifications:
- Microsoft Certified: Azure Administrator Associate/ Microsoft Certified: Azure Solutions Architect Expert
- Databricks Accredited Platform Administrator Accreditation
Weekly Hours:
40Time Type:
RegularLocation:
IND:KA:Bengaluru / Innovator Building, Itpb, Whitefield Rd - Adm: Intl Tech Park, Innovator BldgIt is the policy of AT&T to provide equal employment opportunity (EEO) to all persons regardless of age, color, national origin, citizenship status, physical or mental disability, race, religion, creed, gender, sex, sexual orientation, gender identity and/or expression, genetic information, marital status, status with regard to public assistance, veteran status, or any other characteristic protected by federal, state or local law. In addition, AT&T will provide reasonable accommodations for qualified individuals with disabilities. AT&T is a fair chance employer and does not initiate a background check until an offer is made.
Locations
- Bangalore, Karnataka, India
Salary
Estimated Salary Rangemedium confidence
25,000 - 55,000 USD / yearly
Source: ai estimated
* This is an estimated range based on market data and may vary based on experience and qualifications.
Skills Required
- Azure Databricks administrationintermediate
- Unity Catalogintermediate
- Cost optimizationintermediate
- Databricks architectureintermediate
- Cluster managementintermediate
- Job orchestrationintermediate
- RDBMSintermediate
- ANSI SQL/PL SQLintermediate
- Hadoopintermediate
- Pythonintermediate
- Javaintermediate
- Spark/Pysparkintermediate
- Spark architectureintermediate
- Job schedulingintermediate
- Performance tuningintermediate
- Azure DevOpsintermediate
- Git/Githubintermediate
- Azure Event Hubintermediate
- Azure Event Gridintermediate
- Kafkaintermediate
- Scripting languages (Python, Scala, SQL)intermediate
- Infrastructure-as-code (Terraform, ARM templates)intermediate
- Data securityintermediate
- Governanceintermediate
- Compliance standardsintermediate
- Problem-solvingintermediate
- Collaborationintermediate
- Communicationintermediate
- Hadoop Administrationintermediate
- Azure cloud Administrationintermediate
- Object storage (ADLS/Blob, S3)intermediate
- Kubernetes (AKS)intermediate
- Azure ADintermediate
- OpenIDintermediate
- OAuthintermediate
- SAMLintermediate
- NSGintermediate
- Firewallintermediate
- DNS configurationintermediate
- Automation (Ansible, Terraform, Azure DevOps)intermediate
- Linux administrationintermediate
- Shell scripting (Bash)intermediate
- Documentationintermediate
- Troubleshootingintermediate
- Monitoring toolsintermediate
Required Qualifications
- 6 to 8 years of hands-on experience administering Azure Databricks in cloud environments (experience)
- In-depth knowledge and experience with Unity Catalog for data governance and security (experience)
- Proven expertise in cost optimization for Databricks clusters and cloud resources (experience)
- Strong understanding of Databricks architecture, cluster management, and job orchestration (experience)
- Experience in RDBMS, ANSI SQL/PL SQL, Hadoop, Python and/or Java, Spark/Pyspark (experience)
- Proficiency in Spark architecture, including cluster management, job scheduling, and performance tuning (experience)
- Experience in Azure DevOps, Git/Github (experience)
- Azure Event Hub/ Azure Event Grid / Kafka (experience)
- Hands-on experience with scripting languages such as Python, Scala, or SQL (experience)
- Experience with infrastructure-as-code tools like Terraform or ARM templates (experience)
- Solid understanding of data security, governance, and compliance standards (experience)
- Excellent problem-solving skills and ability to work in a collaborative environment (experience)
- Strong communication skills and ability to explain technical concepts to non-technical stakeholders (experience)
Preferred Qualifications
- Hadoop Administration and/or Azure cloud Administration (experience)
- Working with Object storage ( ADLS/Blob or S3), Kubernetes (preferably AKS) (experience)
- Azure AD/ OpenID /OAuth/ SAML (experience)
- NSG /Firewall deployment and usage (experience)
- DNS configuration and management (experience)
- Automation through Ansible or Teraform or Azure DevOps (experience)
- Basic Linux administration and Shell scripting (Bash) (experience)
- Good documentation skills (experience)
- Ability to troubleshoot to isolate and diagnose common technical problems (experience)
- Monitoring and use of monitoring tools for managing critical infrastructure (experience)
- Microsoft Certified: Azure Administrator Associate/ Microsoft Certified: Azure Solutions Architect Expert (experience)
- Databricks Accredited Platform Administrator Accreditation (experience)
Responsibilities
- Minimum 6+ years of experience in the fundamental technology work of architecting/designing/building/managing/Optimizing the core frameworks for our cloud-based system platforms and end-to-end solutions
- Responsible for optimization of cloud infrastructure, including Databricks, ADLS, Blob, VMs etc.
- Conduct Proof-of-Concept activities in support of advanced use cases
- Must have architectural focus for ensuring availability, reliability and scalability are necessary
- Responsible for documenting the technical solutions
- Administer and manage Azure Databricks workspaces, clusters, and jobs with a focus on maximizing efficiency and performance
- Implement and manage Unity Catalog to provide centralized governance and fine-grained access control across data assets
- Design and execute cost optimization strategies, including monitoring cluster usage, autoscaling, and resource allocation to minimize cloud expenses
- Collaborate with data engineers and security teams to enforce data governance, compliance, and security policies using Unity Catalog
- Automate deployment, scaling, and monitoring tasks using scripting and cloud-native tools
- Troubleshoot and resolve issues related to Databricks clusters, jobs, and Unity Catalog configurations
- Responsible for working with international teams spread across multiple time zones
Tags & Categories
Answer 10 quick questions to check your fit for Specialist Data/AI Engineering (Azure Databricks platform engineer) @ AT&T.
10 Questions
~2 Minutes
Instant Score
Related Books and Jobs