About the Role

Robert Half is excited to partner with a leading enterprise in Tempe, Arizona, to find an exceptional Databricks Data Engineer with specialized expertise in Azure cloud services and the revolutionary Databricks Lakehouse platform. This pivotal full-time position offers the opportunity to design and optimize large-scale data pipelines that power enterprise analytics and business intelligence initiatives. As a key player in modernizing cloud-based data ecosystems, you will enable secure, governed data solutions that drive strategic decision-making across the organization.

The ideal candidate brings deep technical proficiency in data engineering best practices, combined with hands-on experience in building scalable, high-performance data architectures. This role demands not only technical excellence but also the ability to collaborate with cross-functional teams including data scientists, analysts, and stakeholders to deliver transformative data solutions. Located in the dynamic tech hub of Tempe, AZ, this position offers the perfect blend of innovation, professional growth, and work-life balance in one of the fastest-growing regions in the United States.

Key Responsibilities

• Design and optimize data pipelines: Architect, build, and fine-tune large-scale data pipelines leveraging the Databricks Lakehouse platform to handle massive datasets efficiently.
• Modernize Azure data ecosystems: Lead the transformation of Azure-based data architectures, focusing on data modeling, security implementation, governance frameworks, and CI/CD automation pipelines.
• Implement advanced orchestration: Develop and maintain workflow automation using Apache Airflow and other industry-leading tools to ensure seamless data processing and reliability.
• Ensure data compliance and governance: Work with regulated datasets across industries, implementing best practices for data security, access controls, and compliance with standards like GDPR, HIPAA, and SOC 2.
• Collaborate on enterprise solutions: Partner with data science, analytics, and engineering teams to deliver end-to-end data solutions that support advanced analytics, machine learning models, and real-time reporting.
• Performance optimization: Continuously monitor, troubleshoot, and optimize data pipelines for cost-efficiency, scalability, and performance in production environments.
• Innovation leadership: Stay ahead of emerging technologies in lakehouse architecture, recommending and implementing cutting-edge tools and methodologies.

Required Qualifications

To excel in this Databricks Data Engineer role, candidates must demonstrate proven expertise across a comprehensive skill set tailored for modern cloud data engineering:

• 5+ years of hands-on data engineering experience, with at least 3 years focused on Databricks Lakehouse and Azure cloud platforms.
• Advanced proficiency in Python, PySpark, and SQL for developing complex data transformations and analytics.
• Demonstrated experience with Delta Lake, Unity Catalog, and Databricks workspace administration.
• Strong background in ETL/ELT frameworks, data modeling, and pipeline orchestration tools like Apache Airflow.
• Expertise in CI/CD automation, infrastructure as code (Terraform/ARM), and Azure services including Synapse, Data Factory, and Blob Storage.
• Experience managing regulated datasets with emphasis on data governance, lineage tracking, and security best practices.
• Bachelor's degree in Computer Science, Information Technology, or a related quantitative field; Master's preferred.
• Excellent problem-solving skills, attention to detail, and ability to thrive in fast-paced, collaborative environments.

Candidates with certifications such as Databricks Certified Data Engineer Professional, Microsoft Azure Data Engineer Associate, or equivalent will receive strong preference.

Why Join Us

Join Robert Half's prestigious client in Tempe, Arizona, and become part of a forward-thinking organization at the forefront of data innovation. We offer a competitive salary range of $130,000 - $150,000 annually, comprehensive benefits including health coverage, 401(k) matching, professional development stipends, and flexible hybrid work options. Tempe's thriving tech ecosystem provides endless opportunities for networking, career advancement, and enjoying Arizona's sunny climate and vibrant lifestyle.

Robert Half is committed to diversity, equity, and inclusion, fostering an environment where every team member can thrive. This Databricks Data Engineer position represents a rare opportunity to make a lasting impact on enterprise-scale data initiatives while advancing your career with one of the region's most innovative employers. Apply today and elevate your data engineering career to new heights!