Senior Lead Software Engineer - Databricks

Location: Jersey City, NJ, United States

Job Family: Software Engineering

About the Role

At JP Morgan Chase, we are at the forefront of financial services innovation, and our technology teams are pivotal in delivering solutions that power global banking, investment, and asset management. As a Senior Lead Software Engineer - Databricks in our Jersey City, NJ office, you will play a critical role in driving significant business impact by tackling diverse challenges across multiple technologies and applications. This position within the Software Engineering category offers the opportunity to lead high-impact projects that enhance data-driven decision-making in areas like risk analytics, regulatory reporting, and real-time market insights. You will work in a collaborative environment, leveraging cutting-edge tools to build resilient, scalable data platforms that support JP Morgan's commitment to excellence in financial services. In this leadership role, you will architect and implement advanced data solutions using Databricks, ensuring seamless integration with JP Morgan's vast ecosystem of financial data sources. Your responsibilities will include optimizing Spark-based workflows for processing massive volumes of transaction data, collaborating with quant teams on AI-enhanced forecasting models, and ensuring all solutions comply with stringent industry regulations such as Dodd-Frank and MiFID II. You will mentor junior engineers, foster a culture of innovation, and drive the migration of legacy systems to cloud-native architectures, directly contributing to operational efficiency and competitive edge in the dynamic financial landscape. Joining JP Morgan Chase means being part of a world-class organization that values diversity, inclusion, and professional growth. This role not only challenges you technically but also allows you to influence strategic initiatives that shape the future of finance. With access to top-tier resources and a supportive team, you will thrive in an environment where your expertise in Databricks and data engineering can make a tangible difference to our clients and the broader financial community.

Key Responsibilities

• Lead the design, development, and optimization of data solutions using Databricks to support JP Morgan Chase's financial analytics and reporting needs
• Collaborate with business stakeholders in areas like investment banking and asset management to translate complex financial requirements into scalable engineering solutions
• Mentor and guide a team of software engineers, fostering best practices in data engineering and ensuring adherence to security and compliance standards
• Drive the integration of Databricks with enterprise systems, including real-time data processing for trading and risk assessment
• Identify and resolve performance bottlenecks in large-scale data workflows, leveraging Spark for efficient processing of petabyte-scale financial datasets
• Contribute to innovation initiatives, such as AI-driven fraud detection or predictive modeling for market trends
• Ensure robust testing, deployment, and monitoring of data pipelines in a regulated financial environment
• Partner with cross-functional teams to enhance data governance and quality across JP Morgan's global operations
• Stay abreast of emerging technologies and recommend improvements to data infrastructure for competitive advantage in financial services

Required Qualifications

• Bachelor's degree in Computer Science, Engineering, or a related field; advanced degree preferred
• 8+ years of experience in software engineering with a focus on data platforms and big data technologies
• Proven expertise in Databricks, Spark, and cloud-based data processing environments
• Strong experience in financial services, particularly in areas like risk management, compliance, or trading systems
• Demonstrated ability to lead cross-functional teams and drive end-to-end project delivery
• Proficiency in Python, Scala, or Java for developing scalable data pipelines
• Experience with agile methodologies and DevOps practices in a high-stakes financial environment

Preferred Qualifications

• Master's degree in Computer Science or Data Science
• Experience with machine learning frameworks integrated with Databricks
• Knowledge of regulatory requirements such as GDPR, SOX, or Basel III in financial data handling
• Prior leadership in migrating legacy data systems to cloud platforms like AWS or Azure
• Certifications in Databricks, Spark, or cloud technologies

Required Skills

• Databricks platform expertise
• Apache Spark for big data processing
• Python or Scala programming
• Cloud computing (AWS, Azure, or GCP)
• Data pipeline design and ETL processes
• SQL and data modeling
• Machine learning integration with data platforms
• Agile and Scrum methodologies
• Leadership and team management
• Problem-solving in complex environments
• Knowledge of financial regulations and compliance
• DevOps tools (CI/CD, Docker, Kubernetes)
• Version control with Git
• Performance optimization for large datasets
• Communication and stakeholder collaboration

Benefits

• Competitive base salary and performance-based annual bonuses
• Comprehensive health, dental, and vision insurance plans
• 401(k) retirement savings plan with generous company matching
• Paid time off, including vacation, sick days, and parental leave
• Professional development opportunities, including tuition reimbursement and access to internal training programs
• Employee stock purchase plan and financial wellness resources
• On-site fitness centers and wellness programs at JP Morgan Chase locations
• Flexible work arrangements, including hybrid options in Jersey City

JP Morgan Chase is an equal opportunity employer.