Lead Software Engineer – Databricks / PySpark / AWS

Location: Wilmington, DE, United States

Job Family: Software Engineering

About the Role

At JPMorgan Chase, we are at the forefront of financial innovation, leveraging cutting-edge technology to deliver exceptional services to our global clients. As a Lead Software Engineer specializing in Databricks, PySpark, and AWS, you will play a pivotal role in our Data & Analytics team in Wilmington, DE. This position offers the chance to lead transformative projects that enhance our risk management, fraud detection, and customer analytics capabilities, pushing the boundaries of what's possible in the financial services industry. You will work on high-impact initiatives that process petabytes of sensitive financial data, ensuring scalability, security, and compliance with stringent regulations like SOX and GDPR. In this leadership role, you will architect and implement advanced data solutions using Databricks for collaborative data engineering and PySpark for distributed processing on AWS cloud infrastructure. Collaborating with data scientists and business leaders, you will design efficient ETL pipelines to support real-time decision-making in areas such as investment banking and consumer lending. Your expertise will drive the optimization of data workflows, integrating machine learning models to predict market trends and mitigate risks, all while mentoring a team of engineers to uphold JPMorgan Chase's commitment to technological excellence and innovation. Joining JPMorgan Chase means becoming part of a dynamic culture that values diversity, inclusion, and professional growth. You will have access to world-class resources, including our state-of-the-art tech stack and opportunities to contribute to firm-wide digital transformation efforts. This role not only challenges you technically but also allows you to make a meaningful impact on the financial well-being of millions, in a supportive environment that fosters work-life balance and career advancement.

Key Responsibilities

• Lead the design, development, and deployment of scalable data solutions using Databricks and PySpark on AWS infrastructure
• Collaborate with cross-functional teams including data scientists, analysts, and business stakeholders to build robust ETL pipelines for financial data processing
• Mentor and guide a team of software engineers, fostering best practices in code quality, testing, and deployment
• Optimize data architectures to handle large-scale financial datasets, ensuring performance, security, and compliance with regulatory standards
• Integrate machine learning models into production environments to support risk assessment and predictive analytics in banking operations
• Troubleshoot and resolve complex issues in distributed systems, minimizing downtime for critical financial applications
• Drive innovation by exploring emerging technologies and contributing to JPMorgan Chase's digital transformation initiatives
• Conduct code reviews, implement CI/CD pipelines, and ensure adherence to secure coding practices in a high-stakes financial setting
• Monitor system performance and scalability, providing recommendations for cost optimization on AWS
• Communicate technical concepts to non-technical stakeholders, aligning engineering efforts with business objectives in wealth management or consumer banking

Required Qualifications

• Bachelor's degree in Computer Science, Engineering, or a related field; advanced degree preferred
• 7+ years of experience in software engineering with a focus on big data technologies
• Proficiency in Databricks, PySpark, and AWS cloud services
• Strong experience in designing and implementing scalable data pipelines in a financial services environment
• Demonstrated ability to lead engineering teams and mentor junior developers
• Knowledge of financial regulations such as GDPR, SOX, and PCI-DSS compliance
• Proven track record of delivering high-impact projects in a fast-paced, regulated industry

Preferred Qualifications

• Experience with machine learning frameworks integrated with Databricks
• Familiarity with JPMorgan Chase's internal tools and agile methodologies
• Certifications in AWS (e.g., AWS Certified Solutions Architect) or Databricks
• Background in risk management or fraud detection systems within banking
• Experience optimizing data workflows for real-time financial analytics

Required Skills

• Databricks platform expertise
• PySpark and Apache Spark programming
• AWS services (EC2, S3, Lambda, EMR)
• Python and SQL proficiency
• Data pipeline design and optimization
• ETL processes for big data
• Machine learning integration
• Agile and Scrum methodologies
• Leadership and team mentoring
• Problem-solving in complex environments
• Knowledge of financial data security
• Version control with Git
• CI/CD tools (Jenkins, GitHub Actions)
• Communication and stakeholder management
• Regulatory compliance awareness

Benefits

• Competitive base salary and performance-based annual bonuses
• Comprehensive health, dental, and vision insurance plans
• 401(k) retirement savings plan with generous company matching
• Paid time off including vacation, sick days, and parental leave
• Professional development opportunities with tuition reimbursement and access to internal training programs
• Employee stock purchase plan and financial wellness resources
• Flexible work arrangements including hybrid options in Wilmington, DE
• Wellness programs with gym memberships, mental health support, and onsite fitness facilities

JP Morgan Chase is an equal opportunity employer.