Senior Principal Software Engineer - Databricks

Location: Jersey City, NJ, United States

Job Family: Software Engineering

About the Role

At JP Morgan Chase, we are at the forefront of financial innovation, leveraging cutting-edge technology to power the world's leading financial services. As a Senior Principal Software Engineer - Databricks, you will play a pivotal role in setting the strategic direction for our technology ecosystem. Based in our Jersey City, NJ office, you will drive critical programs that harness Databricks to transform vast financial datasets into actionable insights, supporting everything from risk management to algorithmic trading. This position demands a visionary leader who can architect scalable, secure data platforms that comply with stringent regulatory standards while accelerating our tech-driven innovations in the competitive fintech landscape. Your responsibilities will span the full lifecycle of data engineering initiatives, from conceptualizing advanced Spark-based pipelines to deploying machine learning models that enhance client services. You will collaborate with elite teams across the firm, including quantitative analysts and business stakeholders, to integrate Databricks solutions that optimize operational efficiency and mitigate financial risks. By championing best practices in data governance and cloud-native architectures, you will ensure our platforms remain resilient against evolving market demands and cyber threats inherent to the financial sector. We seek a seasoned engineer with a passion for innovation and a deep understanding of how technology intersects with finance. In this role, you will mentor emerging talent, influence firm-wide tech strategies, and contribute to JP Morgan Chase's legacy as a pioneer in digital transformation. Join us to shape the future of banking through intelligent, data-centric solutions that deliver unparalleled value to our global clientele.

Key Responsibilities

• Set the strategic direction for Databricks-based technology platforms across JP Morgan Chase's global operations
• Lead the design, development, and deployment of scalable data engineering solutions using Databricks and Spark
• Drive critical programs to integrate AI/ML capabilities into financial services applications, enhancing decision-making
• Collaborate with cross-functional teams including data scientists, traders, and compliance officers to align tech innovations with business needs
• Oversee the optimization of data pipelines for high-volume financial datasets, ensuring low-latency processing for real-time analytics
• Mentor and guide senior engineers, fostering a culture of innovation and best practices in software engineering
• Ensure adherence to regulatory requirements such as GDPR, SOX, and SEC guidelines in all data initiatives
• Evaluate and integrate emerging technologies to maintain JP Morgan Chase's competitive edge in fintech
• Conduct code reviews, performance tuning, and troubleshooting for complex distributed systems

Required Qualifications

• Bachelor's degree in Computer Science, Engineering, or a related field; advanced degree preferred
• 10+ years of software engineering experience, with at least 5 years in big data technologies and cloud platforms
• Proven track record of leading large-scale data engineering projects in a financial services environment
• Deep expertise in Databricks, Spark, and Delta Lake for data processing and analytics
• Experience with scalable data pipelines and machine learning workflows in regulated industries
• Strong understanding of financial data governance, compliance, and risk management standards

Preferred Qualifications

• Master's or PhD in a quantitative field with focus on data science or AI
• Prior experience at a major financial institution, such as leading data platforms for trading or risk analytics
• Certifications in Databricks, AWS, or Azure cloud services
• Background in developing AI/ML solutions for fraud detection or portfolio optimization

Required Skills

• Proficiency in Python, Scala, or Java for data engineering
• Expertise in Apache Spark and Databricks for big data processing
• Knowledge of cloud platforms like AWS, Azure, or GCP
• Experience with Delta Lake, MLflow, and Unity Catalog
• Strong SQL and data modeling skills for financial datasets
• Understanding of ETL/ELT processes and data orchestration tools like Apache Airflow
• Familiarity with containerization (Docker, Kubernetes) and CI/CD pipelines
• Skills in machine learning frameworks such as TensorFlow or PyTorch
• Excellent problem-solving and analytical thinking
• Leadership and communication skills for cross-team collaboration
• Knowledge of financial regulations and data security best practices
• Ability to handle high-stakes, time-sensitive projects
• Experience with version control systems like Git
• Proficiency in agile methodologies and DevOps practices

Benefits

• Competitive base salary and performance-based annual bonuses
• Comprehensive health, dental, and vision insurance plans
• 401(k) retirement savings plan with generous company matching
• Paid time off including vacation, sick days, and parental leave
• Professional development opportunities, including tuition reimbursement and access to internal training programs
• Employee stock purchase plan and financial wellness resources
• On-site fitness centers, wellness programs, and mental health support
• Flexible work arrangements and relocation assistance for eligible roles

JP Morgan Chase is an equal opportunity employer.