Lead Software Engineer - Databricks Platform Architect

Location: Hyderabad, Telangana, India

Job Family: Software Engineering

About the Role

At JP Morgan Chase, we are at the forefront of financial innovation, leveraging cutting-edge technology to power global banking, investment, and asset management services. As a Lead Software Engineer - Databricks Platform Architect in our Hyderabad office, you will play a pivotal role in architecting robust data platforms that drive business decisions and mitigate risks in one of the world's largest financial institutions. This position offers the opportunity to tackle diverse challenges across multiple technologies, from real-time data processing for trading platforms to scalable analytics for wealth management, all while ensuring compliance with stringent regulatory standards like SOX and GDPR. You will lead initiatives that deliver significant business impact, collaborating with elite teams to build resilient systems that support JP Morgan's commitment to digital transformation and client-centric solutions. In this leadership role, you will design and implement advanced Databricks-based architectures, optimizing for performance, security, and cost-efficiency in a cloud-native environment. Your expertise will be crucial in developing data lakes and pipelines that handle petabyte-scale financial datasets, enabling advanced AI/ML models for fraud detection, portfolio optimization, and market forecasting. Working in an agile, cross-functional team, you will mentor engineers, influence technical strategy, and integrate emerging tools like Delta Lake and Spark to enhance our data ecosystem. This is not just about coding; it's about architecting the future of finance, where your innovations directly contribute to JP Morgan Chase's global operations and competitive edge in the industry. We value engineers who thrive in dynamic, high-impact environments and are passionate about solving complex problems in financial services. Join us in Hyderabad, a hub for our technology excellence in India, and be part of a culture that fosters innovation, diversity, and professional growth. With access to world-class resources and opportunities to influence firm-wide initiatives, this role positions you to make a lasting difference in how JP Morgan Chase harnesses data to serve millions of clients worldwide.

Key Responsibilities

• Architect and lead the development of scalable Databricks platforms to support JP Morgan Chase's data-intensive financial applications
• Design secure, compliant data pipelines that integrate with core banking systems and ensure data governance across global teams
• Collaborate with data scientists, analysts, and business stakeholders to optimize platform performance for financial modeling and risk assessment
• Drive innovation in data engineering practices, including the adoption of Delta Lake for ACID transactions in financial datasets
• Mentor junior engineers and lead technical roadmaps for Databricks infrastructure in a hybrid cloud environment
• Troubleshoot and resolve complex issues in distributed systems to maintain 99.99% uptime for critical financial operations
• Implement monitoring and observability tools to track platform health and compliance in real-time trading scenarios
• Contribute to firm-wide initiatives on AI/ML integration within Databricks for predictive analytics in investment banking
• Evaluate and integrate emerging technologies to enhance data platform capabilities aligned with JP Morgan's digital transformation goals
• Ensure adherence to security best practices and regulatory requirements in all platform designs

Required Qualifications

• Bachelor's degree in Computer Science, Engineering, or a related field; Master's degree preferred
• 8+ years of experience in software engineering with a focus on data platforms and cloud architectures
• Proven expertise in Databricks, including Delta Lake, Spark, and MLflow for building scalable data solutions
• Strong experience in designing and implementing data pipelines in a financial services environment
• Proficiency in Python, Scala, or Java for developing distributed data processing applications
• Experience with cloud platforms such as AWS, Azure, or GCP, with emphasis on secure financial data handling
• Demonstrated ability to lead cross-functional teams in agile environments within regulated industries

Preferred Qualifications

• Experience in financial services, particularly in banking or investment management at a large-scale institution like JP Morgan Chase
• Certification in Databricks (e.g., Databricks Certified Data Engineer Professional)
• Knowledge of regulatory compliance standards such as GDPR, SOX, and PCI-DSS for data platforms
• Background in machine learning operations (MLOps) and AI-driven financial analytics
• Prior work on high-availability systems supporting real-time trading or risk management

Required Skills

• Databricks platform architecture and optimization
• Apache Spark and Delta Lake for big data processing
• Python/Scala/Java programming for data engineering
• Cloud infrastructure (AWS/Azure/GCP) with financial security focus
• Data pipeline design and ETL/ELT methodologies
• Machine learning frameworks (MLflow, TensorFlow) in Databricks
• SQL and NoSQL databases for financial data management
• Agile methodologies and DevOps practices (CI/CD, Terraform)
• Regulatory compliance and data governance in banking
• Leadership and cross-functional team collaboration
• Problem-solving in high-stakes financial environments
• Monitoring tools (Prometheus, Grafana) for platform reliability
• API development and microservices architecture
• Risk assessment and secure coding practices
• Communication skills for stakeholder engagement

Benefits

• Competitive base salary and performance-based annual bonuses
• Comprehensive health, dental, and vision insurance coverage
• Retirement savings plan with generous company matching contributions
• Paid time off including vacation, sick leave, and parental leave
• Professional development programs and tuition reimbursement for certifications
• Employee stock purchase plan and financial wellness resources
• On-site fitness centers and wellness programs at JP Morgan Chase offices
• Global mobility opportunities and relocation support for international roles

JP Morgan Chase is an equal opportunity employer.