Software Engineer III - LLM

Location: Jersey City, NJ, United States

Job Family: Software Engineering

About the Role

At JP Morgan Chase, we are at the forefront of financial innovation, leveraging cutting-edge technology to power global banking, investment, and asset management services. As a Software Engineer III - LLM in our Jersey City, NJ team, you will play a pivotal role in designing and delivering market-leading AI-driven products. This position focuses on Large Language Models (LLMs) to enhance capabilities in areas such as automated compliance checks, intelligent customer interactions, and predictive analytics for risk management. Working within an agile, cross-functional team, you will contribute to secure, scalable solutions that handle petabytes of sensitive financial data while adhering to the highest standards of regulatory compliance and cybersecurity. Your responsibilities will include architecting LLM integrations into our core platforms, optimizing models for real-time performance in high-stakes trading environments, and collaborating with data scientists, product owners, and compliance experts to align technical solutions with business objectives. You will tackle challenges unique to the financial services industry, such as ensuring model explainability for audit purposes and mitigating biases in AI outputs that could impact lending decisions. This role demands a blend of deep technical expertise and a passion for innovation, as you help shape the future of AI at one of the world's largest financial institutions. Joining JP Morgan Chase means becoming part of a dynamic culture that values diversity, inclusion, and continuous learning. We offer unparalleled opportunities to grow your career while contributing to technologies that serve millions of clients worldwide. If you are a seasoned engineer excited about the intersection of AI and finance, this position provides the platform to make a lasting impact in a secure, collaborative environment.

Key Responsibilities

• Design, develop, and deploy LLM-based solutions to enhance financial analytics, customer service automation, and fraud detection within JP Morgan Chase's ecosystem
• Collaborate with agile teams to integrate LLMs into secure, scalable platforms that support global banking operations
• Optimize model performance for low-latency inference in high-volume financial transactions
• Ensure all implementations adhere to JP Morgan's stringent security protocols and regulatory requirements
• Conduct code reviews, testing, and debugging to maintain robust, reliable software in production
• Research and incorporate emerging LLM technologies to drive innovation in areas like personalized financial advice and compliance monitoring
• Mentor junior engineers and contribute to the technical roadmap for AI-driven financial products
• Monitor and troubleshoot LLM applications to minimize downtime and ensure data privacy in a regulated environment
• Partner with data scientists and product managers to translate business needs into technical solutions

Required Qualifications

• Bachelor's degree in Computer Science, Engineering, or a related field; advanced degree preferred
• 5+ years of professional software engineering experience, with a focus on large-scale systems
• Proven experience in designing and implementing machine learning models, particularly Large Language Models (LLMs)
• Strong understanding of secure coding practices and compliance with financial regulations such as GDPR and SOX
• Experience working in agile environments with cross-functional teams in a fast-paced financial services setting
• Demonstrated ability to deliver scalable, high-performance applications handling sensitive financial data

Preferred Qualifications

• Experience with LLM frameworks like Hugging Face Transformers or TensorFlow/PyTorch in production environments
• Background in financial technology, including risk management or trading systems
• Familiarity with cloud platforms such as AWS, Azure, or Google Cloud for deploying AI models
• Contributions to open-source projects or publications in AI/ML related to natural language processing

Required Skills

• Proficiency in Python, Java, or C++ for backend development
• Expertise in machine learning frameworks (e.g., PyTorch, TensorFlow) and LLM-specific tools (e.g., LangChain, Hugging Face)
• Strong knowledge of natural language processing (NLP) techniques and transformer architectures
• Experience with containerization (Docker) and orchestration (Kubernetes) for scalable deployments
• Familiarity with cloud services (AWS, GCP) and CI/CD pipelines (Jenkins, GitHub Actions)
• Understanding of data security, encryption, and compliance in financial systems
• Agile methodologies (Scrum, Kanban) and collaboration tools (Jira, Confluence)
• Problem-solving and analytical skills for optimizing AI models under constraints
• Communication skills for explaining complex technical concepts to non-technical stakeholders
• Version control with Git and experience in microservices architecture
• Knowledge of SQL/NoSQL databases for handling large datasets in finance
• Adaptability to fast-paced environments and regulatory changes in banking
• Team leadership and mentoring abilities

Benefits

• Competitive base salary and performance-based annual bonuses
• Comprehensive health, dental, and vision insurance plans
• 401(k) retirement savings plan with generous company matching
• Paid time off, including vacation, sick days, and parental leave
• Professional development opportunities, including tuition reimbursement and access to internal training programs
• Employee stock purchase plan and financial wellness resources
• On-site fitness centers, wellness programs, and mental health support
• Flexible work arrangements, including hybrid options in Jersey City, NJ

JP Morgan Chase is an equal opportunity employer.