Principal Software Engineer - AI Engineer

This on site role in Jersey City offers a salary range of USD 204,250 to 285,000 per year and requires a minimum of seven years of software engineering experience. JPMorganChase backs this position with comprehensive benefits, including health coverage, on-site health and wellness centers, a retirement savings plan, backup childcare, tuition reimbursement, mental health support, and financial coaching. In this Principal Software Engineer - AI Engineer role, you will lead a specialized AI/ML engineering program, hire and mentor engineers, and set engineering standards across teams. You will oversee end-to-end ML lifecycle management, architect agentic AI solutions, and scale LLM enabled capabilities across advisory, client, and internal workflows.

Responsibilities

• Develop agentic AI reference architectures covering orchestration, retrieval, memory, guardrails, and evaluation harnesses
• Produce production-grade Python code with PyTorch or TensorFlow as needed and review critical-path components
• Create reusable components for prompt management, evaluators, safety filters, connectors, embeddings pipelines, and memory stores
• Build and operate LLM powered APIs and microservices integrated into advisor, client, and internal workflows
• Own the end-to-end ML lifecycle including experimentation, CI/CD, automated testing, monitoring, drift detection, versioning, and rollback
• Optimize inference for latency, throughput, caching, batching, model selection, and cost per inference
• Collaborate with data teams on structured and unstructured data pipelines, document ingestion, metadata, and access controls
• Set engineering standards for agentic AI systems and lead design reviews
• Influence roadmap and priorities through technical insight and delivery
• Architect and govern agentic AI enabled engineering workflows using enterprise tools to improve delivery speed, code quality, and operational outcomes at scale, including AI driven PR review, test generation and maintenance, release readiness checks, incident triage and root-cause acceleration, while defining guardrails for validation, security, resiliency, and reuse
• Leverage SDLC toolchains and enterprise AI assisted development capabilities to increase value realized by automation at scale

Requirements

• Formal training or certification in software engineering concepts plus 7+ years of applied experience
• Strong Python engineering skills with experience in PyTorch or TensorFlow
• Expertise with vector storage systems and designing memory architectures for agents
• Experience developing long running agents that operate autonomously using tools, skills, and human in the loop
• Proven experience deploying LLM backed services to production via APIs or microservices
• Deep MLOps experience including CI/CD, monitoring, incident response, and model governance
• Cloud native AI deployment experience (AWS or Azure) with cost and performance optimization
• Demonstrated commitment to responsible AI practices and operational excellence
• Strong communication and collaboration skills across product, risk, legal, and compliance teams
• Experience designing and leading adoption of agentic AI enabled development practices across teams using enterprise tools, including standards for human in the loop validation, auditability and secure data handling
• Solid understanding of responsible AI use and control expectations in engineering workflows, including security and resiliency implications, data sensitivity, and risk based governance; ability to influence senior technical leaders on safe scaling patterns and reuse

Technologies

• Python
• PyTorch
• TensorFlow
• Vector storage systems

Benefits

• Base salary determined by role, experience, skill set and location
• Commission-based pay and/or discretionary incentive compensation, paid in cash and/or forfeitable equity
• Comprehensive health care coverage
• On-site health and wellness centers
• Retirement savings plan
• Backup childcare
• Tuition reimbursement
• Mental health support
• Financial coaching

FEDERAL DEPOSIT INSURANCE ACT: This position is subject to Section 19 of the Federal Deposit Insurance Act. As such, an employment offer for this position is contingent on JPMorganChase's review of criminal conviction history, including pretrial diversions or program entries.

About the Team

Our professionals in our Corporate Functions cover a diverse range of areas from finance and risk to human resources and marketing. Our corporate teams are an essential part of our company, ensuring that we're setting our businesses, clients, customers and employees up for success.