AI Engineer

Join Amalgamated Bank of NY to build and operationalize enterprise AI solutions that support the Bank’s Data & AI strategy. This hybrid role in New York, NY focuses on designing AI agents, LLM applications, retrieval solutions, and governance controls using Databricks and approved enterprise AI platforms.

You will help deliver practical AI capabilities end-to-end: from development and integration to evaluation, monitoring, validation, and documentation. The work includes attention to model quality, safety, and operational effectiveness, alongside collaboration with data engineering and governance partners.

Responsibilities

• Design, develop, test, and support AI-powered applications, copilots, and agent-based solutions using Python, Databricks, and approved enterprise AI platforms.
• Assist in building retrieval-augmented generation (RAG) solutions, workflow automations, and multi-agent architectures aligned to business objectives.
• Develop and maintain integrations between AI solutions and enterprise systems, including databases, APIs, and business applications.
• Support prompt engineering, context management, tool integration, and agent orchestration activities.
• Create and maintain evaluation frameworks, test datasets, and benchmarking methodologies to measure AI performance.
• Monitor model quality, accuracy, safety, latency, and cost efficiency using dashboards and operational metrics.
• Troubleshoot AI application issues, contribute to performance tuning, and support continuous improvement.
• Participate in validation activities to ensure AI solutions meet business, regulatory, and governance requirements.
• Prepare, transform, and validate structured and unstructured data for AI and analytical applications.
• Collaborate with Data Engineering and Data Governance teams to ensure AI solutions use trusted, certified, and well-governed data sources.
• Support vectorized knowledge repositories and retrieval services.
• Contribute to data lineage, metadata, and documentation efforts for audit and governance needs.
• Adhere to established standards for Responsible AI, information security, privacy, model governance, and change management.
• Support documentation and evidence collection for model reviews, audits, and regulatory examinations.
• Assist in monitoring guardrails related to AI safety, accuracy, traceability, observability, and operational effectiveness.
• Follow enterprise policies for access controls, data handling, and model lifecycle management.
• Partner with data engineers, BI engineers, analysts, and business stakeholders to deliver usable AI solutions.
• Support dashboards and operational reporting that measure AI adoption, effectiveness, and business value.
• Research emerging AI technologies, tools, and engineering practices and share learnings with the Data & AI team.
• Participate in peer reviews, technical discussions, and knowledge-sharing activities.
• Perform other duties as directed.

Requirements

• Bachelor’s degree in Computer Science, Data Science, Engineering, Mathematics, Information Systems, or a related field.
• 1-3 years of professional experience in software engineering, data engineering, machine learning, artificial intelligence, or a related technical discipline.
• Proficiency in Python and SQL.
• Experience with cloud-based data platforms, preferably Databricks or similar technologies.
• Foundational knowledge of large language models (LLMs), prompt engineering, retrieval-augmented generation (RAG), and AI application development.
• Strong analytical, problem-solving, and troubleshooting abilities.
• Effective verbal and written communication skills, including the ability to document technical solutions clearly.

Technologies

• Python, SQL, Databricks
• LLMs, retrieval-augmented generation (RAG)
• LangGraph, LlamaIndex, Semantic Kernel
• Azure, Git, CI/CD pipelines, API development

Preferred Qualifications

• Experience with Databricks, Azure, Git, CI/CD pipelines, and API development.
• Familiarity with agentic AI frameworks such as LangGraph, LlamaIndex, Semantic Kernel, or comparable technologies.
• Exposure to AI governance, model evaluation methodologies, and responsible AI practices.
• Experience supporting dashboards, reporting solutions, or operational monitoring capabilities.
• Understanding of AI and Data Governance principles.
• Prior experience within financial services, banking, or another regulated industry.

Hybrid Work Model

Effective February 18, 2025, employees in office-based positions will follow a hybrid schedule with three days or more on-site per week (Monday - Thursday, with specific days varying by site or organization) and Friday designated as a remote-working day, unless business-critical tasks require on-site presence.

This hybrid guidance does not apply to roles requiring daily in-person attendance (including contact center, branch service roles, and general services located at a Company site), roles covered by a collective-bargaining agreement unless the agreement provides for hybrid work, or any position the Company determines cannot be reasonably performed remotely. Guidance also does not apply to roles designated as remote.

Compensation: USD 105,000 - 120,000 per year.

Search firm representatives: Amalgamated Bank does not accept unsolicited assistance from search firms for employment opportunities. CVs/resumes submitted without a valid written search agreement will become the sole property of the company. No fee will be paid for hires resulting from agency referrals without a pre-existing agreement. Where agency agreements are in place, introductions are position specific. Please no phone calls or emails.