AI Engineer

Persistent Systems is hiring an AI Engineer in New York, NY (onsite) to design, build, test, deploy, and maintain secure AI applications. You will work across the full software development lifecycle, applying modern generative AI, RAG, and agent-based technologies to deliver production-ready solutions. This role includes building the engineering foundation for performance, cost, security, and reliability, alongside a team that values documentation, code review, and best practices.

What you’ll do

• Design and maintain AI-powered applications from development through deployment and ongoing support
• Develop RAG systems, AI agents, and conversational AI solutions
• Partner with business, engineering, IT, security, and data teams to identify AI use cases and deliver solutions into production
• Create secure data ingestion, retrieval, and search pipelines for AI workloads
• Evaluate AI models, frameworks, SDKs, and cloud services based on performance, cost, security, and business needs
• Build Python APIs and services using tools such as FastAPI, Docker, and Kubernetes
• Implement AI safety, security, governance, and monitoring practices
• Create evaluation frameworks to measure quality, accuracy, latency, cost, and reliability
• Integrate AI solutions with enterprise databases and analytics platforms
• Document solutions, mentor teammates, review code, and support engineering best practices

What you bring

• 2 to 5 years of experience in software engineering, machine learning, data engineering, or AI engineering
• Bachelor’s degree in computer science, engineering, data science, mathematics, or a related field (or equivalent experience)
• Strong Python programming skills
• Experience building generative AI applications using LangChain, LangGraph, or similar frameworks
• Experience with RAG, prompt engineering, and AI application development
• Experience with at least one major AI platform: Azure AI Foundry, AWS Bedrock, Google Vertex AI, or Databricks
• Familiarity with SQL and enterprise data systems
• Strong communication and problem-solving skills
• Ability to obtain or hold a U.S. Security Clearance

Tools you may work with

Python, SQL, pandas, R, LangChain, LangGraph, LlamaIndex, CrewAI, AutoGen, Microsoft 365 Agents SDK, OpenAI Agents SDK, Claude Agent SDK, Google ADK, Azure AI Foundry, AWS Bedrock, Google Vertex AI, Databricks, FastAPI, Docker, Kubernetes, CI/CD, Hugging Face, Ollama, LangSmith, MLflow, Braintrust, Langfuse, Arize Phoenix, Power BI, Tableau, PyTorch, TensorFlow, scikit-learn, XGBoost, Microsoft Copilot Studio, Power Platform, Azure Data Factory, AWS Glue, and MLOps/LLMOps.

Compensation and benefits

Salary: USD 133,000 - 166,000 per year.

• Medical, dental, vision, life, and disability insurance
• Paid time off (sick time and vacation time)
• Flexible spending accounts
• 401(k) plan with company match
• Fitness membership reimbursement
• Tuition assistance
• Mental health benefits
• Pet discounts
• Eligibility for yearly discretionary bonus

Preferred qualifications

• Experience with multiple AI frameworks, cloud platforms, or agent SDKs
• Experience deploying open-source models with Hugging Face or Ollama
• Familiarity with FastAPI, Docker, Kubernetes, MLflow, and MLOps/LLMOps
• Experience evaluating and monitoring AI systems in production
• Knowledge of Power BI, Tableau, Microsoft Copilot Studio, or Power Platform
• Data engineering experience with Azure Data Factory, AWS Glue, or Databricks
• Experience with deep learning (PyTorch or TensorFlow) and traditional machine learning (scikit-learn, XGBoost)
• Experience working in regulated or security-sensitive environments

Preferred certifications

• Microsoft Azure AI certifications (AI-103, AI-200, AI-300)
• AWS Certified Generative AI Developer – Professional
• Google Cloud Professional Machine Learning Engineer
• Databricks Certified Generative AI Engineer Associate