Data Scientist
Job Description
The role is centered on building and optimizing machine learning data pipelines that support AI model tracking, lifecycle management, and AI governance integrations within S&P Global’s broader data and AI infrastructure.
Role Overview
In this position, you will combine data engineering execution with AI and ML domain knowledge to design pipelines, infrastructure, and workflows that enable reliable AI data handling across the model lifecycle.
Key Responsibilities
- Design and implement specialized data pipelines for AI model metadata, training data lineage, and model performance metrics tracking.
- Build data infrastructure on Databricks using Apache Spark for large-scale distributed dataset processing.
- Develop MCP servers and enable AI data distribution via MCP.
- Create feature engineering pipelines and data preprocessing workflows for AI model training and inference.
- Implement model versioning, experiment tracking, and model registry integration using MLflow or similar tooling.
- Develop automated workflows for AI agent discovery, classification, and inventory management across the enterprise.
- Design and maintain knowledge graph structures to represent AI model relationships, dependencies, and data lineage.
- Build real-time pipelines for AI model monitoring, drift detection, and performance tracking.
- Develop data quality frameworks for AI training datasets and validation data.
- Collaborate with data scientists to optimize data access patterns and feature store implementations.
- Implement security and compliance controls for sensitive AI training data and model artifacts.
- Create comprehensive documentation for AI data architectures, schemas, and integration patterns.
Required Qualifications
- 5+ years of hands-on experience in data engineering, including at least 2 years focused on AI/ML workloads.
- Expert proficiency in Python, with experience using PyTorch, TensorFlow, or scikit-learn.
- Strong experience with Databricks, Apache Spark, and distributed computing for ML workflows.
- Deep understanding of the machine learning lifecycle, including model training, deployment, and monitoring.
- Experience with feature engineering, data preprocessing, and ML data pipelines.
- Knowledge of vector databases, embeddings, and similarity search for AI applications.
- Proficiency in SQL for managing structured and unstructured data.
- Understanding of data governance, model governance, and AI ethics principles.
- Strong analytical and problem-solving skills with attention to data quality.
- Excellent collaboration skills with data scientists, ML engineers, and architects.
- Bachelor’s or Master’s degree in Computer Science, Data Science, Machine Learning, or a related field.
Preferred / Nice-to-Have
- Experience with generative AI applications, including RAG (Retrieval-Augmented Generation) and fine-tuning.
- Knowledge of LangChain, HuggingFace, or other GenAI frameworks.
- Familiarity with Azure ML, AWS SageMaker, or Google Vertex AI.
- Experience with graph databases (such as Neo4j and Amazon Neptune) for knowledge graph implementation.
- Understanding of AI model explainability and interpretability techniques.
- Experience with A/B testing frameworks for ML model evaluation.
- Certification in Databricks, AWS, Azure, or GCP AI/ML services.
- Publications or contributions to open-source ML projects.
Technologies
Python, PyTorch, TensorFlow, scikit-learn, Databricks, Apache Spark, MLflow, MCP, SQL, vector databases, embeddings, similarity search, feature store, knowledge graphs, Neo4j, Amazon Neptune, LangChain, HuggingFace, Azure ML, AWS SageMaker, Google Vertex AI, RAG (Retrieval-Augmented Generation)
Location and Work Arrangement
New York, NY (onsite)
Compensation
- Anticipated base salary range: USD 90,000 - 150,000 per year.
- Final base salary will be based on geographical location as well as experience and qualifications.
- Additional S&P Global benefits are available in addition to base compensation.
Benefits
- Health care coverage designed for the mind and body.
- Generous time off.
- Access a wealth of resources to grow your career and learn valuable new skills.
- Competitive pay, retirement planning, a continuing education program with a company-matched student loan contribution, and financial wellness programs.
- Family friendly perks for partners and little ones.
- Retail discounts and referral incentive awards.
Mandatory Evaluation
As part of the process, there is a mandatory in-person technical evaluation.
Right to Work (US Based Out Candidates)
- This role is open only for candidates with indefinite right to work within the US.
Mission and Values
- Mission: Advancing Essential Intelligence.
- Values: Integrity, Discovery, Partnership.
Recruitment Fraud Alert
- If you receive an email from a spglobalind.com domain or other regionally based domains, it is a scam and should be reported to [email protected].
- S&P Global never requires candidates to pay money for job applications, interviews, offer letters, pre-employment training, or equipment/delivery of equipment.
Equal Opportunity Employer
- S&P Global is an equal opportunity employer and will consider qualified candidates without regard to race/ethnicity, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, marital status, military veteran status, unemployment status, or any other status protected by law.
- Only electronic job submissions will be considered for employment.
- If you need an accommodation during the application process due to a disability, email [email protected] and your request will be forwarded to the appropriate person.
US Candidates Only
Know Your Rights: Workplace discrimination is illegal.