Senior Palantir Foundry Data Engineer
Big Data
Data Analysis
Data Analytics
Data Architecture
Data Engineer
Data Integration
Data Integration Tools
Data Pipeline
Data Platform
Data Processing
Database
Databases
ETL
Foundry Ecosystem
Informatica
Information Technology (IT)
Palantir Foundry
Palantir Ontology
Programming
Programming Language
Programming Languages
Reporting and Analytics
Software Development
Spark Streaming
SQL
Job Description
Pivot Point Solutions is hiring a Senior Palantir Foundry Data Engineer for a hybrid contract role based in Oakland, CA (with 1 day onsite per week). In this position, you will design, develop, and support enterprise data pipelines, data products, and operational solutions using Palantir Foundry, with a focus on real-time and near-real-time processing and production-grade engineering.
Key Responsibilities
- Design, develop, and maintain enterprise data pipelines using Palantir Foundry, PySpark, Python, and SQL.
- Build and enhance Foundry Ontology models, including object types, properties, relationships, and actions.
- Develop real-time and near-real-time pipelines using Spark Streaming and event-driven processing technologies.
- Create application and integration logic using TypeScript, REST APIs, and Foundry integration capabilities.
- Develop analytical workflows, data exploration solutions, and operational reporting using Foundry Contour.
- Translate SQL queries, stored procedures, triggers, ETL mappings, and business rules into scalable Foundry and PySpark solutions.
- Design and maintain reusable data engineering frameworks to support consistent processing and integration.
- Implement data quality checks, schema validation, metadata management, lineage tracking, and pipeline monitoring.
- Optimize pipelines for performance, scalability, reliability, and operational efficiency.
- Develop and maintain integrations between Foundry and enterprise applications, databases, and external data sources.
- Use production-grade engineering practices including Git, CI/CD, automated testing, and code reviews.
- Troubleshoot complex pipeline failures, data inconsistencies, and processing performance issues.
- Collaborate with business stakeholders and technical teams to translate operational requirements into scalable solutions.
- Participate in Agile/Scrum activities, architecture reviews, and technical planning.
- Support enterprise data modernization and continuous improvement initiatives.
Requirements
- 10+ years of overall IT or data engineering experience, including at least 5 years hands-on data engineering or ETL development.
- Direct experience developing and supporting production data pipelines using Palantir Foundry.
- Hands-on experience with Foundry Ontology, including object modeling, relationships, and actions.
- Advanced development experience with PySpark, Python, and SQL for large-scale processing and ETL/ELT.
- Experience using TypeScript, REST APIs, and Foundry integration capabilities to build enterprise data solutions.
- Experience developing analytical workflows using Foundry Contour and implementing real-time or streaming pipelines.
- Experience with data modeling, data quality, metadata management, lineage, and production pipeline monitoring.
- Experience with Git, CI/CD, automated testing, and distributed or cloud-based data processing environments.
Additional Ways You May Stand Out
- Palantir Foundry Data Engineer Certification.
- Experience developing advanced Ontology models, Foundry APIs, and real-time operational data products.
- Experience with AWS or other enterprise cloud data platforms.
- Experience in the energy and utility industry, particularly outage management, ADMS/OMS, grid operations, ETOR, PSPS or customer communications.
Tech Stack
- Palantir Foundry, PySpark, Python, SQL
- Foundry Ontology, TypeScript, REST APIs
- Foundry Contour, Spark Streaming
- Git, CI/CD
Role Details
- Location: Oakland, CA (Hybrid, 1 day onsite per week)
- Job Type: Contract
- Contract Length: 24 Months +
- Compensation: $53-$80/hr
- Seniority: Senior
- Sector: Information Technology / Data Engineering