Dataops

Dataops Jobs

13 jobs found

1d ago

Data Engineer Senior Principal

General Dynamics Information Technology Fort Bragg, NC

Fort Bragg, NC

1d ago

$145k - $196k/yr Full time Manager Senior Analytics

Apply Now

Job Description

General Dynamics Information Technology is hiring a Senior Principal Data Engineer to support the USASOC OTA Program, helping modernize a DoD client’s data architecture. In this hybrid role based around Fort Bragg, NC, you will apply advanced data engineering expertise, lead technical delivery efforts, and contribute to mission-focused solutions that support warfighter readiness and decision-making.

Key Responsibilities

Apply expertise in cloud-based data architectures to support mission-critical operations.
Evaluate the current environment and recommend tools and capabilities spanning on-premises, cloud, and hybrid resources.
Partner with the client’s migration teams to implement strategy and architecture design.
Serve as Team Lead for a small but growing team delivering technical outputs using live data to build dynamic, visual dashboards based on customer direction.
Coordinate with a government PM to establish sprint cadence and maintain status dashboards.
Work in a hybrid schedule: 50% remote / 50% onsite at the customer location(s) on or around Fort Bragg, NC.

Required Qualifications

10+ years of related experience (may vary based on technical training, certification(s), or degree).
Master’s degree in computer science or a related field.
U.S. Citizen status due to U.S. Government Contract requirements.
Current DoW Secret Clearance is required.
Experience with SQL databases.
Experience integrating with S3 and Block Storage.
Python scripting experience.
3-5 years with non-proprietary big data technologies (examples: Presto, Hive, Spark, Flink); Presto/Trino is preferred.
3-5 years with data lake/warehouse technical architecture, infrastructure components, and ETL/ELT pipelines.
3-5 years with workflow management engines (examples: Airflow, AWS Step Functions, Prefect).
Experience understanding requirements, analyzing data, identifying opportunities and gaps, and communicating findings to multiple individuals and stakeholders.
3-5 years in software development, infrastructure, or Cloud operations.
Experience with multiple operating systems, including Linux, UNIX, and Windows.
Experience with Amazon Web Services (AWS) and Microsoft Azure.
Experience deploying containerized microservices on Kubernetes infrastructure.
Role requirements include a hybrid work environment with 2-3 days on site at Fort Bragg and 2-3 days remote.
Travel: 10-25%.

Technologies

SQL
Amazon S3, Block Storage
Python
Presto, Trino, Hive, Spark, Flink
ETL/ELT
Airflow, AWS Step Functions, Prefect
Linux, UNIX, Windows
Amazon Web Services (AWS), Microsoft Azure
Kubernetes

Desired Skills

Experience applying DoW security technical implementation guides (STIGs) and automating that process.
Experience working in defense or intelligence community cloud environments (plus).
Experience with the PowerBI ecosystem, primarily establishing and maintaining DataFlows.
Experience optimizing cloud environments: using native cloud capabilities, right-sizing servers, expanding storage, and tracking cost efficiencies at the microservice level.
Experience configuring and aggregating logs for data analysis using Splunk or ELK solutions.
Experience managing data pipelines between networks and TAK infrastructure.

Benefits

Growth: AI-powered career tool that identifies career steps and learning opportunities.
Support: an internal mobility team focused on helping you achieve career goals.
Rewards: comprehensive benefits and wellness packages.
401K with company match.
Competitive pay and paid time off.
Community: award-winning culture of innovation and a military-friendly workplace.

Salary Information

The likely salary range for this position is $144,500 - $195,500 per year.

Identity Verification Process

You are expected to be on camera during virtual interviews.
The company may take your picture to verify your identity and prevent fraud.
By proceeding, you authorize the collection, processing, and use of your biometric data for identity verification and security purposes.

View full job page →

3d ago

Data Engineer - Business Analytics

Primoris Services Corporation Texas 📍 United States Remote

Texas

3d ago

$135k - $155k/yr Full time Analytics Azure Data Lakehouse Big Data

Apply Now

Job Description

Primoris Services Corporation is hiring a Data Engineer focused on Business Analytics, supporting an enterprise analytics platform built around Azure and Databricks. In this role, you will design and optimize analytics-ready datasets using a modern Lakehouse approach, delivering curated Silver and Gold assets with the semantic layer implemented in Databricks.

What you’ll do

Design, build, and maintain scalable data pipelines and curated datasets within the Databricks Lakehouse (Silver and Gold layers).
Develop and manage analytics-ready data models and semantic structures in Databricks based on enterprise reporting needs.
Transform raw data into business-consumable datasets using standardized definitions, KPIs, and metrics.
Apply dimensional modeling and other data modeling techniques within a distributed data environment.
Own and deliver the semantic layer in Databricks to support consistent definitions across reporting and analytics use cases.
Enable downstream consumption by visualization and analytics tools such as Power BI, without relying on embedded semantic modeling.
Partner with business analysts and reporting teams to improve dataset usability, performance, and scalability.
Optimize datasets and models for performance, including query efficiency and scalability for enterprise reporting workloads.
Ensure data quality, integrity, and consistency across the data lifecycle.
Implement and enforce data governance standards, including security, masking, access controls, and cost controls.
Translate business requirements into scalable data solutions in collaboration with business leaders and stakeholders.
Align data structures to enterprise data dictionary and KPI definitions.
Communicate dataset and data model designs clearly to technical and non-technical stakeholders.
Support platform evolution within Azure and Databricks.
Contribute to best practices for CI/CD, deployment automation, and data engineering standards.
Support the expansion of data capabilities, including assistance with AI/ML use cases where applicable.

What you bring

Bachelor’s degree in Information Technology, Computer Science, Business Analytics, or a related field.
6+ years of experience in data engineering, data modeling, or analytics engineering roles.
Strong expertise in Databricks Unity Catalog, SQL, and Python for transformations and pipeline development.
Proven experience designing and implementing data models within modern data platforms such as Lakehouse architecture.
Experience with medallion architecture (Bronze/Silver/Gold layers).
Knowledge of BI tools such as Power BI, with emphasis on dataset consumption rather than ownership of the semantic layer.
Experience with CI/CD pipelines, version control, and deployment processes.
Familiarity with Agile/Scrum delivery methodologies.

Tools and technologies

Databricks, Databricks Lakehouse, Databricks Unity Catalog
SQL, Python
Azure
Power BI
CI/CD pipelines
Agile/Scrum

Pay and benefits

Salary: USD 135,000 - 155,000 per year
Pay equity compensation range: $135,000 - $155,000
401k with employer match
Health/Dental/Vision insurance plans
Paid time off
10 paid holidays
Stock purchase plan

Location and work conditions

Location: Texas (remote)
Occasional travel may be required
Flexible work hours may be necessary to meet project deadlines

Salary note: Pay equity compensation range is USD $135,000 - $155,000.

View full job page →

5d ago

Principal Data Engineer, People Data

Okta Bellevue, WA

Bellevue, WA

5d ago

$197k - $271k/yr Full time Apache Airflow Big Data Bigdata

Apply Now

Job Description

Principal Data Engineer for Okta’s People Data / Data & Insights team, focused on building scalable enterprise data platforms for candidate and employee lifecycle reporting.

Responsibilities

Design, build, and continuously improve high-scale data solutions that act as the organization’s reference architecture and streamline enterprise data access
Create data quality frameworks including monitoring, anomaly detection, and alerting, with governance, lineage tracking, and change management rigor for externally reported numbers
Promote standardized data modeling patterns, naming conventions, documentation practices, and metric governance across the data organization
Lead complex cross-functional technical initiatives across data verticals to accelerate delivery and strengthen data systems
Make sound technical decisions under ambiguity, balancing near-term delivery with long-term infrastructure investment
Champion Data Contracts by implementing data contracts and schema evolution practices to improve reliability across global product teams
Mentor and raise the technical bar by coaching senior engineers, leading cross-functional task forces, and supporting a culture of engineering excellence and data-driven decision-making
Evaluate and advocate for emerging data technologies and practices to inform the team’s long-term technical direction

Requirements

10+ years in a data engineering role, with proven experience in a senior or lead capacity
Highly desirable: experience with Federal government compliance and security requirements
Expert-level experience with SQL, ETL/ELT tools (Airflow, dbt), and MPP databases (Snowflake, Redshift)
Extensive hands-on AWS experience with S3, Lambda, EMR, ECR, EKS
HR data expertise, including candidate lifecycle, employee records, compensation, and organizational data; ability to design data models for recruiting analytics, engagement signals, and workforce planning metrics
Bonus: familiarity with Workday data structures
Experience building and maintaining batch and real-time pipelines using technologies such as Spark and Kafka
Deep experience with modern lakehouse and warehouse architectures (Databricks, Snowflake) and modern file formats (Iceberg, Delta)
Demonstrated ability to integrate AI tools to optimize or redesign workflows and drive measurable impact (such as efficiency gains and quality improvements)
Proven track record of hands-on collaboration with Data Science, Business, and Product teams

Tools & Technologies

SQL, Airflow, dbt, Snowflake, Redshift
AWS: S3, Lambda, EMR, ECR, EKS
Spark, Kafka
Databricks, Iceberg, Delta

Location & Compensation

Bellevue, WA (hybrid)
Salary: USD 197,000 - 270,600 per year

Okta Experience

Supporting Your Well-Being
Driving Social Impact
Developing Talent and Fostering Connection + Community

View full job page →

5d ago

Principal Data Engineer, Product Data

Okta Chicago, IL

Chicago, IL

5d ago

$197k - $271k/yr Full time Apache Airflow Data Architecture Data Build Tool

Apply Now

Job Description

Okta is seeking a Principal Data Engineer, Product Data to architect, build, and maintain scalable, high-scale data solutions focused on product behavioral and telemetry data. This role leads cross-functional efforts to strengthen data availability, integrity, governance, and consistent modeling and metric standards.

Role Overview

You will serve as a technical leader responsible for designing reference data architecture that improves organization-wide data access. The position emphasizes data quality and governance rigor suitable for externally reported metrics, along with long-term infrastructure planning while delivering in an ambiguous environment.

Key Responsibilities

Design, build, and evolve high-scale data solutions that act as a reference architecture for the organization and simplify data access
Develop data quality frameworks, monitoring, anomaly detection, and alerting, with governance, lineage tracking, and change management practices appropriate for externally reported numbers
Drive adoption of consistent data modeling patterns, naming conventions, documentation norms, and metric governance standards across the data organization
Lead cross-functional technical initiatives across data verticals to accelerate delivery and harden data systems
Navigate ambiguity and make sound technical decisions by balancing short-term delivery with long-term infrastructure investment
Champion data contracts by implementing data contracts and schema evolution practices to improve reliability across global product teams
Mentor and scale by raising the technical bar through mentoring senior engineers, leading cross-functional task forces, and supporting a culture of engineering excellence and data-driven decision-making
Adopt and advocate for emerging technologies and practices to guide the team’s long-term technical direction

Required Qualifications

10+ years of experience in a data engineering role, including senior or lead capacity
Federal government compliance and security requirements experience is highly desirable
Deep expertise in product behavioral data engineering, including telemetry data for structured product launch analysis, feature usage, retention, and other product lifecycle metrics
Proven experience partnering with Product Engineering teams on successful instrumentation for data collection
Expert-level experience with SQL; ETL/ELT tools including Airflow and dbt; and MPP databases including Snowflake and Redshift
Extensive hands-on experience with AWS services including S3, Lambda, EMR, ECR, and EKS
Deep experience designing and working with lakehouse architectures using Databricks and modern file formats including Iceberg and Delta

Technologies

SQL, Airflow, dbt
Snowflake, Redshift
AWS S3, AWS Lambda, AWS EMR, AWS ECR, AWS EKS
Databricks, Iceberg, Delta

Location and Compensation

Chicago, IL (hybrid)
USD 197,000 to 270,600 per year

The Okta Experience

Supporting Your Well-Being
Driving Social Impact
Developing Talent and Fostering Connection + Community

View full job page →

6d ago

Principal Data Engineer, People Data

Okta Chicago, IL

Chicago, IL

6d ago

$197k - $271k/yr Full time Manager Senior 3d Design Tools

Apply Now

Job Description

As a Principal Data Engineer, People Data at Okta, you will architect and deliver scalable data solutions that power candidate and employee information across the organization. This hybrid role in Chicago, IL is built for engineers who want to lead complex initiatives, raise the technical bar, and ensure data remains available, accurate, and trustworthy through every stage of the employee lifecycle.

Compensation: USD 197,000 - 270,600 per year. Experience: 10+ years in data engineering.

What you’ll do

Design, build, and evolve high-scale data solutions that serve as the organization’s reference architecture and make data access simpler across teams.
Create data quality frameworks, monitoring, anomaly detection, and alerting, including governance, lineage tracking, and change management rigor for externally reported numbers.
Drive consistent data modeling patterns, naming conventions, documentation norms, and metric governance standards across the data organization.
Lead cross-functional technical initiatives across data verticals to accelerate delivery and harden data systems.
Make sound technical decisions in ambiguous situations, balancing short-term execution with long-term infrastructure investment.
Champion Data Contracts by implementing data contracts and schema evolution practices for reliable integration across global product teams.
Mentor and scale by raising the technical bar through mentoring senior engineers, leading cross-functional task forces, and fostering engineering excellence and data-driven decision making.
Stay current with the data landscape by adopting and advocating for emerging technologies and practices to shape the team’s long-term technical direction.

What you’ll bring

10+ years in a data engineering role, with proven experience in a senior or lead capacity. Federal government compliance and security requirements experience is highly desirable.
Expert-level experience with SQL, ETL/ELT tools such as Airflow and dbt, and MPP databases including Snowflake and Redshift.
Extensive hands-on experience with AWS services: S3, Lambda, EMR, ECR, EKS.
Deep HR data expertise, including candidate lifecycle, employee records, compensation, and organizational data.
Experience designing data models for recruiting analytics, engagement signals, and workforce planning metrics.
Familiarity with Workday data structures is a bonus.
Experience building and maintaining batch and real-time pipelines using technologies like Spark and Kafka.
Deep experience with modern lakehouse and warehouse architectures (including Databricks and Snowflake) and modern file formats (Iceberg, Delta).
Demonstrated ability to integrate AI tools to optimize or redesign workflows and drive measurable impact such as efficiency gains and quality improvements.
Track record of hands-on collaboration with Data Science, Business, and Product teams.

Technologies you’ll work with

SQL, Airflow, dbt
Snowflake, Redshift
AWS S3, AWS Lambda, AWS EMR, AWS ECR, AWS EKS
Spark, Kafka
Databricks, Iceberg, Delta

The Okta Experience

Supporting Your Well-Being
Driving Social Impact
Developing Talent and Fostering Connection + Community

View full job page →

7d ago

Principal Data Engineer, Product Data

Okta San Francisco, CA

San Francisco, CA

7d ago

$197k - $271k/yr Full time 3d Design Tools Apache Airflow Big Data

Apply Now

Job Description

Okta is building scalable data capabilities that power reliable product behavioral and telemetry insights. As a Principal Data Engineer for Product Data, you will architect, deliver, and evolve critical data solutions while partnering across global product and engineering teams to strengthen data availability, integrity, and governance.

What you’ll do

Design, build, and evolve high-scale data solutions that act as the organization’s reference architecture and make data access simpler across teams.
Create data quality frameworks including monitoring, anomaly detection, and alerting, with governance, lineage tracking, and change management rigor aligned to externally reported numbers.
Drive consistent data modeling patterns, naming conventions, documentation norms, and metric governance standards across the data organization.
Lead cross-functional technical initiatives across data verticals to accelerate delivery and harden data systems.
Navigate ambiguity and make sound technical decisions by balancing near-term delivery with long-term infrastructure investment.
Champion Data Contracts by implementing data contracts and schema evolution practices that support reliability across global product teams.
Mentor and scale engineering impact by mentoring senior engineers, leading cross-functional task forces, and fostering a culture of engineering excellence and data-driven decision-making.
Stay current with the data landscape and advocate for emerging technologies and practices to shape the team’s long-term technical direction.

What you bring

Experience: 10+ years in data engineering in a senior or lead capacity. Federal government compliance and security requirements experience is highly desirable.
Product data expertise: Deep experience in product behavioral data engineering, especially telemetry data for structured analysis tied to product launch, feature usage, retention, and other key product lifecycle metrics.
Instrumentation partnership: Proven experience partnering with Product Engineering teams to support successful instrumentation for data collection.
Technical expertise: Expert-level SQL, ETL/ELT tools (Airflow, dbt), and MPP databases (Snowflake, Redshift), plus hands-on experience with AWS services including S3, Lambda, EMR, ECR, and EKS.
Modern architectures: Deep experience working with lakehouse architectures (Databricks) and modern file formats (Iceberg, Delta).

Core technologies

SQL, Airflow, dbt
Snowflake, Redshift
AWS S3, AWS Lambda, AWS EMR, AWS ECR, AWS EKS
Databricks, Iceberg, Delta

Location: San Francisco, CA (hybrid). Compensation: USD 197,000 - 270,600 per year. Experience level: 10 years.

The Okta experience

Supporting Your Well-Being
Driving Social Impact
Developing Talent and Fostering Connection + Community

View full job page →

7d ago

Staff Data Engineer I

Bain & Co. Chicago, IL

Chicago, IL

7d ago

$141k - $169k/yr Full time Analytics Apache Airflow Business Intelligence

Apply Now

Job Description

Bain & Co. is seeking a Staff Data Engineer I to join its NGSS team, embedded in Aura, Bain’s global workforce data and analytics platform. This role focuses on building and operating the data infrastructure that enables analytics, machine learning, and product experiences, with ownership across architecture, reliability, scalability, and day-to-day production support.

Role context

As part of the Aura platform, you will help ensure the underlying systems are dependable and cost-effective, supporting downstream analytics layers including dashboards and machine learning features.

Responsibilities

Own the architecture, reliability, and scalability of Aura’s data platform.
Design, build, and maintain reliable and scalable data pipelines from raw ingestion through downstream analytics layers, including dashboards and ML features.
Lead greenfield data infrastructure projects from scratch and take ownership through production delivery.
Optimize performance and cost across data workflows, including query tuning and storage optimization.
Establish and maintain data engineering best practices, including testing, documentation, and observability.
Participate in operational support and continuous improvement for production data systems.
Establish pipeline alerting and data quality monitors using DBT across the data stack.
Triage and resolve inbound data questions from business and technical stakeholders, including data discrepancies, pipeline issues, and ad-hoc data requests.
Partner with Engineering, Product, Data Science, and AI teams to deliver scalable data solutions.
Mentor engineers through code reviews and technical guidance.

Experience & qualifications

5-8+ years of experience designing scalable data architecture.
Associate’s/Bachelor’s degree or an equivalent combination of education, training, and experience.
Strong software engineering best practices, including testing, CI/CD, and code reviews.
Demonstrated ability to lead technical initiatives and collaborate across cross-functional teams.
Advanced SQL and deep experience with modern data warehouses, especially Snowflake.
Proficiency with orchestration tools such as Airflow.
Experience with DBT for data modeling, transformation, and data quality monitoring.
Strong Python programming skills.
Experience in cloud environments, particularly AWS (S3, Lambda, ECS, RDS, MWAA).
Familiarity with version control, CI/CD workflows, and Infrastructure-as-Code.
Experience owning and delivering greenfield projects independently.
Deep expertise in Snowflake performance tuning and cost optimization.
Background in analytics or ML data preparation.
Prior experience embedded in a startup or small data team.
Familiarity with OpenSearch for log analysis or search-backed data products.

Technologies

SQL, Snowflake, Airflow, DBT, Python
AWS (S3, Lambda, ECS, RDS, MWAA)
OpenSearch

Compensation & location

Location: Chicago, IL (onsite)
Base salary range (U.S. Illinois): USD 141,000 - 169,250 per year
Compensation includes base salary, an annual discretionary performance bonus, and a 401(k) plan with an annual employer contribution based on years of service and Bain’s benefits package.
This role may also be eligible for other elements of discretionary compensation.

Benefits

4.5% 401(k) company contribution, increasing after 3 years of service and 100% vested upon start date.
Bain & Company comprehensive benefits and wellness program designed to support personal independence, protection, and stability.
Bain pays 100% individual employee premiums for medical, dental, and vision programs.
Generous paid time off, including parental leave, sick leave, and paid holidays.
Paid Life and Long-Term Disability insurance.
Annual fitness reimbursements.