Azure DevOps

Azure DevOps Data Jobs

9 jobs found

2d ago

Salesforce Technical AI Engineer (Senior Consultant, Technical Transformation)

Deloitte Arlington, VA

Arlington, VA

2d ago

$118k - $160k/yr Full time Anthropic Claude Code Artificial Intelligence Automation

Apply Now

Job Description

Senior Salesforce Technical AI Engineer (Technical Transformation) at Deloitte, based onsite in Arlington, VA. This role leads the design, development, and deployment of Salesforce Public Sector solutions with GenAI integration, CI/CD, and government-client engagement in the Washington, DC region. The position requires a Bachelor’s degree and at least three years of relevant experience.

Responsibilities

Lead the end-to-end design, development, and deployment of advanced solutions using Salesforce Public Sector offerings and emerging capabilities such as Agentforce within mission-critical programs.
Establish and manage robust CI/CD pipelines and DevOps practices to ensure rapid and secure delivery.
Serve as a technical manager and hands-on innovator, embedding GenAI and modern AI practices directly into the development lifecycle to accelerate delivery and enhance system capabilities.
Work across the full technology stack, from backend integrations with large data platforms (Salesforce Data Cloud, Informatica, Databricks, Palantir Foundry) to frontend user experiences.
Collaborate directly with senior government clients, providing technical leadership and translating complex mission requirements into scalable, forward-looking solutions.

Requirements

Bachelor’s degree and a minimum of 3 years of relevant experience.
Ability to work independently as well as within a team environment.
Effective written and verbal communication skills.
Meticulous attention to detail and a commitment to high-quality work products.
Ability to build and sustain professional relationships.
Capability to lead projects or workstreams.
Proficiency in managing and prioritizing multiple tasks in a fast-paced setting.
Strong interpersonal skills and a professional demeanor.
Ability to meet deadlines consistently.
Experience mentoring others and providing clear guidance.

Technologies

Salesforce
Apex
LWC
Salesforce Data Cloud
Informatica
Databricks
Palantir Foundry
Agentforce
Slack
MuleSoft
Azure DevOps
Jenkins
GitLab
Claude Code
GitHub Copilot

Benefits

Compensation range: USD 118,000 - 160,000 per year
Discretionary annual incentive program

The Team

Deloitte's Government & Public Services GPS practice focuses on delivering impact through people, ideas, technology, and outcomes. The team serves federal, state, and local government clients as well as public higher education institutions, bringing a fresh perspective to help clients anticipate disruption, reimagine possibilities, and fulfill their mission promises. The Sales & Service offering designs and implements sales and service experiences, capabilities, and architectures required to translate customer strategies into tangible results.

View full job page →

14d ago

Full-Stack Azure Data Engineer

Telecommunications Development Corp. Laurel, MD

Laurel, MD

14d ago

Full time Azure Data Lake Storage Azure Databricks Azure DevOps

Apply Now

Job Description

This in-person, full-time role is based in Laurel, MD. You will develop, deploy, and maintain cloud-native data pipelines using Azure Databricks, Synapse, and Azure DevOps.

Responsibilities

Build and scale ETL and ELT pipelines using Azure Databricks notebooks and Synapse scripts.
Implement standardized logging, error handling, and restartable processing patterns to ensure pipeline reliability.
Configure integrations with Azure Data Lake Storage, source systems, and enterprise data platforms.
Architect and maintain CI/CD pipelines and code repositories to automate environment promotion and release management.

Requirements

Strong proficiency in Python and SQL.
Proven expertise in Azure Databricks and Azure Synapse development.
Deep experience with automated deployment strategies like Azure DevOps.

Technologies

Python
SQL
Azure Databricks
Azure Synapse
Azure DevOps
Azure Data Lake Storage

View full job page →

18d ago

Senior Data Engineer

Deloitte Miami, FL

Miami, FL

18d ago

$95k - $150k/yr Full time Senior Azure Azure Data Factory

Apply Now

Job Description

Senior Data Engineer in Miami, FL (onsite) at Deloitte, with a salary range of USD 95,000 - 150,000 per year and a Bachelor's degree requirement, focusing on end-to-end data solutions and ETL/ELT pipelines using Azure Data Factory and Databricks, including governance, design, development, optimization, and mentoring within the Project Delivery Model.

Responsibilities

Maintain regular communication with Engagement Managers, project teams, and cross-functional stakeholders, escalating issues that need engagement management input.
Design, develop, and optimize ETL and ELT pipelines leveraging Azure Data Factory and Databricks.
Author and tune PySpark and Spark SQL notebooks to handle large-scale data transformations.
Architect end-to-end data solutions across development, UAT, and production environments using Unity Catalog.
Steer design discussions with client architects and other counterparts to align on technical direction.
Collaborate with multiple teams on data contracts and schema agreements to ensure interoperability.
Lead the design and optimization of high-volume data pipelines.
Define and enforce data engineering standards, including naming conventions, partitioning strategies, cluster configurations, and Spark tuning.
Drive performance improvements through AQE tuning, liquid clustering, broadcast joins, and shuffle partition management.
Design Databricks cluster policies, autoscaling settings, and cost-optimization strategies.
Perform root cause analysis on production incidents and implement permanent fixes.
Mentor junior and mid-level engineers via code reviews and pair programming.
Evaluate new technologies and advise on adoption, such as Delta Apps (DABs), Delta Live Tables (DLT), Auto Loader, Serverless Compute, and Event Hubs.

Requirements

Python, PySpark, Spark SQL, and SQL Server proficiency.
Experience with Azure services including Data Factory, Data Lake Storage Gen2, Key Vault, and Azure Monitor.
Hands-on work with Databricks components such as Delta Lake, Unity Catalog, and Workflows.
Apache Airflow for workflow orchestration.
Git and Azure DevOps for version control and CI/CD.
Deep understanding of Spark internals, including DAG optimization, spill analysis, and skew handling.
Advanced Delta Lake features such as time travel, deletion vectors, and predictive I/O.
Unity Catalog governance covering row and column security, external locations, and system tables.
Infrastructure as code experience with Terraform and Azure ARM templates.
Bachelor's degree in Computer Science, Information Technology, Computer Engineering, or related IT discipline, or equivalent experience.
Limited immigration sponsorship may be available.
Ability to travel about 10 percent on average based on client needs and engagements.

Technologies

Python
PySpark
Spark SQL
SQL Server
Azure Data Factory (ADF)
Azure Data Lake Storage Gen2
Key Vault
Azure Monitor
Databricks
Delta Lake
Unity Catalog
Workflows
Apache Airflow
Git
Azure DevOps
Terraform
Azure ARM templates
DABs
Delta Live Tables (DLT)
Auto Loader
Serverless Compute
Event Hubs

View full job page →

1mo ago

Machine Learning Engineer

Robert Half Los Angeles, CA

Los Angeles, CA

1mo ago Closed

$200k - $260k/yr Full time Ai Ml Artificial Intelligence Azure Databricks

This position is no longer accepting applications (closed Jul 13, 2026).

Job Description

Robert Half invites a Machine Learning Engineer to join onsite in Los Angeles, focusing on deploying and operating scalable ML infrastructure and GenAI/LLM systems. The role centers on MLOps platforms, feature stores, vector search, RAG, and CI/CD automation on Databricks. The position offers a competitive annual salary of USD 200,000 to 260,000, along with a comprehensive benefits package and opportunities for professional development.

Benefits

Medical insurance
Vision insurance
Dental insurance
Life insurance
Disability insurance
401(k) plan
Free online training

Responsibilities

Lead the design, implementation, and ongoing maintenance of scalable ML infrastructure on Databricks, including MLflow for experiment tracking, a model registry, and model serving endpoints.
Oversee the development of the ML Ops platform and automated pipelines for deploying, monitoring, and maintaining models in production environments.
Implement robust solutions for model versioning, systematic retraining, and artifact management using Databricks Unity Catalog for ML governance.
Design and manage Databricks Feature Store to ensure consistent feature engineering across training and inference pipelines.
Architect and implement Retrieval-Augmented Generation (RAG) systems for document Q&A, enabling business teams to query fund documents, investor letters, and market research.
Design, deploy, and manage vector database solutions (Databricks Vector Search, Pinecone, or similar) for semantic search and retrieval across enterprise documents.
Lead LLM fine-tuning and customization initiatives, training models like Claude or open-source alternatives with CIM proprietary data while ensuring data privacy and compliance.
Develop and optimize document processing pipelines including PDF parsing, chunking strategies, and embedding generation for RAG applications.
Implement prompt engineering best practices and LLM evaluation frameworks to ensure output quality, relevance, and factual accuracy.
Build guardrails and safety measures for GenAI applications, including hallucination detection, output validation, and source attribution.
Design and implement extensive automation across the ML workflow, covering model training, testing, validation, and deployment using Databricks Workflows and Asset Bundles.
Set up robust CI/CD pipelines for both traditional ML models and GenAI applications, leveraging GitHub Actions, Azure DevOps, or similar tools.
Automate complex data and model workflows utilizing orchestration tools such as Airflow, Prefect, or Databricks Workflows.

Technologies

Databricks
MLflow
Databricks Unity Catalog
Databricks Feature Store
Databricks Vector Search
Pinecone
Claude
GitHub Actions
Azure DevOps
Airflow
Prefect
Databricks Workflows
Asset Bundles
Python
TensorFlow

View full job page →

1mo ago

Associate Data Engineer

Baker Tilly Advisory Group, LP Milwaukee, WI

Milwaukee, WI

1mo ago Closed

$86k - $163k/yr Full time Analytics Automation Azure Data Factory

This position is no longer accepting applications (closed Jul 3, 2026).

Job Description

The Associate Data Engineer collaborates with cross-functional teams to design, build, and optimize data platforms for mid-market and enterprise clients. Focusing on the Microsoft stack, the role leverages Azure, Synapse, and Microsoft Fabric to convert raw data into analytics-ready assets for dashboards, advanced analytics, and AI use cases.

Location

Milwaukee, WI (onsite)

Compensation

USD 85,910 - 162,890 per year

Responsibilities

Data engineering: Build scalable ETL/ELT pipelines using T-SQL, Python, Azure Data Factory or Fabric Data Pipelines, and Databricks; apply best practice patterns for performance, security, and cost control.
Modeling and storage: Design relational and lakehouse models; implement Fabric OneLake shortcuts, medallion-style layers, and dimensional/semantic models for Power BI.
Quality and governance: Create automated data quality checks, lineage, and observability metrics; contribute to CI/CD workflows in Azure DevOps or GitHub.
Client delivery: Gather requirements, demonstrate iterative deliverables, document technical designs, and translate complex concepts for non-technical audiences.
Continuous improvement: Explore new capabilities, share findings in internal communities of practice, and contribute to reusable accelerators. Collaborate with clients and internal stakeholders to design scalable data engineering solutions.

Requirements

Bachelor's degree in Computer Science, Information Systems, Engineering, or related field, or equivalent experience.
2–3 years delivering production data solutions, preferably in a consulting or client-facing role.
Strong T-SQL for data transformation and performance tuning.
Python for data wrangling, orchestration, or notebook-based development.
Hands-on ETL/ELT with at least one Microsoft service (Azure Data Factory, Synapse Pipelines, or Fabric Data Pipelines).
Project experience with Microsoft Fabric (OneLake, Lakehouses, Data Pipelines, Notebooks, Warehouse, Power BI DirectLake) preferred.
Familiarity with Databricks, Delta Lake, or comparable lakehouse technologies preferred.
Exposure to DevOps (YAML pipelines, Terraform/Bicep) and test automation frameworks preferred.
Experience integrating SaaS/ERP sources (e.g., Dynamics 365, Workday, Costpoint) preferred.

Technologies

T-SQL
Python
Azure Data Factory
Fabric Data Pipelines
Databricks
Fabric OneLake
Power BI
Azure DevOps
GitHub
Microsoft Fabric
Azure Synapse
Azure
Notebooks
Delta Lake
Dynamics 365
Workday
Costpoint
Terraform
Bicep
YAML pipelines
Power BI DirectLake

View full job page →

2mo ago

Senior Data Engineer (Azure & Databricks)

Emergent Staffing Minneapolis, MN

Minneapolis, MN

2mo ago Closed

Contract Senior Azure Data Factory Azure Databricks

This position is no longer accepting applications (closed Jun 10, 2026).

Job Description

Emergent Staffing is seeking a Senior Data Engineer with Azure Databricks expertise to design, build, and optimize a medallion based data platform and pipelines. This contract role is hybrid in Minneapolis, MN, and spans 6+ months. You will work with Delta Lake, Unity Catalog, and cloud data services to deliver analytics ready datasets in collaboration with analytics teams and business stakeholders.

This position emphasizes a collaborative culture and practical impact, with a focus on scalable architecture, governed data zones, and readiness for AI and machine learning initiatives. You'll automate deployments with Azure DevOps, integrate external data sources via REST APIs and SFTP, and support data factory pipelines, shaping data services used across the organization.

Responsibilities

Design, develop, and optimize data pipelines in Azure Databricks using PySpark and SQL, applying Delta Lake and Unity Catalog best practices.
Build modular, reusable libraries and utilities within Databricks to accelerate development and standardize workflows.
Implement Medallion architecture (Bronze, Silver, Gold) for scalable, governed data zones.
Ingest external data sources via REST APIs, SFTP file delivery, and SQL Server Managed Instance, with validation, logging, and schema enforcement.
Utilize parameter driven jobs and manage compute using Spark clusters and Databricks serverless.
Collaborate with data analytics teams and business stakeholders to understand requirements and deliver analytics ready datasets.
Monitor and troubleshoot Azure Data Factory pipelines (jobs, triggers, activities, data flows) to identify and resolve failures and data issues.
Automate deployments and manage code using Azure DevOps for CI/CD, version control, and environment management.
Contribute to documentation, architectural design, and continuous improvement of data engineering best practices.
Support the design and readiness of the data platform for AI and machine learning initiatives.

Requirements

Strong expertise with Azure Databricks, including PySpark, Delta Lake, Unity Catalog, and the ability to build reusable libraries, utility notebooks, and parameterized jobs.
Advanced SQL skills with experience working in Azure SQL Database and/or SQL Server Managed Instance.
Experience designing, troubleshooting, and supporting data pipelines using Azure Data Factory.
Proven ability to integrate external data sources, including REST APIs and SFTP.
Working knowledge of Azure DevOps for CI/CD, version control, and parameterized deployments.
Demonstrated experience partnering closely with data analytics teams and business stakeholders, supported by strong communication, problem solving, and collaboration skills.
Interest or experience in preparing data platforms to support AI and machine learning initiatives.

Technologies

Azure Databricks
PySpark
Delta Lake
Unity Catalog
SQL
Azure SQL Database
SQL Server Managed Instance
Azure Data Factory
Spark
Azure DevOps
REST APIs
SFTP
Power BI

Our Vetting Process

Application (5 minutes)
Online Assessment (40 minutes)
Initial Phone Interview (30-45 minutes)
Virtual Interview with Hiring team
Onsite Interview
Job Offer

View full job page →

2mo ago

Reporting Developer III - Cloud Analytics Data Engineer

Gulfstream Aerospace Corporation Savannah, GA

Savannah, GA

2mo ago Closed

Full time Senior Analytics Auto Loader

This position is no longer accepting applications (closed Jun 7, 2026).

Job Description

This onsite Savannah, GA role focuses on enterprise reporting development and data analytics within Gulfstream's Enterprise Reporting team, using Azure Databricks or Microsoft Fabric to drive business insights.

Responsibilities

Engage stakeholders and technology users to identify, analyze, and document business requirements.
Ensure consistency of application processes and adherence to applicable policies, procedures, and standards.
Perform routine administration and system maintenance for reporting and data analytics applications and solutions.
Document, develop, test, deploy, and support reporting and data analytics development using a variety of technical tools aligned to business needs.
Lead briefings and participate in technical meetings for specific projects or activities.
Carry out other duties as assigned.
Experience with Agile development methodology and working on an agile team preferred.
Understand software development lifecycle (SDLC) methodologies.
Conduct testing, including design and execution of test cases.
Interpret data structures and create effective visualizations and reports that generate business value.
Design and deliver compelling presentation materials.
Lead and facilitate cross-functional meetings and teams.

Requirements

Minimum 3 years of experience with Azure Databricks or Python ETL pipelines.
Experience with medallion framework architecture and ingesting data from on-premise systems to either Azure Databricks or Microsoft Fabric.
Production-grade Python code experience for data ingestion, transformation, and export, including unit testing, building reusable frameworks, error handling, disaster recovery, and logging frameworks.

Technologies

Azure Databricks
Databricks
Microsoft Fabric
Python
Delta Live Tables
Databricks Workflows
Declarative Pipelines
Auto Loader
Unity Catalog
Databricks CLI
Azure Active Directory
Databricks Jobs UI
Azure DevOps
Terraform
Databricks Asset Bundles
Power BI
SQL Server
Oracle

Databricks skillset

Experience managing workspace configurations, user roles, and access controls using Unity Catalog, Databricks CLI, and Azure Active Directory integration.

Microsoft Fabric skillset

Understanding of Lakehouse and Warehouse architecture and security.
Ability to configure pipelines, pipeline coordination, and monitoring.
Experience with semantic modeling and Power BI.

Education and Experience

Bachelor's Degree in Information Technology, Computer Science, Engineering or a related field, or an equivalent mix of education and experience.
At least 6 years of relevant business or technical experience, including a minimum of 3 years in reporting, data analytics, or related development/deployment roles.
Master's Degree may offset one year of experience; PhD may offset two years.
Position purpose: a data and analytics development role within Gulfstream Business Technology for the Enterprise Reporting team, supporting the Gulfstream Enterprise Reporting applications, including requirements development, solution design, testing, deployment, and ongoing support.