Azure Data Lake

Azure Data Lake Jobs

4 jobs found

Today

Senior Data Engineer

Brooksource New York, NY 🇺🇸 Remote

New York, NY

Today

$65 - $85/hr Full time Senior Analytics API

Apply Now

Job Description

The Senior Data Engineer will design, develop, and maintain scalable data pipelines and architectures that support advanced analytics and business intelligence, leveraging big data ecosystems, cloud platforms, and robust data modeling.

Responsibilities

Design, build, and optimize large-scale ETL pipelines using Informatica, Talend, Apache Spark, and Apache Hive.
Create and sustain data architectures on cloud environments including AWS, Azure Data Lake, and other public clouds.
Partner with cross-functional teams to capture requirements and translate them into scalable data solutions.
Develop and implement data models employing dimensional modeling techniques for data warehousing and analytics.
Oversee data integration from linked data, RESTful APIs, and additional external sources.
Ensure data quality, security, and compliance throughout the data lifecycle.
Support machine learning model deployment through efficient data pipeline integration.
Apply SQL, Python, Java, Bash, and shell scripting to automate processes and improve efficiency.
Contribute to Agile practices by participating in sprint planning, reviews, and continuous improvement efforts.
Document data workflows and architecture diagrams to promote transparency and knowledge sharing.

Requirements

Proven experience as a Data Engineer or similar role focusing on big data systems and cloud-based architectures.
Extensive knowledge of AWS services (S3, Redshift, Glue), Azure Data Lake, Hadoop components, and other public cloud offerings.
Strong proficiency with SQL databases including Microsoft SQL Server, Oracle, and cloud-based options.
Hands-on ETL/ELT development experience using Informatica or Talend.
Demonstrated expertise in data modeling techniques, including dimensional modeling for enterprise data warehouses.
Proficiency in programming languages such as Python and Java, with automation scripting in VBA, Bash, and shell scripting.
Familiarity with business intelligence tools like Looker or similar platforms for reporting and analysis.
Understanding of RESTful API integration for linked data access.
Knowledge of analytics approaches related to database design, query management, model training, and analytics methodologies.
Experience delivering value in fast-paced environments using Agile methodologies.

Technologies

Informatica
Talend
Apache Spark
Apache Hive
AWS
Azure Data Lake
Hadoop
S3
Redshift
Glue
Microsoft SQL Server
Oracle
SQL
Python
Java
VBA
Bash scripting
Shell Scripting
Looker
RESTful API

Pay

$65.00 - $85.00 per hour

Location

New York, NY (remote)

View full job page →

1d ago

Staff Engineer II - Senior Data Engineer

Western Alliance Bank Phoenix, AZ

Phoenix, AZ

1d ago

Full time Senior Analytics Azure Data Factory

Apply Now

Job Description

Responsibilities

Design, develop and deploy data engineering solutions using Azure Data Factory, Azure Synapse Analytics, and Azure DevOps to support regulatory reporting and the bank’s LFI strategy.
Craft data solution designs that can be handed off to engineering teams for execution, prioritizing component reuse to maximize efficiency.
Build ETL and data pipeline capabilities, considering data creation, transformation, storage, archiving, analysis, and sharing across the bank and partner systems.
Implement Azure DevOps CI/CD pipelines for all data solutions in alignment with the bank’s technical standards.
Apply Test Driven Development to all designed, built, and deployed data solutions.
Lead the implementation of outcomes from Data Governance and Enterprise Architecture.
Oversee the migration of multidimensional cubes to tabular models to enhance analytics and performance.
Utilize Power BI to design, deploy, and visualize tabular cubes, enabling effective business intelligence integration and insights.
Perform data exploration and profiling with tools such as Excel and Informatica.
Participate actively in data architecture decision making.
Provide technical mentorship to team members and other data professionals.
Collaborate with product owners and business stakeholders to understand requirements and operational processes.
Incorporate built-in quality and compliance by design in all data solutions.
Review Azure Data Factory pipelines, Synapse artifacts, and other scripts produced by data engineers, delivering feedback to uphold quality standards.

Requirements

Bachelor’s degree in engineering or a related field; a Master’s or MBA is preferred.
7+ years of data engineering experience covering ETL concepts, enterprise data warehousing, database principles, and related tools; proficiency in Azure Data Factory, Azure Synapse Analytics, and/or Databricks is preferred.
2+ years designing, implementing, and supporting cloud data solutions; strong preference for Azure Data Lake, Azure Data Factory, Azure Data Services, Azure Synapse, Azure Logic Apps, and Azure DevOps.
Advanced experience with at least one RDBMS and query languages such as T-SQL, PL/SQL, or Spark SQL.
Advanced expertise in conceptual, logical, and physical data design.
Azure certifications such as Azure Fundamentals, Azure Data Engineer, Azure Data Scientist, and/or Azure DevOps Engineer are preferred.
Familiarity with data science and analytics tools such as SAS, Tableau, and Power BI.
Familiarity with multi-cloud data management and transformation platforms or tools such as Databricks and Snowflake.
Experience with Agile, SAFe, and/or Scrum methodologies is preferred.
Experience integrating with data quality, data catalog, and data lineage tools is preferred.
Previous leadership experience is preferred.
Intermediate to advanced knowledge of general financial services or banking is preferred.
Advanced knowledge of regulatory and legal compliance obligations, rules, and industry standards.
Proven ability to lead cross-functional teams and manage multiple projects concurrently, including pipeline development and Azure DevOps usage across multiple projects.
Strong strategic thinking with the ability to align projects with organizational goals, lead and motivate teams, resolve conflicts, and mitigate risks; governance patterns tied to intake, technical reviews, and architectural compliance are advantageous.
Excellent spoken and written communication skills.
May require up to 25% travel.

Technologies

Azure Data Factory
Azure Synapse Analytics
Azure DevOps
Azure Data Lake
Azure Logic Apps
Power BI
Excel
Informatica
Databricks
Snowflake
SAS
Tableau
Azure Data Services
T-SQL
PL/SQL
Spark SQL

Benefits

Competitive salaries
Ownership stake in the company
Medical and dental insurance
Time off
Strong 401k matching program
Tuition assistance program
Employee volunteer program
Wellness program

Location

Block 23, Phoenix, AZ (onsite)

View full job page →

2d ago

Data Engineer

Asylon Norristown, PA

Norristown, PA

2d ago

$120k - $160k/yr Full time Python Azure Data Lake Azure Data Lake Storage

Apply Now

Job Description

Asylon is seeking an experienced Data Engineer to design and maintain real-time data pipelines that drive video, telemetry, and sensor streams from a fleet of robots. This onsite role in Norristown, PA focuses on low-latency processing to support live monitoring and machine learning model training, with a compensation range of USD 120,000 to 160,000 per year.

Responsibilities

Architect and optimize high-throughput, low-latency data pipelines across Azure cloud and on‑prem environments, tailored for streaming and time-series data.
Capture and process robot telemetry data such as position, velocity, and battery life for analytics and monitoring.
Create efficient ingestion, storage, and retrieval solutions for high-resolution video and Lidar point cloud data.
Provide fast, reliable data access to research and development teams.
Collaborate with software engineers to define data formats and communication protocols for robot to cloud transmission.
Implement mechanisms to handle intermittent connectivity and ensure data completeness.

Requirements

Minimum 3 years of hands-on data engineering experience with a strong emphasis on real-time or streaming data.
Experience with data storage services including cloud-based options such as Azure Data Lake and self-hosted deployments.
Expert-level proficiency in Python and data query languages.
Experience with streaming data processing frameworks.
Experience with time-series databases.
Bachelor’s degree.

Domain Experience

Five years of experience as a Data Engineer in robotics, IoT, or autonomous systems domains is required.

Technologies

Azure
Azure Data Lake
Python
Kubernetes

Benefits

401(k)
Dental insurance
Health insurance
Paid time off
Vision insurance

Compensation

USD 120,000 - 160,000 per year

Job Type

Full-time

Schedule

Monday to Friday; weekends as needed

Work Location

In person

Application Question

Are you a U.S. Person as defined by 22 C.F.R. §120.62 (includes U.S. Citizens, lawful permanent residents, refugees, or asylees)? Yes or No

View full job page →

7d ago

BI & Analytics Analyst/Data Engineer

JSSA Rockville, MD

Rockville, MD

7d ago

Full time Analyst Analytics Azure Data Lake

Apply Now

Job Description

JSSA seeks a Hybrid BI and Analytics Analyst/Data Engineer in Rockville, MD, to bridge data engineering with analytics across the organization. The role spans end-to-end analytics from SQL Server data warehouse design to empowering self-service Power BI reporting, working closely with IT partners and operational leaders to transform raw data into reliable, actionable insights.

Responsibilities

Collaborate with IT business partners and operational leaders to design analyses that uncover opportunities to improve care, evaluate adherence to clinical best practices, and measure outcomes.
Contribute to ensuring data repositories deliver consistent, reusable data by partnering with staff to develop, implement, and guide standards and best practices.
Promote best-practice knowledge to business stakeholders to enable self-service analytics rather than IT-owned development.
Own self-service reporting datasets, including DAX measures, data models, and row-level security.
Translate business requirements into clear analytical deliverables, manage stakeholder expectations, and iterate based on feedback.
Monitor report usage and data quality, proactively identifying and resolving issues.
Document data definitions, metric logic, and report lineage to support data literacy across the agency.
Utilize technical tools to query, manipulate, and summarize data from multiple sources.
Assist in designing, developing, maintaining, and updating databases to meet departmental and organizational needs.
Design and build star schema data warehouse objects in SQL Server, including fact and dimension tables and aggregate layers.
Write and maintain T-SQL stored procedures, ETL pipelines, and staging-to-warehouse data loads.
Develop and own source-to-target mapping documentation for new data domains.
Integrate data from source systems.
Contribute to data quality, pipeline reliability, and warehouse performance optimization.
Support the adoption of self-service analytics by building clean, well-documented datasets.
Document current data architecture, define logical and physical data, and establish an agency data blueprint.
Manage and support the data warehouse solution (Wherescape RED), SQL Server, and related technologies.
Define operational monitoring and alerting tools to ensure end-to-end delivery of trusted, quality data from source systems to consumption.
Establish best-practice standards and processes for data automation, orchestration, and transformation.
Identify, design, implement and manage a master data management solution for client and employee subjects, working with stakeholders to define data quality standards and operational DQ processes.

Requirements

Bachelor’s degree required; Master’s degree highly preferred.
5–7+ years of experience in a BI, analytics, or data engineering role.
Strong proficiency in SQL Server and T-SQL, including stored procedures, window functions, and query optimization.
Hands-on experience building and maintaining Power BI reports and semantic models (DAX, Power Query).
Hands-on experience with Wherescape OLAP solutions; familiarity with Azure Analysis Services, Azure Data Lake, and Azure Synapse Analytics as alternative OLAP options.
Experience integrating or working with EHR data (reports, APIs, or data exports).
Familiarity with star schema and dimensional modeling concepts (Kimball methodology a plus).
Python experience for data wrangling, automation, or pipeline scripting.
Experience with Microsoft Master Data Services (MDS), including defining entities and business rules.
Experience with Microsoft Data Quality Services (DQS) and SQL Server Integration Services (SSIS).
Comfort across the full analytics stack from raw source data to end-user reports.
Strong communication skills able to explain data concepts to non-technical stakeholders.
Advanced proficiency with Microsoft Office tools (Power BI) and SQL, plus experience with EMR systems (hospice, homecare, and/or mental health) is desirable.

Technologies

SQL Server
T-SQL
Power BI
DAX
Power Query
Wherescape RED
Azure Analysis Services
Azure Data Lake
Azure Synapse Analytics
Microsoft Master Data Services (MDS)
Microsoft Data Quality Services (DQS)
SQL Server Integration Services (SSIS)

Benefits

Competitive salary
Benefits package
Healthy work-life balance
Collaborative team environment
Opportunities for personal growth and professional development

View full job page →

Azure Data Lake Jobs

Senior Data Engineer

Staff Engineer II - Senior Data Engineer

Data Engineer

BI & Analytics Analyst/Data Engineer

Get Azure Data Lake Jobs alerts