The Senior Data Engineer will design, build, and sustain data pipelines and architectures that leverage iPaaS and cloud-based processing and storage within the client’s IT integrations team.
Position overview
The role resides in the client’s information technology integrations group, focusing on the design, development, support, and optimization of data pipelines and architectures. The incumbent will employ modern iPaaS solutions and cloud data processing/storage to meet cross-functional data needs, collaborating with various stakeholders to identify requirements and translate them into scalable technical solutions.
Location and compensation
Location: Calabasas Hills, CA, hybrid arrangement.
Salary: USD 145,000 to 156,000 per year.
Education: Bachelor's degree required in computer science, information systems, data analytics, or related field.
Experience: Minimum 5 years of hands-on data engineering experience.
Responsibilities
- Design, develop, and maintain scalable, fault-tolerant data pipelines using ETL/ELT frameworks to ingest, transform, and integrate structured and unstructured data.
- Implement integrations with external systems via REST APIs, SOAP services, and message queues such as RabbitMQ and Kafka to enable real-time and batch data exchange.
- Collaborate with Business Analysts, BI teams, and stakeholders to translate business requirements into technical designs, data contracts, and production-ready solutions.
- Optimize and troubleshoot data systems including Azure SQL Database, Azure Data Factory, and SSIS for performance, query efficiency, and cost management.
- Design robust data models for analytical and transactional use cases, ensuring referential integrity and scalability.
- Apply data management best practices, covering governance, security (RBAC, passwordless authentication), compliance, and auditing with tools such as Azure Purview.
- Maintain comprehensive documentation of data workflows, architecture diagrams, and integration patterns.
- Mentor junior engineers through code reviews, design guidance, and troubleshooting to improve overall engineering quality and delivery consistency.
- Lead proofs of concept and evaluate tools such as Snowflake, Databricks, and Airflow, delivering recommendations to enhance architecture and operational maturity.
- Utilize CI/CD pipelines for Azure Functions, Data Factory, and SSIS via GitHub Actions to enable automated deployments and version control.
- Work with cloud-native storage and compute services (Azure Blob Storage, Data Lake Gen2, Functions, Logic Apps, SSIS, ADF) for scalable data processing and integration.
- Develop automation scripts in Python and PowerShell to support data processing, orchestration, and operational efficiency.
Requirements
- 5+ years of hands-on experience with Azure Data Factory, Azure SQL offerings, and SSIS.
- Bachelor’s degree in computer science, information systems, data analytics, or a related field.
- Proficiency in SQL and Python, including stored procedures and data transformation techniques.
- Expertise in SQL query optimization and performance tuning strategies.
- Scripting experience using Python and PowerShell.
- Experience with system design and data architecture, including scalable integration patterns.
- Exposure to modern data platforms such as Databricks, Synapse, BigQuery, or Snowflake.
- Experience with iPaaS tools (SnapLogic, TIBCO, Adeptia) and external system integrations.
- Strong problem-solving and data debugging skills, with the ability to learn new technologies and methodologies.
- Excellent communication and teamwork abilities.
What we require
- 5+ years of hands-on experience with Azure Data Factory, Azure SQL offerings, and SSIS.
- Bachelor’s degree in computer science, information systems, data analytics, or a related field.
- Proficiency in SQL, Python, stored procedures, and data transformation techniques.
- Expertise in optimizing SQL queries and performance tuning.
- Scripting experience in Python and PowerShell.
- Experience with system design and scalable data architectures.
- Familiarity with modern data platforms such as Databricks, Synapse, BigQuery, or Snowflake.
- Experience with iPaaS tools and external system integrations.
- Strong problem-solving and data debugging skills; ability to adapt to new technologies.
- Effective communication and collaboration abilities.
What we prefer
- Experience in the restaurant industry.
- Familiarity with additional Azure cloud services such as Logic Apps and Functions.
- Experience building frameworks for data quality, logging, and monitoring.
- Azure certifications such as Azure Fundamentals, Azure Data Fundamentals, or Azure Data Engineer.
- Experience mentoring engineers, setting standards, and contributing to technical roadmaps.
Technologies
- Python, PowerShell, SQL, stored procedures
- Azure SQL Database, Azure Data Factory, SSIS
- Azure Purview, Snowflake, Databricks, Airflow
- RabbitMQ, Kafka, REST APIs, SOAP
- Azure Blob Storage, Data Lake Gen2, Azure Functions, Logic Apps
- GitHub Actions, Synapse, BigQuery
- Snowflake, Databricks, Airflow, SnapLogic, TIBCO, Adeptia
- iPaaS
You will thrive in this position if you are
- Deadline driven with strong time management and reliability
- A collaborative team player who respects diverse viewpoints
- Highly organized and capable of prioritizing in a dynamic environment
- Adaptable to fast changing priorities and timelines
- Accountable and proactive, able to own tasks within a supportive team
Part 2 Job Specific Q&A
Applicants are asked to provide responses to the must-have and preferred requirements, include total years of experience, recency, and any additional details that strengthen candidacy. Ensure alignment between your resume and this summary and your recent employment history.
About DKKD Staffing
We assemble teams ranging from CIO to Helpdesk, including HR across the United States.
