Senior Data Engineer β Databricks & AWS
Senior
Aws Data Engineer
Aws Data Engineering
Azure Databricks
Big Data
Bigdata
Cloud Data Engineering
Cloud Data Platform
Cloud Platform
Cloud Platforms
Data
Data Analysis
Data Analytics
Data Architecture
Data Engineer
Data Engineering
Data Integration
Data Integration Tools
Data Lake
Data Lakehouse
Data Pipeline
Data Pipelines
Data Platform
Data Processing
Data Warehouse
Database
Databases
Databricks
Databricks Genie
Databricks Lakehouse
Databricks Lakehouse Platform
Databricks Pyspark
Databricks Workflows
Delta Lake
ETL
Informatica
Information Technology (IT)
Programming Language
Programming Languages
Software Development
Spark
SQL
Job Description
Robotics Technologies is seeking a Senior Data Engineer for a contract role focused on building and operating data platforms using Databricks and AWS. The position is based in Sunnyvale, CA (onsite) and emphasizes scalable pipelines, ETL/ELT automation, and reliable data operations.
Key Responsibilities
- Design, develop, and maintain scalable data engineering pipelines.
- Build ETL/ELT workflows using Python, PySpark, and SQL.
- Develop data processing solutions using Databricks and AWS.
- Implement data lakehouse and data warehouse architectures.
- Optimize Spark jobs and large-scale data processing workloads.
- Implement data quality checks and data governance practices.
- Integrate enterprise data sources into centralized data platforms.
- Collaborate with architects, analysts, and business stakeholders.
- Support production deployments, troubleshooting, and performance tuning.
Required Qualifications
- 8+ years of experience in Data Engineering.
- Strong experience with Python, PySpark, and SQL.
- Hands-on experience with Databricks and Delta Lake.
- Strong knowledge of ETL/ELT pipeline development.
- Experience with AWS services including S3, Glue, Lambda, Redshift, and EMR.
- Experience with Snowflake or other cloud data warehouses.
- Strong knowledge of data modeling and data warehousing.
- Experience with Apache Spark and distributed data processing.
- Knowledge of data integration and orchestration tools.
- Experience with Git, Jenkins, and CI/CD pipelines.
- Strong understanding of data quality, performance tuning, and optimization.
Technology Stack
- Databricks, Python, PySpark, SQL, AWS
- Delta Lake, ETL/ELT, Amazon S3, AWS Glue, AWS Lambda
- Amazon Redshift, Amazon EMR, Snowflake
- Apache Spark, Git, Jenkins, CI/CD
- Unity Catalog
- Databricks Lakehouse architecture, Delta Live Tables
- Databricks Workflows, Databricks Genie, Databricks Genie Agents
- Model Context Protocol (MCP), Text-to-SQL, Vector search, RAG
- Infrastructure as Code, Terraform
- Data pipeline observability and monitoring
Modern Skills (2025 to 2026)
- Databricks Unity Catalog and data governance
- Databricks Lakehouse architecture
- Databricks Workflows and Delta Live Tables
- Databricks Genie and Genie Agents
- Model Context Protocol (MCP) integration
- Conversational analytics and Text-to-SQL
- AI-powered data engineering and automation
- Vector search and RAG integration with enterprise data
- Data pipeline observability and monitoring
- Infrastructure as Code using Terraform
Role Details
- Location: Sunnyvale, CA (onsite)
- Employment type: Contract
- Compensation: USD 67 - 67 per hourly
- Experience level: 8+ years