Senior Data Engineer
Senior
Artificial Intelligence
Azure
Big Data
Bigdata
Business Intelligence
Cloud
Cloud Data Engineering
Cloud Data Platform
Cloud Platform
Cloud Platforms
Data Analytics
Data Architecture
Data Engineer
Data Engineering
Data Integration
Data Pipeline
Data Platform
Data Processing
Data Science
Data Warehouse
Databricks
ETL
Event Streaming
Reporting and Analytics
Spark
SQL
Job Description
American Homes 4 Rent, L.P. is hiring a Senior Data Engineer to design, build, and manage data platform capabilities for large-scale processing and analytics.
Responsibilities
- Design, develop, and maintain real-time or batch data pipelines for processing and analysis of large volumes of data.
- Build programs and tools supporting ingestion, curation, and provisioning of complex first-party and third-party data for analytics, reporting, and data science.
- Design and develop Advanced Data Products and Intelligent API’s.
- Monitor system performance through regular tests, troubleshoot issues, and integrate new features.
- Lead analysis of data and the design of data architecture to support BI, AI/ML, and data products.
- Design and implement data platform architecture aligned to organizational analytical requirements.
- Ensure solution designs address operational needs, including scalability, maintainability, extensibility, flexibility, and integrity.
- Provide technical leadership and mentorship to team members.
- Lead peer development and code reviews with emphasis on test driven development and Continuous Integration and Continuous Development (CICD).
Requirements
- Bachelor’s degree in computer science, information systems, data science, management information systems, mathematics, physics, engineering, statistics, economics, and/or a related field required.
- Minimum 8 years of experience as a data engineer with full-stack capabilities.
- Minimum 10 years of experience in programming.
- Minimum 5 years in cloud technologies such as Azure, AWS, or Google.
- Strong SQL knowledge.
- Proficiency in Python and experience with CI/CD practices.
- Strong background in IaaS platforms and infrastructure.
- Hands-on experience with Databricks, Spark, Fabric, or similar technologies.
- Experience in Agile methodologies.
- Hands-on experience designing and developing data pipelines and data products.
- Experience building data ingestion, data processing, and analytical pipelines for big data, NoSQL, and data warehouse solutions.
- Hands-on experience implementing data migration and data processing using Azure services, including: ADLS, Azure Data Factory, Event Hub, IoT Hub, Azure Stream Analytics, Azure Analysis Service, HDInsight, Databricks Azure Data Catalog, Cosmos Db, ML Studio, and AI/ML (and related tooling listed).
- Extensive experience with big data technologies such as Apache Spark and streaming technologies such as Kafka and EventHub.
- Extensive experience designing data applications in a cloud environment.
- Intermediate experience in RESTful APIs, messaging systems, and AWS or Microsoft Azure.
- Extensive experience in data architecture and data modeling.
- Expert in data analysis and data quality frameworks.
- Knowledge of BI tools such as Power BI and Tableau.
- May occasionally work evenings and/or weekends.
Preferred / Additional
- Master’s degree in related fields preferred.
- Experience in ML and ML pipeline is a plus.
- Experience in real-time integration, intelligent apps, and data products.
Technologies
- Azure, AWS, Google
- SQL
- Python
- CI/CD
- Databricks, Spark, Fabric
- Agile methodologies
- NoSQL, Data warehouse
- ADLS
- Azure Data Factory
- Event Hub, IoT Hub, Azure Stream Analytics, Azure Analysis Service
- HDInsight
- Databricks Azure Data Catalog
- Cosmos Db
- ML Studio, AI/ML
- Apache Spark, Kafka
- RESTful APIs, messaging systems
- Power BI, Tableau
- Intelligent API’s
- CICD, test driven development
- Azure Data Catalog
Location
- Irving, TX (onsite)
Compensation
- Anticipated pay range: $121,116.00 to $151,395.00 per year
- Actual starting base pay depends on factors including geographic location, education, training, skills, and relevant experience.
Additional Compensation
- Eligible for a discretionary annual bonus.
Benefits
- Medical, dental and vision insurance
- Flexible spending accounts and/or health savings accounts
- Dependent savings accounts
- 401(k) with company matching contributions
- Employee stock purchase plan
- Tuition reimbursement program
- 9 paid holidays per year
- PTO accrual rate: 0.0577 hours of PTO per hour worked, up to a maximum of 120 hours per year
- Discretionary annual bonus
For additional information on what the company collects when you apply and how it is used, see the CA Job Applicant Privacy Notice: https://www.amh.com/ca-privacy-notice.