Senior Data Engineer
Senior
Analytics
Artificial Intelligence
Azure
Big Data
Bigdata
Business Intelligence
Cloud
Cloud Data Engineering
Cloud Data Platform
Cloud Engineer
Cloud Operations
Cloud Platform
Cloud Platforms
Cloud Platforms Cloud Platforms
Data
Data Analysis
Data Analytics
Data Architecture
Data Engineer
Data Engineering
Data Integration
Data Integration Tools
Data Lakehouse
Data Pipeline
Data Pipelines
Data Platform
Data Processing
Data Science
Data Visualization
Data Warehouse
Database
Databases
Databricks
Design
Digital Marketing
ETL
Event Driven Architecture
Informatica
Information Technology (IT)
Nosql Databases
Programming
Programming Language
Programming Languages
Reporting and Analytics
Software Development
Spark
SQL
Stream Processing
Streaming Data
Visual Design
Job Description
American Homes 4 Rent, L.P. is seeking a Senior Data Engineer to design, build, and manage a data platform and supporting tools used to efficiently process and analyze large data sets. The role includes building scalable real-time and batch pipelines, ensuring strong data quality, and deploying machine learning models into production, along with providing technical leadership to the team.
What you’ll do
- Design, develop, and maintain real-time or batch data pipelines for processing and analysis of large volumes of data.
- Create programs and tools that support ingestion, curation, and provisioning of complex first-party and third-party data to enable analytics, reporting, and data science.
- Design and develop Advanced Data Products and Intelligent API’s.
- Monitor system performance through regular tests, troubleshooting, and integration of new features.
- Lead analysis of data and help design data architecture supporting BI, AI/ML, and data products.
- Design and implement data platform architecture aligned to organizational analytical requirements.
- Ensure solution designs address operational needs including scalability, maintainability, extensibility, flexibility, and integrity.
- Provide technical leadership and mentorship to team members.
- Lead peer development and code reviews with emphasis on test driven development and Continuous Integration and Continuous Development (CICD).
What you’ll bring
- Bachelor’s degree in computer science, information systems, data science, management information systems, mathematics, physics, engineering, statistics, economics, and/or a related field (required).
- Master’s degree in a related field (preferred).
- Minimum 8 years of experience as a data engineer with full-stack capabilities.
- Minimum 10 years of experience in programming.
- Minimum 5 years working with cloud technologies such as Azure, AWS, or Google.
- Strong SQL knowledge.
- Experience with ML and ML pipelines (plus).
- Experience in real-time integration and building intelligent apps and data products.
- Python proficiency and experience with CI/CD practices.
- Strong background in IAAS platforms and infrastructure.
- Hands-on experience with Databricks, Spark, Fabric, or similar technologies.
- Experience with Agile methodologies.
- Hands-on experience designing and developing data pipelines and data products.
- Experience building data ingestion, processing, and analytical pipelines for big data, NoSQL, and data warehouse solutions.
- Hands-on experience implementing data migration and processing using Azure services including ADLS, Azure Data Factory, Event Hub, IoT Hub, Azure Stream Analytics, Azure Analysis Service, HDInsight, Databricks Azure Data Catalog, Cosmo Db, ML Studio, and AI/ML.
- Extensive experience with big data technologies such as Apache Spark and streaming technologies such as Kafka and EventHub.
- Extensive experience designing data applications in a cloud environment.
- Intermediate experience with RESTful APIs, messaging systems, and AWS or Microsoft Azure.
- Extensive experience in data architecture and data modeling.
- Expertise in data analysis and data quality frameworks.
- Knowledge of BI tools such as Power BI and Tableau.
- May occasionally work evenings and/or weekends.
Location
- Roswell, GA (onsite)
Compensation
- USD 121,116 - 151,395 per year
- Discretionary annual bonus eligibility
Benefits
- Medical, dental and vision insurance
- Flexible spending accounts and/or health savings accounts
- Dependent savings accounts
- 401(k) with company matching contributions
- Employee stock purchase plan
- Tuition reimbursement program
- 9 paid holidays per year
- Paid time off (PTO) accruing at a rate of 0.0577 hours of PTO per hour worked, up to a maximum of 120 hours per year
Key technologies
- SQL, Machine Learning, Python, CI/CD
- Azure, AWS, Google
- Databricks, Spark, Fabric, Agile, NoSQL
- Apache Spark, Kafka, EventHub
- RESTful APIs
- ADLS, Azure Data Factory, Event Hub, IoT Hub, Azure Stream Analytics, Azure Analysis Service, HDInsight
- Databricks Azure Data Catalog, Cosmo Db, ML Studio, AI/ML
- Power BI, Tableau
- IAAS platforms and infrastructure
- Continuous Integration and Continuous Development (CICD)
For more information about what the company collects when you apply for a job and how it uses that information, please see the CA Job Applicant Privacy Notice at https://www.amh.com/ca-privacy-notice.