The Data Engineer role supports the New York City Department of Sanitation within the Operations Management Division, focusing on the design, development, and maintenance of database systems, data integration pipelines, and analytics solutions. The position is based onsite in New York, NY.
Responsibilities
- Perform data analysis, profiling, data modeling, source-to-target mapping, and reporting activities for enterprise data and analytics projects.
- Develop and maintain conceptual, logical, and physical data models to support current and future operational, analytical, and reporting requirements.
- Analyze legacy and strategic source systems to assess data quality, identify inconsistencies, and recommend corrective actions to improve data integrity and governance.
- Collaborate with business stakeholders, technical teams, and external partners to design, develop, and support complex data integration pipelines using ETL tools such as Databricks, Informatica PowerCenter, Pentaho Data Integration (Kettle), and similar technologies.
- Develop, maintain, and enhance technical documentation, including data models, data dictionaries, source-to-target mapping documents, ETL specifications, process flows, and reporting artifacts.
- Develop and maintain SQL-based data solutions, including complex queries, stored procedures, database objects, and data transformation processes.
- Support business intelligence and reporting initiatives through the development of reports, dashboards, and analytical solutions utilizing platforms such as Oracle Business Intelligence Enterprise Edition (OBIEE), Power BI, and other enterprise reporting tools.
- Participate in the design and implementation of innovative data architecture and integration strategies to improve data sharing and interoperability across multiple DSNY domains and across City agencies.
- Support and maintain internal IT systems, applications, and databases, ensuring reliability, performance, and adherence to agency standards.
Requirements
- Strong proficiency in SQL and Python programming. Additional experience with pySpark preferred.
- Experience with data modeling, data analysis, ETL development, and database design.
- Experience with enterprise reporting and analytics platforms such as Power BI, OBIEE, Tableau, or similar tools.
- Knowledge of modern data platforms and cloud-based analytics environments; experience with Databricks is highly desirable.
Technologies
- SQL
- Python
- pySpark
- Databricks
- Informatica PowerCenter
- Pentaho Data Integration (Kettle)
- Oracle Business Intelligence Enterprise Edition (OBIEE)
- Power BI
- Tableau
- ASP.NET
- C#
- TypeScript
- React
- Java
- Unix
- Linux
- shell scripting
Minimum Qualifications
- A baccalaureate degree from an accredited college in computer science, engineering or a related field and four years of satisfactory full-time experience related to datacenter engineering and operations, cloud engineering and operations, or complex IT infrastructure engineering; or
- A baccalaureate degree from an accredited college and eight years of satisfactory full-time experience related to datacenter engineering and operations, cloud engineering and operations, or complex IT infrastructure engineering; or
- Education and/or experience equivalent to the above.
55A Program
This position is open to qualified applicants with a disability who are eligible for the 55-A Program. Please indicate at the top of your resume and cover letter that you would like to be considered for this program.
Public Service Loan Forgiveness
As a prospective employee of the City of New York, you may be eligible for federal loan forgiveness programs and state repayment assistance programs. For more information, visit the U.S. Department of Education's PSLF site at https://studentaid.gov/pslf/.
Residency Requirement
New York City residency is not required for this position.
Additional Information
The City of New York is an inclusive equal employment opportunity employer committed to recruiting and retaining a diverse workforce and providing a work environment free from discrimination and harassment based on protected status or characteristics, including sex, race, color, ethnicity, national origin, age, religion, disability, sexual orientation, veteran status, gender identity, or pregnancy.
