Sr. MDM Data Engineer
Job Description
Lead complex MDM and data engineering efforts for City agencies, spanning Person and Business domains, pipelines, APIs, analytics tooling, and security accreditation coordination.
Responsibilities
- Support the implementation and ongoing support of MDM Person and MDM Business domains that integrate multiple data sources plus accompanying web services and APIs
- Build and maintain architectural blueprints that use MDM as a foundational service, including unified profiles for use cases such as linking business transactions to a business owner
- With guidance from ODS Technical Leads, coordinate senior data engineers delivering pipelines to MDM and other data platforms
- Develop and support analytics tools that leverage the data pipeline for actionable insights (customer engagement and experience, operational efficiency, and other key performance metrics)
- Review ETL strategies for data from a wide variety of sources using SQL, cloud, and “big data” technologies
- Create, update, and maintain system documentation
- Manage API development for data access or for landing data outputs into appropriate target data stores
- Coordinate security scan accreditations
- Perform special projects and initiatives as assigned
- Develop custom code and services to enable seamless system integration
- Contribute to technology initiatives as assigned and provide operations and maintenance support for existing applications
- Unit test newly developed code and support system testing efforts
- Troubleshoot errors, defects, and other system issues
- Maintain strong documentation assets, including data dictionaries, source-to-target maps, database policies and guidelines, and source code repositories
- Work with the City’s Cyber Command unit to follow and complete the application security accreditation process
Requirements
- 8+ years of experience managing the development and implementation of large technology projects, including 3+ years involving an MDM implementation
- 8+ years writing SQL
- 8+ years copying, transferring, manipulating, and automating data operations that were previously manual processes
- Experience with data architecture tools/components such as Informatica Power Center, IICS, SSIS, or similar ETL tooling
- Experience with Amazon Web Services or Microsoft Azure
- In-depth knowledge of SQL and other database solutions
- Knowledge of modeling database schemas for large datasets
- Experience developing cloud-ready applications
- Experience using programming languages including Python, Java, and Perl
Technologies
- MDM, SQL, Informatica Power Center, IICS, SSIS
- Amazon Web Services, Microsoft Azure
- Python, Java, Perl
- Open Data, ETL, APIs, web services
- SOAP, RESTful web services
- Git, GitHub, Subversion
- Oracle 10g/11g, SQL Server, Oracle, MySQL, RDS, PostgreSQL, Snowflake
- Java Spring Boot Framework, B2B Data Transformation, 3-tier architecture
Desirable skills / experience
- 5+ years hands-on development experience with Informatica PowerCenter and B2B Data Transformation
- Experience using Oracle 10g/11g, SQL Server and/or a database appliance
- Knowledge of metadata-driven enterprise reporting platforms
- Experience with application development using Java Spring Boot Framework
- Extensive knowledge of service-oriented architecture using SOAP and RESTful web services
- Experience with 3-tier architecture
- Experience with Oracle, Microsoft SQL Server, MySQL, RDS, PostgreSQL
- Hands-on experience with cloud-based platforms such as AWS, Microsoft Azure, and Snowflake (plus)
- Experience with an agile, iterative development process and version control tools such as Git, GitHub, and Subversion
Work location
- Hybrid (Brooklyn, NY)
- On Site
- Remote: Monday through Friday, 9:00 a.m. to 6:00 p.m.
Scheduled work hours
- Normal business hours, Monday through Friday
- 35 hours/week (not including a mandatory unpaid meal break after 6 hours of work)
Assignment dates and hours
- Projected start date: December 7, 2026
- Projected end date: December 5, 2027
- Total estimated assignment hours: 2,080 hours (1 year)
Note: Normal business hours, Monday through Friday (not including a mandatory unpaid meal break after 6 hours of work), 40 work hours per week. If working more than 40 hours per week, overtime must be requested in the Agency’s timekeeping system and approved by the project manager.