Sr. Data Engineer
Job Description
Sr. Data Engineer role on NBCUniversal’s Content Delivery Engineering (CDE) team, focused on scalable data systems for ingesting, processing, and storing large volumes of data.
Responsibilities
- Design, develop, and maintain new and existing data systems and pipelines, emphasizing reliability, testability, and ease of use
- Support feature preparation activities including cleansing, discretization, imputation, selection, and generalization for modeling
- Partner with business stakeholders to define business requirements, including KPI and acceptance criteria
- Use big data plus relational and non-relational data sources to access data at the right granularity for analytical projects
- Stay current on relevant data set structures and contribute to upgrades and modifications
- Collaborate with software and data architects to build real-time and automated batch implementations and integrate them into the streaming service architecture
- Maintain consistent peer review practices for code and configuration changes using sensible repository structures and CI/CD pipelined deployments
- Participate in, or lead, design reviews, architectural discussions, and team knowledge-sharing sessions
- Use observability systems and advanced analytics to surface issues, diagnose problems, and implement fixes
- Support development of models, alerts, reports, and visualizations and integrate implementations into the streaming service architecture
Requirements
- Bachelor’s degree in computer science, information technology, or a relevant field
- 5+ years experience with big data: ETL, pipeline building, analysis, and code, with expertise in at least one programming language
- Experience implementing scalable, distributed, highly available, and resilient systems using industry data platforms such as Snowflake, Databricks, GCP, or AWS
- Skilled with software repositories, CI/CD pipelines, and test automation
- Experience with data visualization tools and techniques
- Strong skills in data processing using SQL
- Experience applying Site Reliability Engineering (SRE) practices to ensure scalability and reliability in cloud environments
- Familiarity with Agile methodologies including Scrum and Kanban
- Ability to communicate clearly via design documentation, text, voice, and code across a wide variety of nationalities
- CDN experience for streaming media delivery is advantageous; full training can be provided
Technologies
- SQL
- Snowflake
- Databricks
- GCP
- AWS
- CDNs
- CI/CD
- ETL
- Scrum
- Kanban
Desired Characteristics
- Experience with Snowflake or a similar data service
- Experience with data visualizations
- Experience working with multi-billion record datasets and leading projects spanning data science and data engineering
- Knowledge of enterprise-level digital analytics platforms
- Team-oriented collaboration with aptitude and willingness to learn new methods and tools
- Pride and ownership in work and confident representation of the team across NBCUniversal
Benefits
- Medical, dental, and vision insurance
- 401(k)
- Paid leave
- Tuition reimbursement
- Other discounts and perks
Hybrid Work Schedule
- Hybrid schedule requires contributing from the office a minimum of four days per week
- The company may change in-office requirements at any time
Additional Information
- External candidates may be required to attend an in-person interview with an NBCUniversal employee at an NBCUniversal location prior to a hiring decision
- NBCUniversal provides equal employment opportunities without regard to protected characteristics
- Reasonable accommodations are available for qualified individuals with disabilities or disabled veterans
- To request accommodation, contact [email protected]