Sr Data Engineer, AI

Constellation Energy Generation, LLC. is hiring an AI-focused Senior Data Engineer in Baltimore to lead delivery of secure Azure-based AI data platforms and pipelines.

Responsibilities

• Lead end-to-end activities for designing, building, testing, implementing, and maintaining AI solutions, products, and processes
• Evaluate technology standards and product availability, including risks and benefits, to deliver solutions aligned to business and IT needs
• Coordinate tasks for less experienced engineers and collaborate across teams as needed
• Partner with scrum masters, project managers, QA, and Creative and UX to support compliance with project needs
• Architect, design, implement, and test to build products correctly and support high-quality releases
• Produce secure, maintainable code and configurations
• Lead peer code reviews and advocate for standard development methodologies
• Maintain deep technical knowledge and promote knowledge via seminars, presentations, and publications within IT and Constellation
• Drive technological innovation to tackle complex business problems and support new business opportunities
• Shape and advance core team processes to improve operational efficiency and quality
• Coach and provide oversight for engineers on assigned product or project teams
• Learn and understand business processes with limited guidance
• Collaborate in an agile environment to build solutions
• Support and research issues across application layers and databases, including strong debugging and problem solving
• Identify opportunities to improve and scale Azure architecture
• Ensure code deployment via Azure DevOps
• Design and query database objects including tables, views, functions, stored procedures, and batch processes
• Develop and support interfaces connecting websites, back-end systems, and third-party cloud solutions, vendors, and customers
• Engage with business partners to gather information, analyze requirements, and deliver practical, efficient, cost-effective solutions
• Design, develop, and review complex code/configurations to ensure AI solutions meet functional and technical specifications
• Write product specifications and design documentation for assigned system components
• Design and build large-scale AI data platforms/products & frameworks for real-time and batch processing at high volume
• Develop complex data algorithms for AI/ML, data analytics, machine learning, and scientific computing
• Use indicators to scope and respond proactively to emerging threats
• Support development of version control principles using examples like Git while working in agile
• Enhance knowledge and compliance with preferred technologies, methodologies, standards, and policies
• Assist with white papers and presentations explaining why a technology is recommended by IT
• Maintain technical knowledge and business acumen within the discipline or function
• Implement data governance to ensure and manage data quality as part of data lifecycle work

Requirements

• Bachelor's degree in Accounting with 5-years experience; in lieu of degree, 9-years experience
• Experience with private and public cloud architectures, including pros/cons and migration considerations
• 5-years RDBMS experience
• Experience with JSON, JSON-LD, and XML data structures
• Experience implementing data pipelines using latest technologies and techniques
• Experience with Azure DevOps plus tools such as Copado, GitHub, Heroku, ServiceNow or similar
• 3-years hands-on programming with Java 8, C#, node.js, Python, SQL, Unix shell/Perl scripting
• 5-years industry experience as a data engineer, with involvement in the data component of the AI/ML lifecycle and a solid understanding of applied machine learning topics
• 3-years consulting or client service delivery experience on Azure
• Experience handling structured and unstructured datasets
• Strong t-SQL with experience in Azure SQL DW
• Experience with data modeling and advanced SQL techniques
• Cloud migration methodologies using tools like Azure Data Factory, Event Hub, etc.
• Analytical skills with attention to detail, critical thinking, problem solving, and independent decision making
• Knowledge of ETL tools
• Experience with cloud-native Azure technologies such as Azure Functions, Event Grids, Service Bus Queues, Cosmos DB, Azure Data Factory (or related) is a plus
• Experience designing integration applications for both upstream and downstream use cases
• Experience with Git, Azure DevOps, build pipelines, and code branching/merging and code management
• Experience writing technical reports and procedures
• Knowledge of event-driven architecture
• Advanced hands-on experience with Databricks and Spark (PySpark preferred) for building and optimizing workflows and pipelines
• Hands-on proficiency designing, building, and maintaining ETL/ELT pipelines using Python, PySpark, and related tools
• Strong SQL skills and experience with data warehousing
• Hands-on experience with cloud platforms such as AWS, Azure, or GCP, including cloud-native data tools
• Expertise in big data systems and integrating data from APIs, flat files, and databases
• Experience configuring secure external data connections (example tools/approaches: Azure Data Lake Storage, on-prem SQL Server) using Service Principals, SAS Tokens, OAuth, mounting techniques
• Strong understanding of data security, encryption, and compliance standards
• Experience implementing data governance frameworks for data quality
• Proven expertise with Azure Data Factory (ADF) to orchestrate and automate data workflows across cloud and on-premises

Technologies

• AI, Azure, Azure DevOps, Azure SQL DW, t-SQL, SQL, RDBMS
• JSON, JSON-LD, XML
• Java 8, C#, node.js, Python, Unix shell/Perl scripting
• Git, GitHub, Copado, Heroku, ServiceNow
• Azure Functions, Event Grids, Service Bus Queues, Cosmos DB, Azure Data Factory, Event Hub, Azure Data Lake Storage
• Databricks, Spark, PySpark
• ETL/ELT pipelines, ETL tools, Event driven architecture
• AWS, GCP, OAuth, SAS Tokens, Service Principals, On-prem SQL Server

Benefits

• Eligible employees offered a bonus program
• 401(k) with company match
• Employee stock purchase program
• Comprehensive medical, dental and vision benefits, including robust wellbeing programs
• Disability and life insurance benefits
• Paid time off for vacation, holidays, and sick days
• Comprehensive benefits package that includes bonus and 401(k)

Compensation

• Salary: USD 129,600 - 194,400 per year
• Total rewards (expected): $145,800 to $162,000, varies based on experience, plus comprehensive benefits package including bonus and 401(k)

Location

• Baltimore, MD (onsite)