Sr Data Engineer
Job Description
Consumers Energy is seeking a Sr Data Engineer to help analytics and business teams translate data needs into reliable pipeline and data warehouse solutions. This hybrid role in Jackson, MI focuses on engineering data at scale, delivering analytic tools and visualizations, and strengthening data quality through automation and performance improvements.
What you will do
- Provide technical leadership for incident management, along with direct technical consulting and support for existing applications and solutions.
- Assemble and clean big data, integrating complex datasets from multiple data sources to satisfy functional business requirements for medium-to-large enhancements and IT or technical modeling projects.
- Capture and evaluate requirements from data architecture and business partners.
- Assess development alternatives and establish timelines for delivery.
- Build analytic tools powered by data pipelines to support insights into areas such as customer acquisition, operational efficiency, and other key business performance metrics.
- Partner with stakeholders and IT to design and build efficient data pipelines for medium-to-large enhancements and IT or technical modeling projects.
- Create complex data visualizations using reporting tools to support customer insight and operational efficiency, among other performance metrics.
- Prepare, review, and/or approve solution artifacts and document activities.
- Deliver technical expertise across solution alternatives, design, testing, and documentation for medium-to-large enhancements and IT or technical modeling projects.
- Identify and improve internal processes to automate manual data wrangling, optimize performance, and improve data quality.
- Perform other duties as assigned or needed.
What you bring
- Understanding of data test methodologies and testing tools.
- Knowledge of database management principles and methodologies, including data structures, data modeling, data warehousing, and transaction processing.
- Familiarity with data design principles and approaches, applying systems engineering concepts such as supportability, survivability, reliability, scalability, and maintainability.
- Excellent verbal and written communication skills and the ability to work across all levels of the organization.
- Ability to establish and maintain strong working relationships with business and IT teams.
- Knowledge of project planning and full lifecycle delivery using the Agile framework.
- Ability to work effectively with contract employees and vendors.
- Knowledge of change and release tools and processes used to implement solutions across multiple teams and technologies.
- At least 4 years of experience in a Data Engineer or Software Engineer role, with experience as an Intermediate Data Engineer.
- Education requirement: a Bachelor’s Degree in Data Engineering, Computer Science, Engineering, Data Sciences, or a related field. (Alternative degree/experience combinations are also listed in the original posting.)
- Advanced experience building analytic tools, data architecture/design, defining user requirements, building big data pipelines, understanding ETL extraction tooling, basic data testing aptitude, and familiarity with analytic tool deployment processes and best practices.
- This position is not eligible for immigration sponsorship (for example, H-1B, TN, etc.).
Preferred experience
- Demonstrated experience designing and supporting scalable enterprise data platforms using Databricks and Lakehouse Architecture.
- Experience leveraging Delta Lake, Delta Live Tables (DLT), Structured Streaming, Unity Catalog, Databricks Workflows, and Databricks Asset Bundles.
- Strong understanding of Medallion Architecture and dimensional data modeling, including star schema design.
- Experience establishing data quality, governance, and validation standards.
- Experience with CI/CD automation and DevOps methodologies for data engineering and analytics solutions.
Technologies
- Databricks
- Lakehouse Architecture
- Delta Lake
- Delta Live Tables (DLT)
- Structured Streaming
- Unity Catalog
- Databricks Workflows
- Databricks Asset Bundles
- Medallion Architecture
- star schema
Benefits
- Competitive compensation packages
- Medical, Dental and Vision
- 401k with company match
- Paid parental leave
- Up to 13 paid Holidays
- Paid time off
- Educational Assistance Program
Location and work model
This is a hybrid (virtual/onsite) position with required onsite days on Monday, Tuesday and Thursday at One Energy Plaza in Jackson, MI. The selected candidate must be within commutable distance or willing to relocate (relocation package available for those that qualify).