DataJobs.io
← Back to all jobs

Job Description

Build reliable data pipelines across hybrid and multi-cloud environments with Southern Company’s Electric Operations Technology Solutions (EOTS). In this hybrid role based in Birmingham, AL, you will design, operationalize, and maintain data pipelines that enable data, analytics, and AI use cases. You will also help drive standardization across Databricks and Azure for multiple business areas, supporting scalable, reusable delivery of data products.

This position is part of the Electric Operations Technology Solutions Leadership Team, partnering with data, business, and technical stakeholders to translate data into consumable formats with strong reliability and governance.

What you’ll do

  • Design and develop methods to process structured, semi-structured, and unstructured data using batch and real-time techniques
  • Develop release pipelines to automate build, version control, and deployment tasks
  • Build and maintain reusable templates, code libraries, and semantic models to support consistent delivery
  • Implement gatekeeping and guard rail processes for promotion of production data
  • Define and enforce data quality and integrity controls
  • Promote data reusability through modular data product delivery
  • Provide technical guidance to less experienced data engineers and support knowledge sharing
  • Optimize pipeline performance using parallel processing and minimal data movement
  • Stay current with data technologies and share insights across the organization
  • Standardize, design, and develop Databricks applications, data integrations, and automated business processes
  • Integrate data from multiple systems, databases, APIs, and business applications
  • Provide technical guidance and support for business users and fellow data engineers

What you’ll bring

  • Bachelor’s degree in Computer Science, Engineering, Machine Learning, or related field
  • 9+ years of experience
  • Experience with batch and real-time data processing frameworks
  • Experience with big data technologies such as Hadoop, HIVE, and Spark
  • Experience applying AI/ML solutions in Python
  • 4+ years with on-prem tools (e.g., MSBI, Informatica, Oracle Golden Gate, SQL Server)
  • 2+ years with Microsoft Azure tools (e.g., Data Lake, Data Factory, Databricks, Synapse, Power BI)
  • Containerization experience (e.g., Docker, OpenShift)
  • Proficiency in data modeling, access, storage, and quality tools
  • Familiarity with Agile and DevOps, including CI/CD methodologies
  • Strong communication and collaboration skills, with ability to lead and mentor
  • Familiarity with performance optimization and data governance
  • Proactive approach to sharing knowledge and best practices
  • Hands-on expertise with Databricks, SQL, Python, and Apache Spark
  • Proficiency in data modeling for analytics and machine learning

Tools and technologies

Databricks, Azure, Python, Apache Spark, SQL, Hadoop, HIVE, MSBI, Informatica, Oracle Golden Gate, SQL Server, Microsoft Azure Data Lake, Data Factory, Synapse, Power BI, Docker, OpenShift

Location and schedule

  • Birmingham, AL (The Energy Center)
  • Onsite 4 days per week and 1 day per week remote

Compensation and benefits

  • Competitive base salary
  • Annual incentive awards for eligible employees
  • Health, welfare and retirement benefits designed to support physical, financial, and emotional/social well-being
  • Additional compensation, such as an incentive program (subject to the terms and conditions of the applicable incentive plan(s))
  • A summary of the benefits offered for this position can be found at https://seo.nlx.org/southernco/pdf/SOCO-Benefits.pdf

Equal Opportunity Employer: Southern Company is an equal opportunity employer where an applicant's qualifications are considered without regard to race, color, religion, sex, national origin, age, disability, veteran status, genetic information, sexual orientation, gender identity or expression, or any other basis prohibited by law.

Similar Jobs