Sr Lead Data Engineer
Senior
Analytics
Azure
Business Intelligence
Cloud
Cloud Data Engineering
Cloud Data Platform
Cloud Platform
Cloud Platforms Cloud Platforms
Data Analytics
Data Architecture
Data Engineer
Data Engineering
Data Integration
Data Integration Tools
Data Lakehouse
Data Platform
Data Warehouse
ETL
Informatica
Microsoft Azure
Reporting and Analytics
SQL
Job Description
Cox Enterprises is seeking a Senior Lead Data Engineer to own end-to-end delivery of cloud data and analytics solution projects in a hybrid, agile environment in Atlanta, GA. The role leads solution architecture and design, drives data integration delivery including Microsoft Fabric and lakehouse medallion architecture, and coaches data engineering resources to align with stakeholder needs.
Location and Work Model
- Location: Atlanta, GA (hybrid)
Compensation
- Base salary range: USD 134,900 - 224,900 per year
- Base pay note: The base salary may vary within the anticipated range based on the ultimate location of the position and the selected candidate’s knowledge, skills, and abilities
- Additional compensation: The position may be eligible for additional compensation that may include an incentive program
Core Responsibilities
- Coach, mentor, and develop cloud engineering and platform skills of Data Engineer resources.
- Lead large, complex technology engagements, roadmaps, and strategy requiring in-depth data evaluation and critical thinking.
- Provide expert knowledge of modern cloud data architecture patterns and solutions.
- Assess end-to-end impacts by understanding the big picture across Business Intelligence platforms, Corporate IT solutions, and enterprise platforms.
- Recommend technical designs aligned with industry best practices and Cox standards for cloud platforms.
- Partner with Leadership, Portfolio, Enterprise Architecture, Analytics, Security, and Data Governance teams to collaborate on platform solutions and engineering direction, including analytics and reporting opportunities and priorities.
- Understand Agile software methodology and tools.
- Develop understanding of Cox Enterprises applications and how they interoperate with source applications, customers, and business processes supported by the role.
- Identify architectural issues and propose alternative solutions.
- Build trusted relationships with personnel at all levels, including management, across business and technology teams.
- Identify and mitigate risks, including escalation of potential business issues.
- Perform data integrations into Microsoft Fabric, including data sourcing and Fabric ETL development and set-up, plus data product development within medallion architecture.
- Support data engineering for analytics products, including transformations, table views, or other capabilities needed to enable analytics products developed within lakehouse medallion architecture.
- Monitor and optimize performance of data pipelines and storage solutions.
- Implement and enhance Data Reliability Engineering (DRE) practices.
- Help prepare features and user stories, functional and technical designs, test scenarios, and deployment plans related to the data platform.
- Conduct gap analysis related to data processes and database table structures that populate reporting and analytics requirements.
- Construct, manage, monitor, and support data integration between multiple systems.
- Work within an Agile development team and align efforts with shared goals and objectives.
- Apply expertise in software development languages including SQL, PL/SQL, Python, PySpark, KQL, and DAX to explain technology limitations and recommend solutions accordingly.
Required Qualifications
- Authorization to work in the United States for any employer without current or future sponsorship (no OPT, CPT, STEM/OPT, or visa sponsorship now or in the future).
- Must live within a commutable distance to Atlanta and observe a hybrid office model.
- Bachelor’s degree in a related discipline and 8 years of experience in a related field.
- Must have demonstrated hands-on experience architecting and building cloud solutions end to end using Microsoft Azure and Fabric platforms.
- Advanced proficiency in ETL and data orchestration technologies (including Microsoft Fabric, PySpark, Azure Data Factory, SSIS, Informatica, Ab Initio, Pentaho, Talend).
- Experience with data processing, ETL pipelines, and big data technologies.
- Experience with cloud-based data warehousing and data lake solutions such as Snowflake, Redshift, Databricks, and Microsoft Fabric.
- Expertise in Spark applications (Python/Scala) for data transformation and integration with cloud services, including proficiency in PySpark.
- Experience building and operating highly available distributed systems for data extraction, ingestion, and processing large datasets.
- Expertise in designing and building data models, warehouses, and data lakes for enterprise and product use.
- Excellent interpersonal, leadership, presentation, and collaboration skills across organizational teams.
- Demonstrated technology leadership producing results in a large, complex application environment.
- Alternative qualification combination may be considered, such as a master’s degree with 6 years of experience, or 20 years of experience in a related field.
Preferred Qualifications
- Experience leading code development, test plans, test data, and expected results at the program level.
- Experience in application design and implementation, distributed architecture concepts, and data manipulation and analysis.
- Proven analytical and technical problem-solving skills, including a track record of deploying large-scale cloud-native data solutions.
- Experience implementing modern cloud-based solution/platform services (AWS, Azure, GCP).
- Familiarity with designing and building APIs, ETL and data ingestion processes, and using tools to support enterprise solutions.
- Experience with performance tuning, query optimization, security, monitoring, and release management.
- Experience optimizing data pipelines and ensuring data quality.
- Experience with data migration and integrating legacy systems into cloud data architectures.
- Strong experience working in DevOps models, including understanding best practices for code management, continuous integration, and deployment strategies.
- Experience with platforms and systems including:
- Microsoft Azure Cloud, Fabric, PowerBI, Dynamics
- Workday Human Capital Management
- Informatica Power Center, Informatica Intelligent Cloud, IDQ, CGDC
- Tableau
- OneStream Intelligent Finance
- Analytical SQL functions and PL/SQL or SQL, KQL, DAX
- Data Governance and Master Data Management
- Workday
- Excellent verbal and written communication skills for interaction with business users, solution owners, and team members.
Technologies
- Oracle; Azure; Amazon Web Services; Informatica
- Tableau; Microsoft Power BI; Microsoft Fabric
- ETL; Medallion architecture; lakehouse medallion architecture
- Data Reliability Engineering (DRE)
- Agile software methodology
- SQL; PL/SQL; Python; PySpark; KQL; DAX
- Azure Data Factory; SSIS; Ab Initio; Pentaho; Talend
- Snowflake; Redshift; Databricks; Spark; Scala
- Data orchestration; Data processing; Big data technologies
Benefits
- Flexibility to take as much vacation with pay as consistent with duties, company needs, and obligations
- Seven paid holidays throughout the calendar year
- Up to 160 hours of paid wellness annually for personal wellness or that of family members
- Additional paid time off, including bereavement leave
- Time off to vote; jury duty leave; volunteer time off; military leave; parental leave
Work Environment
- Team agreement in place to support hybrid work that balances in-office with remote work to maximize collaboration and customer-centric value delivery.
- Team-first mentality where teams swarm on objectives and success is determined at the team level rather than individual level.
- Ability to work under pressure and meet deadlines within specified time constraints.
- Ability to adapt to changes in assigned work tasks, duties, and priorities in a fast-paced and dynamic work environment.
Minimum Education and Experience
- Education: Bachelor’s degree in a related discipline
- Experience: 8 years minimum in a related field