Data Engineer IV

What ARC offers Join Airlines Reporting Corporation and become part of a motivated, diverse, creative, and collaborative team focused on leading data solutions for the travel industry. ARC values big thinking, welcomes challenges, and encourages exploration of new ideas to push the industry forward. Our culture supports hands-on learning and ongoing professional growth, with opportunities to expand skills across dynamic roles. ARC also provides a hybrid WorkFlex program to balance remote work with in-office collaboration, plus a comprehensive benefits package. By joining ARC, you’ll work alongside top minds in the industry as we use data and technology to transform how the world travels.

About the Role

ARC accelerates the growth of global air travel by delivering forward-looking travel data, flexible distribution services and other innovative industry solutions. ARC is a leading travel intelligence company with the world’s largest, most comprehensive global airline ticket dataset, including more than 15 billion passenger flights.

We are looking for a Data Engineer IV to join our team. In this role you will be a key driver of technical excellence, strategy, and innovation with a central role in the success of our data projects. You will collaborate and mentor a team of application and platform engineers at the forefront of developing data products that harness the world’s most comprehensive and accurate airline ticketing data.

Responsibilities

• Technical Leadership: Provide expert-level guidance to development and platform teams, act as a subject matter expert, and demonstrate leadership through communication, influence, relationship-building, direction, and coaching. On-call for incident response and production issues; perform forensic analysis for breaches and data incidents as needed.
• Design: Lead the design and software development of complex data systems, ensuring scalable, efficient, and robust solutions. Ensure data platforms and pipelines support ARC products and services. Apply multi-region database and data platform architecture concepts (such as Aurora RDS and Redshift) with Ops collaboration for performance, resiliency, and high availability.
• Technology Evaluation: Explore, evaluate, and recommend innovative tools, technologies, and platforms to enhance data infrastructure.
• Data Strategy: Define and implement data strategies, best practices, and standards across the organization.
• Data Governance: Develop and enforce data governance and compliance policies.
• Innovation: Stay current with emerging technologies and industry practices; recommend and adopt new tools and technologies.
• Optimization: Continuously optimize data platforms, processes, storage, codebases, and database performance.

Requirements

• Bachelor’s Degree or equivalent work experience preferred; equivalent experience considered.
• 7+ years designing and developing solutions for large-scale data systems, services, and platforms.
• 7+ years of full SDLC experience (design, development, delivery, etc.).
• 5+ years with Agile, Scrum, DevOps, and CI/CD.
• 7+ years implementing modern data solutions using cloud-based technologies in AWS, including Lambda, API Gateway, Security Groups, IAM Roles, Aurora (MySQL/PostgreSQL), S3, CloudWatch, Secrets Manager, Redshift, RDS, and RDS Proxy.
• Expert in modern data and infrastructure design patterns, stream processing, and building data pipelines.
• Deep knowledge of modern database technologies including S3, Aurora, Python, Postgres, RDS, RDS Proxy, Redshift, and NoSQL databases such as DynamoDB.
• Extensive experience with data warehousing platforms (Redshift, Snowflake, Teradata).
• Strong SQL, database design, ETL/ELT design patterns, and data mart structures.
• Expertise with ETL tools such as Glue, Kinesis, Athena, Ab Initio (preferred), Informatica or Talend.
• Experience with data lake and data lakehouse concepts and design patterns.
• Experience in data profiling and data analysis to verify data accuracy.
• Experience with BI technologies (such as AWS QuickSight, Power BI, Tableau, Jasper, Cognos, Qlik, Looker, Metabase, and others).
• Strong knowledge of monitoring tools such as Datadog and CloudHealth, and familiarity with the Atlassian Suite.
• Experience in data management and data governance.
• Excellent leadership skills and a track record of guiding projects with other engineers.
• Proven ability to lead architectural development and collaborate with stakeholders at all levels.
• Ability to translate functional and nonfunctional requirements into technical solutions and to influence technology strategy and best practices in an agile environment.
• Outstanding verbal and written communication skills, with the ability to convey technical concepts to nontechnical audiences and document best practices and SOPs.
• Intellectual curiosity and a genuine drive to evolve processes and systems to meet changing business needs.
• A strong commitment to supporting peers and helping meet project timelines.

Technologies

• AWS and related services: Lambda, API Gateway, Security Groups, IAM Roles, Aurora (MySQL/PostgreSQL), S3, CloudWatch, Secrets Manager, Redshift, RDS, RDS Proxy
• NoSQL databases: DynamoDB
• Programming and databases: Python, Postgres, SQL, Snowflake, Teradata
• ETL/ELT and data processing: Glue, Kinesis, Athena, Ab Initio, Informatica, Talend
• Data architecture: data lake and data lakehouse concepts
• Monitoring and collaboration: Datadog, CloudHealth, Atlassian Suite
• BI and analytics: AWS QuickSight, Power BI, Tableau, Jasper, Cognos, Qlik, Looker, Metabase