Lead Data Engineer

Systems Enginuity, Inc. (SEI) is seeking a Lead Data Engineer to build scalable real-time/streaming, incremental, and batch data processing capabilities for FAA aviation safety research.

Responsibilities

• Lead the design, development, and deployment of scalable real-time/streaming, incremental, and batch data processing pipelines for aviation safety research and analytics.
• Design and implement data architectures to integrate and synchronize aircraft trajectory, surveillance, operational, environmental, and other spatial-temporal data.
• Create data models and processing approaches to maintain aircraft state, trajectory histories, spatial relationships, and derived analytical features.
• Develop and oversee processing capabilities that deliver reliable, reproducible inputs for trajectory prediction, anomaly detection, machine learning, visualization, and other analytics.
• Lead development of APIs, data services, feature pipelines, and interfaces connecting source data, analytical models, enterprise platforms, and user-facing applications.
• Improve engineering outcomes across performance, scalability, data quality, temporal alignment, spatial processing, and data gap handling for high-volume trajectory and telemetry data.
• Collaborate with data scientists and ML engineers on training data generation, model evaluation, feature engineering, and near real-time model execution.
• Provide hands-on technical leadership through architecture reviews, code reviews, engineering best practices, and mentoring senior and associate engineers.

Requirements

• Bachelor’s or Master’s degree in Computer Science, Data Science, Software Engineering, or a related technical field.
• 8+ years experience with a Bachelor’s degree, or 6+ years experience with a Master’s degree.
• Advanced proficiency in Python and SQL, plus current software engineering practices.
• Significant experience with streaming, event-driven, incremental, or distributed data processing architectures.
• Experience with technologies such as Palantir Foundry, Kafka, Flink, Spark, Databricks, Snowflake, or comparable tools.
• Experience processing large-scale time-series, telemetry, sensor, geospatial, or spatial-temporal data.
• Experience with APIs, databases, cloud platforms, containerized environments, and modern software/data architectures.
• Experience with Java, TypeScript, or other languages used in large-scale distributed systems.
• Experience working with geospatial libraries and spatial indexing approaches.
• Experience with aircraft surveillance track data or ADS-B data, trajectory processing, and predictive analytics.
• Aviation, aerospace, transportation, or other safety-critical systems experience.

Technologies

• Python
• SQL
• Palantir Foundry
• Kafka
• Flink
• Spark
• Databricks
• Snowflake
• Java
• TypeScript
• ADS-B

Benefits

• 401(k)
• 401(k) matching
• Dental insurance
• Flexible schedule
• Flexible spending account
• Health insurance
• Paid time off
• Referral program
• Vision insurance

Interview Process

• SEI states the interview process is personal and authentic, and that it does not use AI to conduct interviews.
• Selected candidates meet directly with Project Engineers and Hiring Managers in a live online interview to assess qualifications, experience, and fit within the data science team and culture.
• To ensure fair evaluation, candidates are asked not to use AI tools or other assistance during interviews.
• Evaluation focuses on candidates’ own knowledge, skills, experience, and problem-solving abilities.

Eligibility Requirements

• Offered employment requires successful completion of a U.S. Federal Government public trust security process, including fingerprinting, a government background investigation, and other required screenings.
• Applicants MUST be U.S. citizens or lawful permanent residents and eligible to satisfy applicable U.S. Federal Government suitability and security requirements.
• SEI cannot provide employment visa sponsorship for this position.
• Not eligible: individuals working under or requiring temporary employment authorization, including F 1 CPT, OPT, or STEM OPT.

Pay and Location

• Salary: USD 104,000 - 130,000 per year
• Work location: Remote