Senior Data Engineer (Analytics & Applied AI)
Job Description
Work remotely in McLean, VA on a Contract To Hire engagement as a Senior Data Engineer focused on building end-to-end data platforms and production Python services. System One offers health and welfare benefits coverage options plus 401(k), with the opportunity to expand from analytics and data engineering into applied AI/ML capabilities.
What you’ll do
- Own data platforms end to end, from source ingestion through transformation to the analytics and application layers that consume the data, with correctness, idempotency, and auditability built in.
- Build production Python services (services, APIs, and tooling) with well-tested, maintainable code, not just SQL queries.
- Design and orchestrate AWS cloud data pipelines using scheduling, retries, data-quality gates, and clear failure handling.
- Model data for analytics and application serving including dimensional/fact modeling, grain decisions, slowly-changing dimensions, and idempotent recompute patterns, while understanding the difference between an analytical warehouse and an application system-of-record.
- Implement data-quality and reconciliation checks that run every pipeline and gate publication so metrics remain defensible.
- Drive architecture independently by evaluating tradeoffs, making technical decisions, and leading implementation with limited supervision.
- Use agentic coding assistants effectively to speed delivery while maintaining code quality and review discipline.
- Grow into applied AI/ML work such as entity resolution / record linkage, LLM-assisted analytics over structured and unstructured data, and anomaly or risk scoring.
What you bring
- 6+ years of data engineering and/or software engineering building and operating production systems.
- University degree and minimum 6 years of prior relevant experience. 4 years of relevant experience may substitute for formal education.
- Strong software engineering practices: production-quality Python, clean architecture, testing, code review, and CI/CD.
- Ability to build software, not scripts.
- Expert SQL, including window functions, complex joins, aggregation-grain reasoning, and query performance awareness.
- Hands-on experience with multiple items in the AWS data and compute stack: Glue, Step Functions, S3, Redshift, Aurora/RDS, Lambda, EventBridge, and ECS/Fargate, plus IAM.
- Demonstrated data modeling skills: dimensional/analytical modeling, grain, SCD, and idempotent recompute patterns.
- Data-quality discipline: validate outputs, reconcile totals, and defend your numbers.
- Infrastructure as code experience, such as Terraform or CDK in a real project.
- High autonomy with proven ownership and sound architecture judgment to complete work independently.
- Effective use of agentic coding assistants in real workflows.
- Analytics fluency: profile datasets, detect anomalies, interpret what a metric means, and explain discrepancies.
- Eligibility to obtain and maintain a Federal or DoD “public trust”; candidates must have approved adjudication of their public trust prior to onboarding (active public trust or suitability is preferred).
- Applied AI/ML experience with practical LLM use such as RAG, structured extraction from unstructured text, embeddings, or ML risk-scoring; strong interest counts even without deep production experience.
- Experience with agent frameworks such as AWS Strands Agents, Bedrock AgentCore, or similar for tool-using or multi-agent systems.
- Experience with entity resolution / record linkage including probabilistic matching.
- API development using FastAPI or similar, with enough UI awareness to collaborate with UI engineers.
- Experience with DuckDB / Parquet-based data flows and data-lake table formats such as Iceberg or Delta.
- Experience working with regulated or government data environments.
Benefits
- Health and welfare benefits coverage options including medical, dental, vision, spending accounts, life insurance, and voluntary plans
- 401(k) participation