Data Engineer

DCI Solutions is seeking a Data Engineer to join a cross-functional team in New York, NY on site, with an active DoD Secret clearance.

Responsibilities

• Serve as a Data Engineer on a cross-functional team to address high-priority problems
• Integrate data from diverse source systems
• Transform insights into actionable outputs for operational use
• Develop first-class applications to support operational decisions
• Set up transfers of data feeds from source systems to designated locations
• Write data transformations and pipelines
• Derive new datasets using Spark for distributed computation
• Monitor build progress and debug build issues
• Design applications that answer operational questions
• Execute information requests related to the platform’s data footprint
• Iterate with product teams while debugging and understanding the code behind the core platform

Requirements

• BS in Computer Science or Engineering (or related field) preferred
• 3+ years of experience in data transformation, data engineering, and software engineering
• Proficiency in Python and Java
• Experience with TypeScript or JavaScript
• Hands-on experience with Spark, PySpark, and/or Pandas
• Strong understanding of algorithms and data structures as they relate to development and problem solving
• Experience with Foundry is preferred
• Active DoD Secret Clearance is required
• Security clearance level: Secret (Required)

Technologies

• Spark
• PySpark
• Pandas
• Python
• Java
• TypeScript
• JavaScript
• Foundry

Benefits

• 401(k) and 401(k) matching
• Dental insurance
• Health insurance
• Flexible schedule
• Flexible spending account
• Health savings account
• Life insurance
• Paid time off
• Parental leave
• Professional development assistance
• Relocation assistance
• Retirement plan
• Tution reimbursement
• Vision insurance

Location

New York, NY

Job Type

Full-time

Salary

USD 175,000 - 260,000 per year

Security Clearance

Secret (Required)

Experience (preferred)

• Data engineering: 5 years (Preferred)
• Python coding/programming: 5 years (Preferred)
• Building and managing data pipelines: 5 years (Preferred)
• Data transformation: 5 years (Preferred)
• Foundry: 1 year (Preferred)
• Spark and/or PySpark: 3 years (Preferred)