Data Engineer
Backend Developer
Aws Data Engineer
Aws Data Engineering
Big Data
Cloud Data Engineering
Data
Data Analysis
Data Analytics
Data Architecture
Data Engineer
Data Engineering
Data Engineering Lead
Data Integration
Data Pipeline
Data Platform
Data Processing
Database
Databases
Engineer
ETL
Informatica
Information Technology (IT)
Lead Data Engineering
Programming Language
Programming Languages
Software Development
SQL
Job Description
Steampunk is seeking a seasoned Data Engineer to lead and architect enterprise-grade data platforms, services, and pipelines in an Agile environment.
Responsibilities
- Lead and architect data pipelines and ingest patterns to move raw data from producers into an enterprise data ecosystem with emphasis on performance and reliability
- Assess and understand ETL jobs, workflows, BI tools, and reports
- Provide technical responses for customization, integration, enterprise architecture, and data product feature/functionality inquiries
- Support an Agile software development lifecycle
- Contribute to the growth of the Data Exploitation Practice
Requirements
- Experience supporting ICE contract work
- Experience working in Design Intelligence
- Bachelor’s Degree and 6+ years total experience, or equivalent experience and education
- 6+ years direct experience in Data Engineering, including experience with tools such as: Databricks
- Ability to inspect existing data pipelines, understand purpose and functionality, and re-implement efficiently in Databricks
- Advanced SQL knowledge and experience with relational databases
- Advanced knowledge of NoSQL databases
- Experience with message queuing, stream processing, and highly scalable big data stores
- Experience manipulating, processing, and extracting value from large, disconnected datasets
- Experience manipulating structured and unstructured data for analysis
- Experience with data modeling tools and processes
- Experience aggregating and transforming data from multiple datasets to create data products
- Experience working in an Agile environment
Technology Stack
- Python, SQL, Databricks, AWS Data Services
- Hadoop, Spark, Kafka
- Postgres, Cassandra
- Azkaban, Luigi, Airflow
- EC2, S3, RDS
- Glue, Step Functions, Lamda, EMR
- DynamoDB, DocumentDB, Redshift, Aurora, Athena
- Snowflake
- Storm, Spark-Streaming
- R, Scala, Go
Location
- McLean, VA (onsite)
Compensation
- USD 110,000 - 160,000 per year
Additional Information
- Steampunk determines salary based on factors including geographic location, contractual requirements, education, knowledge, skills, competencies, and experience
- Annual salary is one component of Steampunk’s total compensation package
- As part of the application process, candidates are expected to be on camera during interviews and assessments
- Steampunk reserves the right to take your picture to verify identity and prevent fraud
- Steampunk is an equal opportunity employer
- Steampunk participates in the E-Verify program
Note: The technologies listed include AWS services and related big data tooling; cloud environment experience is emphasized, preferably with AWS.
Similar Jobs
