Data Engineer
Job Description
NeoMax is hiring a Data Engineer to support data integration and delivery in a complex, security-focused environment in Herndon, VA (onsite). If you bring a Systems Engineer background alongside strong data engineering fundamentals, you will help turn diverse inputs into reliable datasets for downstream IT and service delivery use.
Responsibilities
- Integrate diverse data streams into a data lake.
- Ensure unstructured data is structured at time of load.
- Establish data standards and act as the custodian of IT and service delivery data sets and streams.
- Analyze complex networks and systems.
- Analyze log data from network components and operating systems.
- Manage and troubleshoot data feeds end-to-end.
- Use Python and BASH scripting to support data processing and automation.
Requirements
- 16+ years of experience.
- Bachelor’s or master’s degree.
- Experience integrating diverse data streams into a data lake.
- Experience with ETL and ensuring unstructured data is structured at time of load.
- Experience with data transfer tools such as NiFi and Cribl (examples provided).
- Experience establishing data standards and serving as custodian for IT and service delivery data sets and streams.
- Experience analyzing complex networks and systems.
- Experience analyzing log data from various network components and operating systems.
- Knowledge of complex environments involving shared networks and multiple security enclaves.
- Systems Engineer with a Data Engineer background.
- Ability to manage and troubleshoot data feeds.
- Splunk CORE User certification prior to start.
- Splunk CORE Power User certification within 3 months from start.
Technology Focus
Python, BASH scripting, NiFi, Cribl, Splunk, and ShellScript.
Desired Skills
- SecDevOps (Security Development and Operations)
- Hands-on Splunk experience and certifications
- Scripting tools such as Python, ShellScript, or Ansible
- Cloud security controls and implementation
- Public, private, and hybrid cloud experience (including AWS and Microsoft Azure)
- AWS Certified Security Specialty
Location: Herndon, VA (onsite)