Data Engineer
Backend Developer
Python
Analytics
Business Intelligence
Data
Data Analysis
Data Analytics
Data Architecture
Data Engineer
Data Integration
Data Integration Tools
Data Pipeline
Data Platform
Data Processing
Data Visualization
Design
Digital Marketing
Engineer
ETL
Informatica
Information Technology (IT)
Programming
Programming Language
Programming Languages
Reporting and Analytics
Software Development
Visual Design
Job Description
Electrosoft Services Inc is seeking a contract Data Engineer to design and build automated scientific data extraction and standardization pipelines for the NIST CHIPS METIS initiative. The role focuses on transforming scientific documents and non-standard research data into structured, machine-readable outputs using Python-based OCR, parsing, normalization, and microservice integrations.
Responsibilities
- Design and implement automated OCR and document layout analysis pipelines to extract scientific figures, charts, and tables from PDF and Microsoft Word documents.
- Develop algorithms to extract figure captions, axis labels, measurement units, and related scientific metadata.
- Implement table extraction capabilities that maintain row and column structures, including headers and data relationships.
- Integrate extracted metadata with established controlled vocabularies and ontologies within the Controlled Vocabulary Curation System (CVCS).
- Develop and enhance user interfaces that support scientific domain experts in validating extracted content and correcting OCR errors.
- Build Python-based parser libraries to convert proprietary instrument outputs, legacy spreadsheets, and non-standard text files into standardized CSV formats.
- Create automated data normalization, schema validation, and quality assurance procedures to support compliance with METIS data schemas.
- Implement heuristic data-cleaning capabilities to address missing values, merged cells, inconsistent headers, and extraneous metadata.
- Integrate extraction and standardization components as microservices or software modules within the existing CVCS web application architecture.
- Develop data export capabilities to support integration with the METIS Discovery Portal.
- Prepare design documentation, implementation guides, API specifications, and deployment procedures.
- Develop, test, and maintain documented source code in GitHub repositories, including code planned for public release.
- Prepare and deliver technical demonstrations of extraction workflows, data conversion capabilities, and system enhancements.
- Monitor and report technical performance metrics such as document processing volumes, OCR accuracy, data conversion success rates, and system integration status.
- Collaborate with government scientists, developers, and technical stakeholders to identify requirements, troubleshoot issues, and improve system functionality.
Requirements
- Bachelor’s degree (four-year) in Computer Science, Data Engineering, or a related field.
- Four (4) years of advanced Python programming experience, specifically with Pandas and OCR libraries.
- Four (4) years of experience with OCR pipelines and table extraction logic.
- Four (4) years of experience in data format normalization and schema validation.
- Four (4) years of experience integrating microservices into web applications.
- Experience developing and maintaining automated data processing and transformation pipelines.
- Knowledge of OCR and document processing technologies, such as Tesseract, PaddleOCR, pdfplumber, Camelot, LayoutParser, or comparable tools.
- Familiarity with JSON Schema, XML/XSD, controlled vocabularies, and ontology-based metadata tagging.
- Experience with REST APIs, GitHub, and software development and deployment practices.
- Strong analytical, problem-solving, technical documentation, and communication skills.
- Successful completion of a federal background investigation appropriate for an IT-Low Risk position and ability to meet applicable HSPD-12/PIV credentialing requirements.
- Ability to work on-site at the NIST campus in Gaithersburg, Maryland.
- Position is contingent upon contract award.
Required Technologies
Python, Pandas, OCR, Tesseract, PaddleOCR, pdfplumber, Camelot, LayoutParser, JSON Schema, XML/XSD, REST APIs, GitHub, GitHub repositories, Microservices
Role Details
- Location: Gaithersburg, MD (onsite)
- Minimum Experience: 4 years
- Education: Bachelor’s degree (four-year) in Computer Science, Data Engineering, or a related field
- Job Type: Contract
Similar Jobs
U