DataJobs.io
← Back to all jobs

Job Description

This Data Engineer role at INFOSYS NOVA HOLDINGS LLC focuses on building and maintaining data engineering features and standalone PySpark scripts.

Responsibilities

  • Design, develop, and implement new features within an existing framework using Python and PySpark.
  • Create efficient, effective PySpark scripts for data transformations driven by business logic.
  • Use Object-Oriented Programming concepts to address complex problems and build robust, reusable solutions.
  • Collaborate with team members to understand requirements and deliver solutions aligned with business objectives.
  • Translate business requirements into technical solutions and data transformation processes.
  • Test, debug, and troubleshoot code to ensure accurate and reliable results.
  • Identify and resolve complex software and data-related issues.
  • Develop standalone scripts and applications to support data processing needs.
  • Follow coding best practices and contribute to enhancement of the existing framework.
  • Document programming tasks, processes, and procedures to support future troubleshooting and maintenance.
  • Communicate effectively with teammates about requirements, technical challenges, and solutions.
  • Work independently with minimal supervision while still contributing to the team’s overall outcomes.

Requirements

  • Strong hands-on experience with Python.
  • Strong hands-on experience with PySpark and data transformations.
  • Solid understanding of Object-Oriented Programming concepts.
  • Experience developing standalone scripts based on defined business logic.
  • Strong problem-solving and troubleshooting skills.
  • Ability to understand complex requirements and translate them into effective technical solutions.
  • Experience working with data engineering frameworks and large-scale data processing.
  • Excellent written and verbal communication skills.
  • Ability to work independently with minimal supervision.

Technologies

  • Python
  • PySpark
  • Object-Oriented Programming
  • AWS

Preferred Skills

  • AWS / cloud technologies
  • Large-scale data processing
  • Data transformation and ETL
  • Software development best practices
  • Framework development and enhancement
  • Automated testing and debugging
  • Data engineering tools and technologies

Location: Charlotte, NC (onsite)
Compensation: USD 90,000 - 135,000 per yearly

Similar Jobs