Data Engineer III (Hybrid) at LexisNexis focuses on designing and maintaining data pipelines and engineering solutions using Python, Spark, SQL, and Azure technologies in a hybrid work setting near Horsham, PA.
Responsibilities
- Collaborate with technical teammates to document, interpret, and finalize requirements.
- Develop clean, efficient, repeatable code that adheres to best practices such as naming conventions and encapsulation.
- Contribute to and review detailed specifications for data component development.
- Address data engineering bugs, researching root causes as needed.
- Identify opportunities to apply automation or tooling to improve effectiveness or efficiency.
- Collaborate with other developers to translate product requirements into data engineering and data management designs.
- Innovate process improvements that enable efficient delivery and maintenance.
- Participate in development processes, coding best practices, and code reviews.
- Oversee database management to ensure structure and data flow align with departmental standards.
- Utilize various data workflow management and analysis tools.
- Maintain in-depth knowledge of a specific data content area.
- Contribute to process improvements and ensure compliant, timely delivery of high quality services, with flexibility to adapt to changing priorities.
- Resolve simple data engineering bugs and technical issues as necessary.
- Work closely with other engineers to understand data requirements and translate them into designs.
- Operate in diverse development environments, including Agile, while collaborating with key stakeholders.
- Stay informed about new technology developments.
- Perform other duties as assigned.
Requirements
- Bachelor’s Degree; Engineering or Computer Science preferred but not required, or equivalent experience.
- Hands-on experience in Azure Synapse Analytics, Azure Databricks, or Hadoop environments.
- Minimum 3 years of strong experience developing Python-based Spark code for large-scale data processing.
- Solid understanding of Big Data concepts, distributed computing, and data lake based medallion architecture.
- Strong communication and collaboration skills to work with cross-functional teams.
- Strong proficiency in Python for data engineering, ETL, and automation tasks.
- Good working knowledge of Azure services, including Azure Data Factory or Synapse Pipelines, Azure Data Lake Storage, and Azure Key Vault/Secrets Management.
- Strong experience with writing SQL.
- Experience working in both Linux and Windows environments for development and deployment.
- Solid working knowledge of GIT with Azure DevOps (Repos, Pipelines).
- Experience deploying code to higher environments using CI/CD pipelines and DevOps practices in Azure.
- Ability to troubleshoot, optimize, and monitor data pipelines in production.
- Exposure to Data Warehouses like AWS Redshift, Azure Dedicated SQL Pool, Netezza, etc.
- Familiarity with data security, governance, and compliance in cloud environments.
- Exposure to monitoring and logging frameworks for data workloads.
- Exposure to Microsoft Fabric.
- Knowledge of industry best practices such as code coverage.
- Knowledge of software development methodologies such as Agile.
- Good documentation skills.
- Attention to detail and strong oral and written communication skills.
Technologies
- Azure Synapse Analytics
- Azure Databricks
- Hadoop
- Python
- Apache Spark
- SQL
- Azure Data Factory
- Synapse Pipelines
- Azure Data Lake Storage
- Azure Key Vault
- Linux
- Windows
- Git
- Azure DevOps
- CI/CD
- AWS Redshift
- Azure Dedicated SQL Pool
- Netezza
- Microsoft Fabric
Benefits
- Health Benefits
- 401(k) with match and Employee Share Purchase Plan
- Wellbeing initiatives
- Disability, Life and Insurance
- Family Benefits
- Health Savings, Health Care, Dependent Care and Commuter Spending Accounts
- Paid leave for Employee Resource Groups and volunteering
Conditions of Employment
- You must be a U.S. citizen to apply for this position.
- You must successfully pass a background investigation and achieve Public Trust security clearance.
- Must be located near the Horsham, PA location for a Hybrid onsite schedule.
Work In A Way That Works For You
LexisNexis promotes a healthy work life balance with wellbeing initiatives, shared parental leave, study assistance, and sabbaticals to support both immediate responsibilities and long term goals.
Flexible hours allow you to adjust when you work in the day to fit personal productivity peaks and obligations.
Working For You
- Health Benefits: Comprehensive medical, dental, and vision coverage
- Retirement Benefits: 401(k) with match and Employee Share Purchase Plan
- Wellbeing: Wellness platform with incentives, Headspace subscription, Employee Assistance, and time-off programs
- Disability, Life and Insurance: Short and long term disability, life and accidental death coverage, plus critical illness and hospital indemnity
- Family Benefits: Bonding and family care leaves, adoption and surrogacy benefits
- Financial Benefits: Health savings accounts, dependent care, and commuter spending accounts
- Volunteer Leave: Up to two days per year for ERG participation and volunteering
About The Business
LexisNexis Legal & Professional provides legal, regulatory, and business information and analytics that help customers increase productivity, improve decision-making, and advance the rule of law worldwide. As a digital pioneer, LexisNexis was among the first to bring legal and business information online with Lexis and Nexis services.
USA Job Seekers
EEO Know Your Rights.
