Data Engineer _ Python/AI

The Data Engineer position involves building Python driven data pipelines, ETL/ELT workflows, and supporting AI/ML data needs for Tata Consultancy Services. A minimum of ten years of experience is required along with a Bachelor of Computer Science.

Responsibilities

• Develop and maintain data pipelines using Python for data ingestion, transformation, and processing
• Design and implement ETL/ELT workflows for large-scale data systems
• Work with structured and unstructured data from multiple data sources
• Collaborate with data scientists and AI/ML teams to support model development and deployment
• Build and manage data integration frameworks and workflows
• Ensure data quality, validation, and governance across all pipelines
• Optimize data processing performance and scalability
• Develop and manage data storage solutions such as data lakes and data warehouses
• Automate repetitive tasks and improve operational efficiency
• Monitor and troubleshoot data pipelines and workflows
• Implement best practices for coding, testing, and documentation
• Support AI/ML use cases by preparing and delivering clean, usable datasets
• Work with orchestration tools like Airflow for scheduling workflows
• Collaborate with cross-functional teams for data-related requirements

Requirements

• Primary skills: Python, ETL/ELT pipelines, SQL, PySpark/Pandas, Big Data (Spark, Hadoop), Airflow, Data
• Modeling & Warehousing, AI/ML data pipelines, Cloud (AWS/Azure/GCP), Data Integration, Git
• Experience: Minimum 10 years

Technologies

• Python
• SQL
• PySpark
• Pandas
• Spark
• Hadoop
• Airflow
• AWS
• Azure
• GCP
• Git

Benefits

• Discretionary Annual Incentive
• Comprehensive Medical Coverage: Medical & Health, Dental & Vision, Disability Planning & Insurance, Pet Insurance Plans
• Family Support: Maternal & Parental Leaves
• Insurance Options: Auto & Home Insurance, Identity Theft Protection
• Convenience & Professional Growth: Commuter Benefits & Certification & Training Reimbursement
• Time Off: Vacation, Time Off, Sick Leave & Holidays
• Legal & Financial Assistance: Legal Assistance, 401K Plan, Performance Bonus, College Fund, Student Loan Refinancing

Salary Range

USD 110,000 - 130,000 per year

Location

Charlotte, NC

Job Function

Technology

Role

Technical Lead

Job ID

411522

Desired Skills

• Python
• SQL

Qualifications

Bachelor of Computer Science