Data Engineer & Agentic AI Lead
Analytics
Artificial Intelligence
Automation Developer
Business Analytics
Business Intelligence
Cloud
Cloud Platform
Cloud Platforms
Data
Data Analysis
Data Analytics
Data Analytics Tools
Data Architecture
Data Engineer
Data Integration
Data Integration Tools
Data Pipeline
Data Platform
Data Processing
Data Visualization
Database
Databases
Digital Marketing
ETL
Hr Technology
Informatica
Information Technology (IT)
Microsoft
Microsoft Power Platform
Power BI
Power Platform
Reporting and Analytics
Software Development
SQL
Visual Design
Job Description
Hands-on role focused on building and evolving a centralized data platform with end-to-end ETL and data pipeline ownership.
Responsibilities
- Design, build, and maintain scalable end-to-end ETL/data pipelines
- Ingest data from a variety of internal and external sources
- Clean, transform, validate, and structure large volumes of raw data
- Work with multiple data formats, including Excel, CSV, JSON, ORC, and Parquet
- Load and organize transformed data within database and data lake environments
- Design scalable data models based on business and analytical requirements
- Build the underlying data and semantic layers used for reporting and analytics
- Help develop and expand a centralized enterprise data platform
- Work with datasets that can reach billions of rows
- Prepare trusted, well-structured data for downstream use across Power BI, advanced analytics, and future AI applications
- Partner with business and technical stakeholders to understand data structuring and consumption needs
Requirements
- Strong hands-on data engineering and ETL experience
- Proven experience personally designing and building production data pipelines
- Strong SQL skills
- Strong experience with data transformation and data modeling
- Experience working with large, complex datasets from multiple sources
- Ability to take messy or unstructured source data and convert it into clean, usable datasets
- Experience working with data lakes, databases, and modern data architectures
- Ability to translate business data requirements into scalable technical solutions
- Comfortable working independently and owning projects from requirements through implementation
Technologies
- SQL
- Power BI
- Excel
- CSV
- JSON
- ORC
- Parquet
Location: New York, NY (onsite)
Salary: USD 150,000 per yearly
EEO Notice
- Vaco by Highspring is an Equal Opportunity Employer and does not discriminate against any employee or applicant for employment because of race, color, sex (including pregnancy or related conditions), religion or creed, national origin, citizenship, age, disability, status as a veteran, union membership, ethnicity, gender, gender identity, gender expression, sexual orientation, marital statu
- Vaco by Highspring and its parents, affiliates, and subsidiaries are committed to full inclusion of all qualified individuals, and will ensure that persons with disabilities are provided reasonable accommodations
- If reasonable accommodation is needed to participate in the job application or interview process, to perform essential job functions, and/or to receive other benefits and privileges of employment, contact [email protected]
- Vaco by Highspring wants applicants to know their rights: workplace discrimination is illegal
Representation Notice
- By submitting to this position, you agree you will give Vaco by Highspring the exclusive right to present you as a candidate for the opportunity
- You represent that information provided is accurate and not affirmatively misrepresented
- You agree to maintain confidentiality about information learned about the position, to the fullest extent permitted by law
- Residents of Ontario, Canada: based on Highspring’s discussions with its client, this position is a current vacancy (either through Highspring as a contractor or with the client directly)
Privacy Notice
- Vaco by Highspring respects privacy and provides transparent notice of policies
- California residents may access Vaco by Highspring HR Notice at Collection for California Applicants and Employees
- Virginia residents may access state specific policies
- Residents of all other states may access policies here
- Canadian residents may access policies in English and French
- Residents of countries governed by GDPR may access policies here
- Submissions are subject to AI use for preliminary candidate screenings to ensure minimum job requirements are satisfied
- More details on AI use are available at https://www.highspring.com/ai-use-notices/
- Further assessment beyond the initial AI phase will be conducted by recruiters and hiring managers
- Vaco by Highspring does not know and cannot opine on if its client’s use of AI products affects hiring
Pay Transparency Notice
- Compensation for this role depends on multiple factors including skills, experience, training, licensure/certification requirements, office location, and other geographic considerations
- The referenced salary range reasonably estimates base compensation for hires in geographies requiring salary range disclosure
- Candidate may also be eligible for discretionary bonuses