Data Engineer IV
Job Description
Data Engineer IV role in Springfield, MA (hybrid) with Farm Credit Financial Partners.
Responsibilities
- Lead and architect enterprise-scale data engineering initiatives within a matrix project structure.
- Set strategic direction for the design, enhancement, and long-term support of data platforms.
- Drive organizational data engineering strategy by refining processes, automating manual tasks, improving data delivery, and redesigning infrastructure for scalability.
- Build and optimize the infrastructure for efficient extraction, transformation, and loading of data from diverse sources.
- Oversee engineering standards through code reviews to maintain quality and best practices.
- Shape enterprise-wide data governance policies with senior leadership, covering data quality, data management, policies, business process management, and risk handling.
- Perform other related duties as assigned.
- Coach and mentor junior engineers.
- Communicate technical direction effectively to senior leadership and cross-functional stakeholders; foster innovation and process improvement during development.
- Demonstrate thought leadership in data engineering practices and enterprise data strategy.
Requirements
- Bachelor's degree in computer science or MIS.
- 10+ years of experience in data modeling and cloud technologies.
- Expert with Azure stack including Databricks, Data Factory, SQL, Python, and Power BI.
- 2+ years of leading large, distributed technical teams.
- Ability to work comfortably in both Agile and Waterfall methodologies.
- Strong organizational, analytical, and communication skills.
- Proficiency in Microsoft Office Suite.
- Strong customer service orientation for data consumers.
- Familiar with software development best practices.
- Knowledge of Artificial Intelligence concepts and technologies, including or similar to ChatGPT, Claude, Windsurf, Perplexity AI, Grok, Gemini.
Technologies
- Databricks
- Data Factory
- SQL
- Python
- Power BI
- Microsoft Office Suite
- ChatGPT
- Claude
- Windsurf
- Perplexity AI
- Grok
- Gemini
- Artificial Intelligence concepts and technologies
Benefits
- Competitive earnings
- Hybrid and remote work options
- Tuition reimbursement
- Generous 401(k) matching
- Development opportunities through company-sponsored trainings and certifications
Essential Functions
- Must be able to report to work in person and attend work-related functions.
- Work at a desk and use a computer for extended periods.
- Occasionally lift, carry, and move objects up to 10 pounds.
- Occasional travel as required.
- Type and use various software programs; operate general office equipment.
- Work in an office setting with moderate noise levels.
- Physical demands include frequent talking or hearing, occasional push/pull, stoop/kneel, bend/twist, and reach.
- Work scheduled hours and overtime as needed.
- Hybrid arrangement (work from home on Mondays and Fridays, in-office Tue–Thu) or remote arrangement; exceptions possible; designation may change by business needs.
- Concentrate on details when reviewing documents and analyzing data; manage multiple tasks and deadlines with accuracy.
- Problem-solve efficiently and make sound decisions; manage work-related stress and interactions.
- Communicate ideas clearly in verbal and written form; collaborate with others in a collegial manner.
Reasonable Accommodation
- Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions of the position.