Senior Data Engineer - Cloud & Analytics, Officer
Job Description
Officer level Senior Data Engineer with a Cloud and Analytics focus based in Boston is responsible for designing and building modern cloud data pipelines that support analytics, reporting, and AI use cases for the Client Coverage Group and Chief Business Office within Sales and Business teams.
Location
Boston, MA onsite
Salary
USD 70,000 to 118,750 per year
Responsibilities
- Design, develop, and support end-to-end data pipelines using AWS, Redshift, Databricks, and Snowflake to deliver secure, scalable cloud data platforms for analytics and reporting.
- Implement and maintain enterprise system-to-system integrations via APIs, event-based patterns, and secure authentication mechanisms.
- Build scalable data ingestion, transformation, and validation frameworks using Python, SQL, and shell scripting.
- Develop and optimize data pipelines for performance, reliability, and data quality.
- Collaborate with product owners, analytics teams, and downstream consumers to translate business requirements into technical solutions.
- Support production stability, incident resolution, and root-cause analysis for data platforms.
- Participate in architecture discussions, design reviews, and technical walkthroughs.
- Adhere to Agile delivery practices including sprint planning, estimation, and issue tracking in Jira.
- Ensure compliance with data security, governance, and SDLC standards.
- Apply AI code generation tools such as Anthropic Code, Codex, and GitHub Copilot to accelerate development, improve quality, and boost productivity.
- Contribute to structured and unstructured data workflows, leveraging AI technologies.
- Continuously identify opportunities to improve efficiency, automation, and platform capability.
- Exhibit strong analytical skills to translate business requirements into technical specifications.
- Demonstrate hands-on experience with AWS storage products like S3 and Amazon Redshift.
- Participate in major incident management and production stability efforts as required.
- Communicate effectively, both verbally and in writing, with stakeholders across teams.
- Leverage prior Agile project management experience to contribute to project success.
Requirements
- Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
- 6–10 years of overall IT experience with a strong focus on data engineering.
- 4+ years of hands-on experience building data pipelines on cloud platforms.
- Proven track record as a senior data engineer or ETL expert tackling complex technical problems.
- Excellent communication and leadership capabilities.
- Proficiency in designing, developing, and supporting AWS based data pipelines and cloud architectures (S3, Redshift, EC2, IAM) using Apache Airflow, YAML, and shell scripting.
- Solid AWS Cloud experience including S3, IAM, and cloud-based data architectures.
- Strong Python skills for data engineering and automation.
- Advanced SQL and Python proficiency for data analysis, validation, and performance tuning.
- Experience writing and maintaining shell scripts for automation and operational support.
- Experience working with unstructured data such as sales notes, 13F filings, news, and social media content.
- Solid understanding of data warehousing, data lakes, and data quality concepts.
- Ability to independently analyze requirements and deliver technical solutions.
Technologies
- AWS, AWS Redshift, S3, EC2, IAM
- Databricks, Snowflake
- Python, SQL, Shell scripting
- Apache Airflow, YAML
- Git, Bitbucket, CI/CD, JIRA
- GitHub Copilot, Codex, Anthropic Code
- Salesforce
Benefits
- 401K retirement savings plan with company match
- Insurance coverage including basic life, medical, dental, vision, long-term disability
- Paid time off including vacation, sick leave, short term disability, and family care responsibilities
- Employee Assistance Program
- Incentive compensation with eligibility for annual performance-based awards
- Eligibility for certain tax advantaged savings plans
About State Street
Across the globe, institutional investors rely on State Street to help them manage risk, respond to challenges, and drive performance and profitability. We keep our clients at the heart of everything we do, and educated, engaged employees are essential to our continued success. We are committed to fostering an environment where every employee feels valued and empowered to reach their full potential. Discover more information on jobs at StateStreet.com/careers
Job Application Disclosure
It is unlawful in Massachusetts to require or administer a lie detector test as a condition of employment or continued employment. An employer who violates this law shall be subject to criminal penalties and civil liability.