Data Engineer (Intermediate OR Senior)
Senior
CI/CD
Cloud Data Engineering
Cloud Data Platform
Cloud Data Warehouse
Cloud Data Warehouse
Data Analysis
Data Analytics
Data Engineer
Data Engineering
Data Integration
Data Lakehouse
Data Pipeline
Data Platform
Data Processing
Data Visualization
Data Warehouse
Data Warehousing
Databricks
DevOps
Devops Tools
ETL
Microsoft Fabric
Power BI
Reporting and Analytics
Snowflake
SQL
Job Description
Teacher Retirement System of Texas is hiring an on-site Data Engineer in Austin, TX to build and improve enterprise data pipelines and platforms.
Responsibilities
- Design, develop, and optimize data pipelines, data modeling, and platform management to support seamless data system integration and operation
- Maintain data warehouses, generate complex reports, and perform in-depth data analysis
- Build and manage data platforms, including ETL process development
- Perform basic data lake management (intermediate) and advanced data lake management (senior)
- Develop and maintain basic data models (intermediate) and advanced data models (senior) for structured data storage and accessibility
- Manage and maintain data catalogs to keep a clear, organized repository of data resources (and enhance them as experience grows)
- Implement, manage, and maintain CI/CD pipelines with intermediate proficiency (intermediate) and advanced DevOps practices (senior)
- Manage data permissions to ensure proper access control and data security
- Support administrative tasks and basic system administration duties to help maintain and improve data systems
- Develop data-driven applications that support business needs
- Conduct data analysis and assist with larger analysis projects to provide insights for business stakeholders
- Generate reports using reporting tools and provide support for more advanced reporting tasks as required (including automation of reports using reporting tools)
- Collaborate with stakeholders to gather requirements and help define project scopes and objectives
- Create visually appealing, intuitive dashboards for visibility into key performance, risk, and control indicators across agency divisions and departments
- Actively contribute to Agile practices, including scrum participation (and for senior, lead scrum activities to ensure Agile adherence)
- Proactively collaborate with the Data Engineering Team, IT staff, enterprise stakeholders, and agency employees
- Guide evolution of Investment data platforms by shaping how critical investment data is integrated, secured, and delivered at scale
- Serve as a trusted technical advisor to Investment teams by implementing modern platform capabilities and driving adoption across the business
- Optimize system performance, manage complex systems, and improve reliability and ease of management
- Perform related work as assigned
- Partner with stakeholders to align data strategies with business goals
Requirements
- Bachelor's degree from an accredited college or university in computer information systems, computer science, data management, information systems, information science, mathematics, or a closely related field
- High School diploma or equivalent plus additional full-time experience in data pipeline builds and implementation may be substituted on an equivalent year-for-year basis
- Three (3) to Five (5) years of full-time directly related, progressively responsible experience in data pipeline builds and implementation, including ETL tools for ETL script creation and Power BI or an equivalent modern data visualization package (or related experience)
- Experience may be concurrent
- Master's degree or doctoral degree in a closely related field may be substituted on an equivalent year-for-year basis
Technologies
- ETL tools, CI/CD pipelines, Power BI
- Data lake, Data warehouses, Data catalogs
- DevOps practices
- Microsoft Fabric, Databricks, Snowflake, Spark, SQL, Python
- Cloud platforms
- Data encryption (REST, SOAP, XML, JSON)
- Web services (SSL, SSH, SFTP, Certificates)
- Reporting tools
Preferred Qualifications
- Data Engineer: Experience with data architecture and modeling; experience with Microsoft Fabric, Databricks, Snowflake, Spark, SQL, Python, and cloud platforms; experience with data encryption (REST, SOAP, XML, JSON) and web services (SSL, SSH, SFTP, Certificates)
- Data Engineer Senior: Advanced experience with data architecture and modeling; advanced experience with Microsoft Fabric, Databricks, Snowflake, Spark, SQL, Python, and cloud platforms; advanced experience with data encryption (REST, SOAP, XML, JSON) and web services (SSL, SSH, SFTP, Certificates)
Knowledge, Skills, and Abilities
- Strong knowledge of business intelligence tools, databases, SQL, and object-oriented programming languages to support data analysis and predictive analytics
- Database modeling and data warehousing principles
- System development life cycle concepts
- ETL concepts and assistance in building pipelines
- Data platform knowledge and assistance in platform management
- Data architecture and modeling (knowledge/advanced knowledge)
- Knowledge/advanced knowledge of Microsoft Fabric, Databricks, Snowflake, Spark, and cloud platforms
- Knowledge/advanced knowledge of data encryption (REST, SOAP, XML, JSON) and web services (SSL, SSH, SFTP, Certificates)
- Proficient/advanced proficiency in Python and SQL
- Ability to deliver clear, concise, and visually appealing management metrics and reports using technical and statistical analysis skills
- Writing report queries with an understanding of relational databases
- Business process analysis and problem solving
- High accuracy in completing detailed work
- Planning, organizing, and prioritizing work assignments in a fast-paced, changing environment
- Working in a Windows environment with Microsoft Office tools (word processing, spreadsheets, and business software)
- Effective written and verbal communication, including explaining complex information and writing clear documentation
- Team collaboration and influence across a diverse group of stakeholders
- Operating effectively with competing and shifting priorities
- Continual learning and professional development
- Building and maintaining harmonious working relationships
- Participation in Scrum activities with advanced understanding of Agile
Military Encouragement
- Veterans, Reservists, or Guardsmen with experience in a Military Occupational Specialty (MOS) may meet minimum requirements when paired with the minimum qualifications, and are highly encouraged to apply
- Crosswalk: https://www.trs.texas.gov/files/trs-military-crosswalk.xlsx
- For questions, contact Talent Acquisition at [email protected]
Location: Austin, TX, United States (onsite)
Salary: USD 98,214 - 149,898 per year
Minimum Experience: 3 years