Data Engineer

Trading Technologies is seeking a Data Engineer to join its Data and Analytics engineering team. The role focuses on modernizing a SQL Server-based data platform to Snowflake and AWS, while delivering reliable data pipelines, performance improvements, and migrated workflows.

Key Responsibilities

• Develop, maintain, and optimize complex SQL Server queries, stored procedures, functions, and views, along with data processing workflows.
• Design and build scalable Snowflake data solutions, including data models, SQL transformations, loading processes, and analytical workloads.
• Contribute to the migration of large volumes of data and processing from SQL Server to Snowflake.
• Review existing SQL Server logic and translate or redesign it for Snowflake where appropriate.
• Build and maintain ETL/ELT pipelines using SQL, Python, and orchestration tools such as Apache Airflow.
• Create data ingestion and processing workflows on AWS, including S3.
• Perform SQL Server and Snowflake performance tuning, including query optimization, execution plans, indexing, statistics, warehouse sizing, and workload optimization.
• Implement data validation and reconciliation processes to ensure migrated and transformed data is accurate and complete.
• Troubleshoot production data issues, identify root causes, and implement durable solutions.
• Set up monitoring, logging, alerting, and operational controls for critical data pipelines.
• Collaborate with software engineers, service managers, the implementation team, product teams, and DevOps.
• Support and enhance existing Transaction Cost Analysis (TCA) products and develop new functionality.
• Work with large-scale trade, market, benchmark, and financial data.

Required Qualifications

• Bachelor’s degree in Computer Science, Data Engineering, or a related field.
• Hands-on experience with Snowflake and AWS Cloud services, particularly S3 and related data services.
• Strong hands-on SQL development experience.
• Python and C# scripting experience.
• Strong experience with Microsoft SQL Server, including complex queries, stored procedures, performance tuning, and troubleshooting.
• Experience working with large datasets and production data systems.
• Strong analytical and problem-solving skills.
• Experience migrating SQL Server workloads to Snowflake or another cloud data platform.
• Experience with Apache Airflow or similar orchestration technologies.
• Experience with Git, CI/CD, Liquibase, and automated deployment processes.
• Experience with data quality, reconciliation, and data governance.
• Knowledge of capital markets, trading, market data, or financial systems.
• Experience with Transaction Cost Analysis (TCA) or other financial analytics.
• Snowflake or AWS certification.
• Ability to use AI effectively while independently validating generated code for correctness, security, performance, and maintainability.

Technologies

SQL, Python, C#, Microsoft SQL Server, Snowflake, ETL/ELT, Apache Airflow, AWS, S3, Git, CI/CD, Liquibase, SQL transformations, data pipelines, stored procedures, functions, views, query optimization, execution plans, indexing, statistics, warehouse sizing, workload optimization, Transaction Cost Analysis (TCA), Claude Code

Compensation and Location

• Location: New York, NY (hybrid)
• Salary: USD 94,500 - 115,000 per year

Benefits

• Medical, Dental, and Vision insurance
• Flexible Spending Accounts (FSA) & Health Savings Accounts (HSA)
• 401(k) retirement plan
• Pre-tax transit and parking benefits
• Hybrid position requiring three days of in-office collaboration per week, with flexibility to work remotely for the remaining two days
• 22 days of Paid Time Off (PTO) per year, with the option to roll over unused days
• One dedicated day per year for volunteering
• Two professional development days per year
• Additional PTO day added during milestone anniversary years
• Robust paid holiday schedule with early dismissal
• Generous parental leave for all parents (including adoptive parents)
• Budget for tech accessories, including monitors, headphones, keyboards, and other office equipment
• Backup child and pet care, as well as tutoring services
• Milestone anniversary bonuses
• Stipend and subsidy contributions toward personally-owned cell phones
• Contributions for gym memberships and health/wellness initiatives
• Discounted healthcare premiums
• Healthy meal delivery program subsidies

Hybrid Work Model

This hybrid role combines in-person collaboration with focused remote work. The position requires three days of in-office collaboration each week, with the option to work remotely for the remaining two days.

AI-Assisted Development

• Engineers are encouraged to use modern AI-assisted development tools, including Claude Code, to accelerate development, debugging, testing, refactoring, and migration work.
• Candidates are expected to use AI effectively while independently validating generated code for correctness, security, performance, and maintainability.