EchoStar is hiring a Data Engineer II to build and improve high-performance data pipelines for batch and streaming workloads. In this onsite role in Englewood, CO, you will work with AWS and Spark, and help evaluate workflow orchestration using Apache Airflow. You will also collaborate on integrating Amazon Q into the data pipeline lifecycle to support automation such as data quality checks and documentation.
What you’ll do
- Design, construct, and optimize scalable data pipelines for batch and streaming data processing from internal and external sources
- Build and manage data processing jobs using Apache Spark on Amazon EMR clusters, focusing on performance, cost-efficiency, and scalability
- Implement transformation logic and complex workflows primarily with Python, PySpark, and SQL
- Lead a Proof-of-Concept evaluating Apache Airflow as an enterprise-wide workflow orchestration tool, including designing and deploying Directed Acyclic Graphs (DAGs) to manage dependencies
- Explore integration points for Amazon Q as part of the orchestration POC, including automated data quality checks, data documentation generation, or pipeline optimization
- Implement CI/CD pipelines for data platform components using GitLab, leveraging Infrastructure-as-Code templates while maintaining strict data governance, security, and quality across the lifecycle
- Participate in at least one in-person interview
What you bring
- Bachelor’s degree in Computer Science, Data Engineering, or a related technical field
- Minimum 2 years of experience in Big Data and Data Engineering
- At least 2 years each with Python and SQL
- At least 2 years each with Amazon EMR and Apache Spark
- At least 2 years with Apache Airflow or Control M
- At least 2 years with GitLab CI/CD pipelines
- At least 2 years with Amazon Q or Generative AI tools
- Databricks experience is preferred
Salary
USD $83,160 - $118,800 per year.
Benefits
EchoStar offers versatile health and financial benefits, including flexible spending accounts, HSA, a 401(k) Plan with company match, ESPP, career opportunities, and a flexible time away plan. Benefits can be viewed here: EchoStar Benefits.
Pre-employment screening and posting
- Successful completion of a pre-employment screen is required, which may include a drug test and DMV check.
- The posting will be active for at least 3 days and will continue to extend by 3 days until the position is filled.
Technologies you’ll work with: Python, PySpark, SQL, Apache Spark, Amazon EMR, Amazon Q, Apache Airflow, Control M, Git, GitLab, Infrastructure-as-Code, Terraform, AWS CloudFormation, Amazon EC2, Amazon S3, DAGs, Databricks.
