On TikTok USDS JV’s Edge and CDN team, this Data Engineer role focuses on turning edge and CDN operational telemetry into reliable data pipelines and warehouses. You will help produce intelligence used by SRE teams for alerting, capacity planning, and analytics, while partnering with reliability and business stakeholders to improve platform insights and reduce infrastructure cost.
What you’ll do
- Design and build high-concurrency, real-time streaming pipelines that ingest and process CDN measurement data, edge access logs, and infrastructure telemetry at hyperscale using Flink, Spark Streaming, or Kafka.
- Own the design and ongoing maintenance of offline and real-time data warehouses, implementing robust ETL/ELT workflows that consolidate edge, network, and client-side data into a unified source of truth.
- Create data and analytics products that support intelligent SRE, including statistical and ML-assisted anomaly detection, alerting, and root-cause analysis across the global edge fleet.
- Develop cost attribution and optimization datasets to quantify edge resource spend across bandwidth, compute, storage, and peering, and identify optimization opportunities across PoPs, ISPs, and product lines.
- Build demand forecasting and capacity planning datasets using historical traffic, seasonality, growth, and event signals to inform procurement and edge capacity deployment.
- Design and deliver dashboards, “compasses,” and self-service analytics that surface edge and CDN platform health, performance, cost, and growth for engineers, leaders, and cross-functional partners.
- Implement proactive monitoring, data quality, and lineage frameworks to maintain pipeline stability and protect the integrity of critical reliability and business metrics.
Requirements
- Bachelor’s degree or higher in Computer Science, Data Engineering, or a related quantitative field.
- 3+ years of data engineering experience building production-grade real-time and offline pipelines on Big Data platforms.
- Strong SQL skills and hands-on experience with at least one of Python, Java, Scala, or Go, plus distributed processing frameworks such as Spark/Flink and streaming systems such as Kafka/Pulsar or equivalent.
- Experience operating at hyperscale with data lake / lakehouse architectures (Hudi, Iceberg, Delta) and OLAP engines (ClickHouse, Doris, Presto/Trino).
- Domain experience with CDN, edge, networking, or large-scale infrastructure telemetry (access logs, RUM, NetFlow, peering data) and SRE/observability use cases such as anomaly detection and SLO analytics.
- Demonstrated leadership and self-direction, with strong written and verbal communication skills, including a willingness to teach and learn.
Technologies
- Flink, Spark Streaming, Kafka, Spark
- Python, Java, Scala, Go, Pulsar
- Hudi, Iceberg, Delta
- ClickHouse, Doris, Presto/Trino
- ETL, ELT, data lakes, OLAP engines, message queues, caches, streaming engines
Compensation and location
- Location: San Jose, CA (onsite)
- Base salary range: $136,800 - $359,720 per year
- Compensation may vary outside the range based on qualifications, skills, competencies, experience, and location
- Base pay is one part of the Total Package; the role may also include discretionary bonuses/incentives and restricted stock units
Benefits
- Day one access to medical, dental, and vision insurance
- 401(k) savings plan with company match
- Paid parental leave
- Short-term and long-term disability coverage
- Life insurance
- Wellbeing benefits
- 10 paid holidays per year
- 10 paid sick days per year
- 17 days of Paid Personal Time (prorated upon hire, with increasing accruals by tenure)
- Eligible for additional discretionary bonuses/incentives and restricted stock units
About USDS
TikTok USDS Joint Venture LLC is dedicated to the safety and security of millions of Americans who create, discover, and connect with what they love on the apps operated by the Joint Venture. The Joint Venture has been established in compliance with the Executive Order signed by President Trump on September 25, 2025. On-site presence across teams supports faster speed, alignment, and agility, transitioning from a hybrid work model to a fully in-person schedule up to 5 days a week.
Reasonable accommodation
USDS is committed to providing reasonable accommodations in its recruitment processes for candidates with disabilities, pregnancy, sincerely held religious beliefs, or other reasons protected by applicable laws. If you need assistance or a reasonable accommodation, reach out at https://tinyurl.com/USDS-RA.
