San Francisco Bay Area, CA

Data Jobs in San Francisco Bay Area, CA

4 jobs found

Include remote jobs

1mo ago

Senior Scientific Data Engineer

Lawrence Berkeley National Laboratory San Francisco Bay Area, CA

San Francisco Bay Area, CA

1mo ago Closed

$139k - $174k/yr Full time Python Senior Data Engineer

This position is no longer accepting applications (closed Jul 12, 2026).

Job Description

Lawrence Berkeley National Laboratory's Joint Genome Institute is seeking a Senior Scientific Data Engineer to help design and sustain the data platforms that underpin genomic data generation, metadata management, and laboratory operations. This hybrid role in the San Francisco Bay Area offers the opportunity to influence systems that span LMS/LIMS, data warehouse and lakehouse architectures, and project management workflows, with the possibility to lead major technical initiatives across diverse teams.

Responsibilities

Translate intricate scientific, operational, and user needs into concrete specifications, architecture, and implementation plans for system enhancements, integrations, and shared data platforms.
Design, develop, deploy, and support core systems, APIs, and workflows including the Laboratory Information Management System (LMS/LIMS), Data Warehouse/Data Lakehouse, and Proposal/Project Management platforms to enable genomic data generation, metadata management, and laboratory operations.
Lead the resolution of complex technical challenges, drive system improvements, and ensure production platforms are reliable, scalable, interoperable, and high-performing.
Advocate engineering best practices through technical reviews, documentation, mentorship, and ongoing refinement of development and operational processes.

Requirements

A Bachelor’s degree in Computer Science or a related field with a minimum of 8 years of professional experience developing, integrating, deploying, and supporting production software applications and data systems that enable metadata management, workflow orchestration, data lifecycle operations, and broad user access to scientific and operational data.
Experience with data engineering and event-driven technologies such as Airflow or Kafka (or equivalent).
Hands-on experience with relational databases, object storage, and systems supporting structured, semi-structured, and large-scale datasets.
Solid grounding in software and data engineering principles for large-scale production systems, including system design, APIs, testing, concurrency, reliability, scalability, interoperability, and performance optimization.
Proficiency in Python and experience with one or more additional programming languages.
Experience using AI-assisted development tools with sound judgment to evaluate generated code for production readiness.
Ability to provide technical leadership shaping system architecture and direction across cross-functional engineering teams.
Excellent communication skills, including the ability to present complex technical information to internal teams and stakeholders.
Demonstrated experience collaborating with stakeholders to understand project goals and translate them into automated systems, technical specifications, and implementation plans.

Technologies

Python
Airflow
Kafka
Laboratory Information Management System (LMS/LIMS)
Data Warehouse/Data Lakehouse
AI-assisted development tools

Benefits

Exceptional health benefits
Generous paid time off, sick time off, and holidays
A culture where you’ll belong, with investment in our teams
Relocation assistance
Hybrid work schedule eligibility

Why join Berkeley Lab?

Strong health benefits
Generous paid time off, sick leave, and holidays
Inclusive culture with support for teams

Additional Information

Application deadline: Priority consideration for applications with resume and cover letter by June 22, 2026; applications accepted until the posting is removed.
Appointment type: Full-time, exempt from overtime pay, monthly paid, two-year term with benefits eligibility, with potential extension or conversion to a Career appointment based on performance, funding, and operational needs.
Salary range: USD 139,440 - 174,312 annually, within the broader job code range; final salary determined by qualifications, experience, and alignment with peers.
Background check: A background check is required; convictions will be evaluated for relevance to responsibilities; a history does not automatically disqualify.
Work modality: Hybrid schedule with on-site work at Lawrence Berkeley National Laboratory, 1 Cyclotron Road, Berkeley, CA 94720; must reside within 150 miles; rare cases of full remote work may be considered; Real ID or other acceptable identification required for access.
Relocation assistance: Eligible
Work authorization: Must be legally authorized to work in the United States; Berkeley Lab does not provide visa sponsorship for this position.

View full job page →

1mo ago

Senior Scientific Data Engineer

Lawrence Berkeley National Laboratory San Francisco Bay Area, CA

San Francisco Bay Area, CA

1mo ago Closed

$139k - $235k/yr Full time Python Senior Apache Airflow

This position is no longer accepting applications (closed Jun 29, 2026).

Job Description

The Senior Scientific Data Engineer at Lawrence Berkeley National Laboratory, working with the Joint Genome Institute (JGI), will design and operate core scientific data systems, data workflows, and AI-ready pipelines, emphasizing data management, job orchestration, and platform integration. This role is based in the San Francisco Bay Area with a hybrid work arrangement.

Responsibilities

Develop and enhance JGI's core scientific data and compute capabilities as part of a skilled engineering team.
Design, implement, and deploy production automated systems, APIs, and workflows that support genomic data movement, metadata management, job orchestration, data access, and large-scale scientific computing.
Identify and resolve technical issues and integration gaps while driving ongoing system improvements.
Strengthen the reliability, scalability, observability, interoperability, and maintainability of shared production data systems while supporting sustainable operations and delivery.
Promote engineering best practices through technical reviews, knowledge sharing, and team process optimization.

Requirements

A Bachelor's Degree (or equivalent knowledge/training) in Computer Science or a related field and a minimum of 8 years of related professional experience developing, integrating, deploying, and operating production software and data systems that support metadata management, workflow orchestration, data lifecycle operations, and broad user data access or an equivalent combination of education and professional experience.
Strong knowledge of software and data engineering fundamentals relevant to data-intensive distributed systems, including system design, concurrency, performance, and testing.
Experience with database and data storage technologies including relational databases, object storage, and systems for managing structured, semi-structured, and large-scale data.
Experience with data engineering and event-driven technologies such as Airflow or Kafka.
Experience effectively using AI coding agents such as Claude Code, Codex, Cursor, including demonstrated judgment in reviewing and validating generated software for correctness, quality, security, maintainability, and suitability for production use.
Proficiency in Python and experience with one or more additional programming languages.
Excellent communication skills, including experience organizing and presenting complex technical information to internal teams and stakeholders.
Demonstrated ability to work effectively with users, stakeholders, and engineering teams to deliver technical results in a complex, interdisciplinary environment.

Technologies

Python
Airflow
Kafka
Claude Code
Codex
Cursor
WDL
Nextflow

Benefits

Exceptional health and retirement benefits, including pension or 401K-style plans
A culture where you’ll belong; we are invested in our teams
Winter Holiday Shutdown every year
Parental bonding leave (for both mothers and fathers)
Pet insurance
Relocation assistance

Desired Qualifications

A Master’s Degree (or equivalent knowledge/training) in Computer Science or a related field.
Experience working with genomics, bioinformatics, and/or next-generation sequencing data.
Experience with scientific workflow languages or workflow systems such as WDL and Nextflow.
Experience with full-stack or front-end application development.
Experience working in High Performance Computing (HPC) environments.

Additional Information

Application Date: Priority consideration will be given to candidates who apply with a resume and cover letter by June 1, 2026. Applications will be accepted until the job posting is removed.
Appointment Type: Full time, exempt from overtime pay, monthly paid, two-year term appointment with benefits eligibility, with potential for extension or conversion to a Career appointment based on performance, funding, and operational needs.
Salary Range: Budgeted salary range is $139,440 to $174,312 annually, within the broader range of $139,440 to $235,308 for job code C71.3; final offer depends on qualifications and experience.
Background Check: The position is subject to a background check; convictions will be evaluated for relevance to the role. A prior conviction does not automatically disqualify an applicant.
Work Modality: Hybrid work schedule with on-site presence at 1 Cyclotron Road, Berkeley, CA 94720; residency within 150 miles is required; some cases of full-remote work may be considered. Real ID or equivalent identification is required.
Relocation Assistance: Eligible for relocation support.
Work Authorization: Applicants must be legally authorized to work in the United States. Berkeley Lab does not provide visa sponsorship for this position.
Misconduct Disclosure Requirement: Finalists must disclose any misconduct-related administrative or judicial decisions within the last seven years; disclosure is a condition of employment.

Who is JGI?

The Joint Genome Institute (JGI) is a global leader in genome science, enabling biological discovery through advanced genomic capabilities, expert support, and large-scale, AI-ready data resources. As a DOE Office of Science user facility supported by BER, JGI advances BER's mission to achieve a predictive understanding of complex biological, Earth, and environmental systems to support the nation’s energy and infrastructure needs.

Why join Berkeley Lab?

Exceptional health and retirement benefits, including pension or 401K-style plans
A culture where you belong; we are invested in our teams
Winter Holiday Shutdown every year
Parental bonding leave (for mothers and fathers)
Pet insurance

View full job page →

1mo ago

Staff Data Engineer, Analytics

Discord San Francisco Bay Area, CA

San Francisco Bay Area, CA

1mo ago Closed

$248k - $279k/yr Full time Senior Analytics Business Intelligence

This position is no longer accepting applications (closed Jun 21, 2026).

Job Description

Location: San Francisco Bay Area, CA (onsite) • Salary: USD 248,000 - 279,000 per year

Discord offers equity and a platform to shape analytics at scale. In the Staff Data Engineer, Analytics role, you will define the technical strategy and architecture for analytics data infrastructure, own the transformation and semantic layer, and own end-to-end metrics in collaboration with Data Science, Product, Finance, and Engineering.

Responsibilities

Define the technical strategy and architectural direction for analytics data infrastructure, building and maintaining enterprise-scale curated datasets and data models
Own end-to-end metric definitions, partnering with stakeholders to determine what we measure, designing and implementing production data models, and surfacing metrics and dimensions in dashboards and reports
Design and build sophisticated data models and analytical frameworks using SQL, Python, and modern data stack technologies
Develop data quality frameworks, monitoring, anomaly detection, and alerting at massive scale, with governance, lineage tracking, and change management rigor for externally reported numbers
Drive adoption of consistent data modeling patterns, naming conventions, documentation norms, and metric governance standards across the data organization
Lead cross-functional technical initiatives across product verticals and mentor engineers to accelerate delivery and harden data systems
Navigate ambiguity and make sound technical decisions with incomplete information, balancing short-term delivery with long-term infrastructure investment

Requirements

7+ years of experience in analytics or data engineering with a strong focus on building curated, consumer-facing datasets
7+ years designing, developing, and maintaining robust data models from structured and unstructured sources
Expert-level SQL and strong Python skills, with solid fundamentals in version control and CI/CD
Proven experience implementing data quality audits, monitoring systems, and automated remediation for massive datasets
Experience building and owning executive-level dashboards and reports using BI tools (eg, Looker, Tableau, or similar)
Strong business acumen and communication skills, able to translate ambiguous business questions into concrete metric definitions and explain complex implementations to audiences from engineering peers to executive leadership
Track record of hands-on collaboration with Data Science, Finance, and Product teams

Technologies

SQL
Python
Looker
Tableau
dbt
BigQuery

Benefits

equity

Bonus Points

Passion for Discord or online communities
Experience building or contributing to a semantic layer or metrics store
Experience with modern analytics and data engineering tools and workflows (dbt, BigQuery, or similar)
Experience defining and governing metric standards across a data organization
Experience with reporting infrastructure subject to external audit or SOX compliance

View full job page →

1mo ago

Lead Scientific Data Engineer

Lawrence Berkeley National Laboratory San Francisco Bay Area, CA

San Francisco Bay Area, CA

1mo ago Closed

$159k - $268k/yr Full time Python Apache Airflow Big Data

This position is no longer accepting applications (closed Jun 21, 2026).

Job Description

Join Lawrence Berkeley National Laboratory’s Joint Genome Institute in the San Francisco Bay Area with hybrid work options, a supportive culture, and a competitive compensation package. This role offers a salary range of USD 158,808 to 267,996 per year, strong health and retirement benefits, and a commitment to work-life balance and professional growth.

We are seeking a Lead Scientific Data Engineer to provide senior technical leadership for core genomic data systems, data management, job orchestration, and platform integration that drive AI enabled scientific discovery.

Responsibilities

Provide senior technical leadership for JGI's core scientific data and compute platforms by crafting implementation roadmaps, data system architectures, and long term strategy.
Design and implement production automated systems, APIs, and workflows that enable genomic data movement, metadata management, job orchestration, data access, and large scale scientific computing.
Improve reliability, scalability, observability, interoperability, and maintainability of shared production data systems while supporting sustainable operations and delivery.
Collaborate with product managers, scientists, and users to drive cross team alignment and integration decisions that address complex technical challenges and shared priorities.

Requirements

Bachelor’s degree in Computer Science or a related field and a minimum of 12 years of professional experience with large scale scientific data and compute infrastructures, or an equivalent combination of education and experience.
Proven experience leading the design, development, integration, and operation of production software and data systems that support metadata management, workflow orchestration, data lifecycle operations, and broad user data access.
Advanced knowledge of data and software engineering fundamentals relevant to data intensive distributed systems, including system design, concurrency, performance, and testing.
Wide experience with databases and data storage technologies, including relational databases, object storage, and systems managing structured, semi-structured, and large scale data.
Experience with data engineering and event driven technologies such as Airflow or Kafka.
Strong experience using AI coding agents like Claude Code, Codex, or Cursor, with the ability to review and validate generated software for production quality, security, and maintainability.
Proficiency in Python and experience with one or more additional programming languages.
Excellent communication skills, with the ability to present complex technical information to diverse audiences.
Demonstrated ability to lead through influence in interdisciplinary environments, aligning users, stakeholders, and engineering teams around shared requirements and implementation plans.

Technologies

Airflow
Kafka
Claude Code
Codex
Cursor
Python
WDL
Nextflow

Benefits

Exceptional health and retirement benefits, including pension or 401K style plans
A belonging culture with strong investment in team wellbeing and growth
Vacation and sick time plus a Winter Holiday Shutdown each year
Parental bonding leave for both mothers and fathers
Pet insurance

View full job page →

Data Jobs in San Francisco Bay Area, CA

Senior Scientific Data Engineer

Senior Scientific Data Engineer

Staff Data Engineer, Analytics

Lead Scientific Data Engineer

Get Data Jobs in San Francisco Bay Area, CA alerts