DataJobs.io
← Back to all jobs

Job Description

Alldus International Consulting is seeking a founding-level Data Engineer to help build the backend systems and data foundation behind Agentic AI applications. This onsite role in San Francisco, CA focuses on production-grade pipelines, connector frameworks, and graph-based knowledge models, with a strong emphasis on governance, observability, and secure data access. Compensation includes a $150,000 to $200,000 salary range plus equity.

What you’ll build

  • Data ingestion and transformation pipelines across structured, semi-structured, and unstructured sources.
  • Connector frameworks to integrate enterprise systems such as ERPs, PLMs, CRMs, legacy platforms, email, Excel, documents, and web APIs.
  • Data Fabric and knowledge graphs, including enrichment with ontologies, metadata, and relationships.
  • Semantic data preparation for AI and LLM workloads, including vectorization for use cases such as RAG, summarization, and intelligent alerting.
  • Data contracts, access layers, lineage, governance, and quality processes to keep enterprise data reliable and auditable.
  • Secure APIs that allow services, AI agents, and users to access and query enriched semantic data.
  • Collaboration with ML and LLM teams to ensure high-quality enterprise data for training, tuning, and AI applications.
  • Production systems that handle schema evolution, observability, scalability, and dependable operations.

What you bring

  • At least 5 years of experience designing, building, and operating large-scale data infrastructure in production environments.
  • Hands-on experience with ingestion frameworks including Kafka, Airbyte, Meltano, or Fivetran, plus orchestration tools such as Airflow, Dagster, or Prefect.
  • Experience working with structured, semi-structured, and unstructured data, including PDFs, Excel, emails, logs, CSVs, and web APIs.
  • Knowledge of columnar data stores, object storage, and lakehouse technologies such as Iceberg, Delta, or Parquet.
  • Strong understanding of knowledge graphs and semantic modelling, with experience using Neo4j, RDF, Gremlin, or PuppyGraph.
  • Experience designing and developing GraphQL and REST APIs, including scalable, developer-friendly data access layers.
  • Strong data governance knowledge, including RBAC, ABAC, data contracts, lineage, and data quality.
  • Vector database and embedding pipeline experience, including Weaviate, Qdrant, or Pinecone (highly desirable).
  • Familiarity with enterprise connector ecosystems, ontology versioning, graph diffing, and semantic schema alignment (advantage).
  • Exposure to RAG pipelines, LLM fine-tuning, Linked Data, W3C standards, or modern data fabric architectures (plus).

Technologies you’ll likely work with

  • Ingestion and orchestration: Kafka, Airbyte, Meltano, Fivetran, Airflow, Dagster, Prefect
  • Data and storage: Iceberg, Delta, Parquet
  • Graph and semantics: Neo4j, RDF, Gremlin, PuppyGraph
  • APIs and governance: GraphQL, REST APIs, RBAC, ABAC
  • Vector and AI data prep: Weaviate, Qdrant, Pinecone, RAG pipelines, LLM fine-tuning
  • Standards and related areas: Linked Data, W3C standards

Compensation

  • Salary: USD $150,000 to $200,000 per year
  • Equity

Similar Jobs