DataJobs.io
← Back to all jobs

Job Description

NTT Ltd (NTT DATA) is building and scaling enterprise-grade Databricks Lakehouse platforms through a dedicated Databricks Center of Excellence (CoE). In this onsite role in Plano, TX, you will design, govern, and operationalize modern data platforms that enable client-facing analytics, AI/BI dashboards, model serving, and advanced use cases across cloud environments.

This position blends platform engineering, hands-on data engineering, and adoption enablement of modern Databricks capabilities. You will help establish repeatable standards, drive secure deployment patterns, and support teams in adopting the Lakehouse with confidence.

Responsibilities

  • Design and deploy enterprise-scale Databricks Lakehouse platforms across AWS and Azure
  • Establish secure and governed environments using Unity Catalog, role-based access controls, and data lineage
  • Define platform standards, reusable patterns, and guardrails to support scalable adoption
  • Optimize performance, cost, and reliability for production workloads
  • Implement CI/CD, environment promotion, and DevOps automation for Databricks
  • Lead adoption of modern Databricks capabilities such as Unity Catalog, Dataflow / declarative pipelines, and Genie / AI-assisted development
  • Enable use cases including AI/BI dashboards, model serving, and advanced analytics
  • Build and optimize batch and streaming pipelines using Spark and Delta Lake
  • Develop data products and domain-oriented pipelines aligned to enterprise data strategies
  • Lead end-to-end delivery for use cases, from requirements through production deployment
  • Drive data quality, observability, and pipeline reliability
  • Serve as a trusted advisor across architecture, data, risk, and business stakeholders
  • Translate business requirements into technical architecture and delivery roadmaps
  • Run workshops and solution design sessions to support platform adoption strategies
  • Support proposals, solutioning, and client innovation efforts within regulated industries
  • Build and contribute to NTT DATA accelerators, frameworks, and reusable assets
  • Define best practices, reference architectures, and playbooks for enterprise Databricks adoption
  • Mentor junior engineers and support capability building across the CoE

Requirements

  • 12+ years of experience in data engineering, platform engineering, or data architecture
  • 5+ years hands-on experience with Databricks in large enterprise environments
  • Deep expertise in Apache Spark using Scala and Python
  • Deep expertise in Delta Lake and Lakehouse architectures
  • Deep expertise in Databricks workspace setup, cluster policies, and job orchestration
  • Strong experience with cloud platforms: AWS, Azure, or GCP
  • Experience implementing data governance, security, and compliance controls
  • Proven ability to design and deliver scalable, production-grade data platforms
  • Strong client-facing and communication skills

Location

Plano, TX (onsite). Additional locations listed: Minneapolis, MN, Chicago, IL, Atlanta, GA.

Technologies

Databricks, Unity Catalog, Dataflow, Genie, Apache Spark, Scala, Python, Delta Lake, Lakehouse, AWS, Azure, GCP, CI/CD, DevOps, Kafka, Structured Streaming, MLOps, Model Serving, AI/BI, AI-assisted development workflows, agent-based tooling

Preferred Qualifications

  • Experience in financial services or other regulated industries
  • Familiarity with data governance frameworks, regulatory reporting, and risk data environments
  • Databricks certifications (for example: Data Engineer, Solutions Architect)
  • Experience with real-time streaming using Kafka and Structured Streaming
  • Experience with MLOps and Model Serving
  • Experience with Data marketplace / data product architectures
  • Exposure to AI-assisted development workflows and agent-based tooling

Similar Jobs