NTT Ltd (NTT DATA) is building and scaling enterprise-grade Databricks Lakehouse platforms through a dedicated Databricks Center of Excellence (CoE). In this onsite role in Plano, TX, you will design, govern, and operationalize modern data platforms that enable client-facing analytics, AI/BI dashboards, model serving, and advanced use cases across cloud environments.
This position blends platform engineering, hands-on data engineering, and adoption enablement of modern Databricks capabilities. You will help establish repeatable standards, drive secure deployment patterns, and support teams in adopting the Lakehouse with confidence.
Responsibilities
- Design and deploy enterprise-scale Databricks Lakehouse platforms across AWS and Azure
- Establish secure and governed environments using Unity Catalog, role-based access controls, and data lineage
- Define platform standards, reusable patterns, and guardrails to support scalable adoption
- Optimize performance, cost, and reliability for production workloads
- Implement CI/CD, environment promotion, and DevOps automation for Databricks
- Lead adoption of modern Databricks capabilities such as Unity Catalog, Dataflow / declarative pipelines, and Genie / AI-assisted development
- Enable use cases including AI/BI dashboards, model serving, and advanced analytics
- Build and optimize batch and streaming pipelines using Spark and Delta Lake
- Develop data products and domain-oriented pipelines aligned to enterprise data strategies
- Lead end-to-end delivery for use cases, from requirements through production deployment
- Drive data quality, observability, and pipeline reliability
- Serve as a trusted advisor across architecture, data, risk, and business stakeholders
- Translate business requirements into technical architecture and delivery roadmaps
- Run workshops and solution design sessions to support platform adoption strategies
- Support proposals, solutioning, and client innovation efforts within regulated industries
- Build and contribute to NTT DATA accelerators, frameworks, and reusable assets
- Define best practices, reference architectures, and playbooks for enterprise Databricks adoption
- Mentor junior engineers and support capability building across the CoE
Requirements
- 12+ years of experience in data engineering, platform engineering, or data architecture
- 5+ years hands-on experience with Databricks in large enterprise environments
- Deep expertise in Apache Spark using Scala and Python
- Deep expertise in Delta Lake and Lakehouse architectures
- Deep expertise in Databricks workspace setup, cluster policies, and job orchestration
- Strong experience with cloud platforms: AWS, Azure, or GCP
- Experience implementing data governance, security, and compliance controls
- Proven ability to design and deliver scalable, production-grade data platforms
- Strong client-facing and communication skills
Location
Plano, TX (onsite). Additional locations listed: Minneapolis, MN, Chicago, IL, Atlanta, GA.
Technologies
Databricks, Unity Catalog, Dataflow, Genie, Apache Spark, Scala, Python, Delta Lake, Lakehouse, AWS, Azure, GCP, CI/CD, DevOps, Kafka, Structured Streaming, MLOps, Model Serving, AI/BI, AI-assisted development workflows, agent-based tooling
Preferred Qualifications
- Experience in financial services or other regulated industries
- Familiarity with data governance frameworks, regulatory reporting, and risk data environments
- Databricks certifications (for example: Data Engineer, Solutions Architect)
- Experience with real-time streaming using Kafka and Structured Streaming
- Experience with MLOps and Model Serving
- Experience with Data marketplace / data product architectures
- Exposure to AI-assisted development workflows and agent-based tooling