Databricks Platform Lead / Technical Delivery Lead

OKAYA INFOCOM ยท Warren, NJ
Work typeHybrid ยท Full Time
Pay ยท estimate~$23 โ€“ $30/hrMarket rate ยท not set by employer
PostedNov 20, 2026
LevelSenior
In short Databricks Platform Engineering Lead / Technical Delivery Lead Work Location: Warren, NJ (Hybrid) Employment Type: Fulltime/Permanent Need Independent Candidates Only | Local orโ€ฆ
SQLPYTHONPOWER BIAWSAZURE

๐Ÿ“‹ About the job

LocationWarren, NJ (Hybrid)
Job typeFulltime/Permanent

Job Title: Databricks Platform Engineering Lead / Technical Delivery Lead

Need Independent Candidates Only | Local or Nearby

Minimum Years of Experience: 10+ Years

Need Someone who has experience in Python/PySpark and AWS Glue, EMR, S3

Develop and optimize analytical datasets and workloads involving Redshift and Athena

Project Overview

We are seeking an experienced Databricks Platform Engineering Led to support an enterprise-wide pricing application within a global reinsurance organization. The application leverages Databricks as its data and analytics platform and integrates with a SQL Server-based pricing application.

The resource will lead the engineering, governance, and ongoing enhancement of the Databricks platform supporting the pricing application. The role requires a strong combination of hands-on platform engineering, Databricks administration, data engineering, and technical delivery leadership.

The ideal candidate must be capable of managing the Databricks platform foundation while providing technical oversight to data-engineering teams building ETL/ELT pipelines, transformations, and pricing data products.

Technical and Delivery Expertise

  • 10+ years of overall technology experience.
  • 5+ years of hands-on experience with Databricks, cloud data platforms, or platform engineering.
  • 3+ years of experience in a Platform Lead, Databricks Lead, Cloud Platform Engineer, Data Platform Lead, or similar role.
  • Strong hands-on experience with:
  • Azure Databricks
  • Databricks account and workspace administration
  • Unity Catalog
  • Apache Spark and PySpark
  • Python and SQL
  • Delta Lake and Lakehouse architecture
  • Azure Data Lake Storage
  • Azure Data Factory or comparable integration tools
  • Databricks Workflows and job orchestration
  • Infrastructure as code using Terraform
  • CI/CD and automated deployment practices
  • Strong understanding of:
  • Databricks workspace provisioning and administration
  • Development, test, and production environment management
  • Compute provisioning and cluster configuration
  • Cluster policies, pools, runtimes, and serverless compute
  • Platform security, identity, and access management
  • Service principals, managed identities, and secrets management
  • Azure networking, private endpoints, and secure connectivity
  • Unity Catalog architecture, permissions, lineage, and governance
  • Platform monitoring, logging, auditability,โ€ฆ
๐Ÿ“„ Read the full description โ†’ The rest of this listing is on the hiring partnerโ€™s site.
Interested in this role?Apply in one click โ€” no JobQ account needed.
Apply now โ†’
Databricks Platform Lead / Technical Delivery Le...OKAYA INFOCOM
Apply now