Databricks Platform Lead / Technical Delivery Lead
OKAYA INFOCOM ยท Warren, NJ
Work typeHybrid ยท Full Time
Pay ยท estimate~$23 โ $30/hrMarket rate ยท not set by employer
PostedNov 20, 2026
LevelSenior
In short
Databricks Platform Engineering Lead / Technical Delivery Lead Work Location: Warren, NJ (Hybrid) Employment Type: Fulltime/Permanent Need Independent Candidates Only | Local orโฆ
SQLPYTHONPOWER BIAWSAZURE
๐ About the job
๐
LocationWarren, NJ (Hybrid)
๐๏ธ
Job typeFulltime/Permanent
Job Title: Databricks Platform Engineering Lead / Technical Delivery Lead
Need Independent Candidates Only | Local or Nearby
Minimum Years of Experience: 10+ Years
Need Someone who has experience in Python/PySpark and AWS Glue, EMR, S3
Develop and optimize analytical datasets and workloads involving Redshift and Athena
๐ขProject Overview
We are seeking an experienced Databricks Platform Engineering Led to support an enterprise-wide pricing application within a global reinsurance organization. The application leverages Databricks as its data and analytics platform and integrates with a SQL Server-based pricing application.
The resource will lead the engineering, governance, and ongoing enhancement of the Databricks platform supporting the pricing application. The role requires a strong combination of hands-on platform engineering, Databricks administration, data engineering, and technical delivery leadership.
The ideal candidate must be capable of managing the Databricks platform foundation while providing technical oversight to data-engineering teams building ETL/ELT pipelines, transformations, and pricing data products.
Technical and Delivery Expertise
๐น10+ years of overall technology experience.
๐น5+ years of hands-on experience with Databricks, cloud data platforms, or platform engineering.
๐น3+ years of experience in a Platform Lead, Databricks Lead, Cloud Platform Engineer, Data Platform Lead, or similar role.
๐นStrong hands-on experience with:
๐นAzure Databricks
๐นDatabricks account and workspace administration
๐นUnity Catalog
๐นApache Spark and PySpark
๐นPython and SQL
๐นDelta Lake and Lakehouse architecture
๐นAzure Data Lake Storage
๐นAzure Data Factory or comparable integration tools
๐นDatabricks Workflows and job orchestration
๐นInfrastructure as code using Terraform
๐นCI/CD and automated deployment practices
๐นStrong understanding of:
๐นDatabricks workspace provisioning and administration
๐นDevelopment, test, and production environment management
๐นCompute provisioning and cluster configuration
๐นCluster policies, pools, runtimes, and serverless compute
๐นPlatform security, identity, and access management
๐นService principals, managed identities, and secrets management
๐นAzure networking, private endpoints, and secure connectivity
๐นUnity Catalog architecture, permissions, lineage, and governance