Databricks Lead – Delivery & Engineering
jade global software pvt
📍 pune maharashtra hyderabad telangana india🕐 5mo ago🔗 workday
Job Description
Databricks Lead – Delivery & Engineering1
**Lead **hands-on Databricks delivery**, ensuring adherence to CoE standards and best practices.**
### ****Key Responsibilities****
* **Lead Databricks engineering teams**
* **Build and optimize Spark & Delta Lake pipelines**
* **Implement Databricks Jobs, Workflows, CI/CD**
* **Optimize performance and DBU usage**
* **Contribute to Databricks accelerators and standards**
* **Design and implement end-to-end data platforms using Databricks Lakehouse**
* **Lead development of:**
* **Data ingestion (batch & streaming)**
* **Delta Lake data modeling (Bronze/Silver/Gold)**
* **Scalable ETL/ELT pipelines**
* **Optimize Spark workloads for performance and cost**
* **Ensure reliability, scalability, and observability of data pipelines**
### ****Experience****
* ****10–12 years** in data engineering**
* ****3–5 years** hands-on Databricks experience**
### ****Skills****
* **Deep expertise in Databricks, Apache Spark, Delta Lake**
* **Strong hands-on experience with PySpark / Spark SQL (core, SQL, streaming)**
* **Experience designing Lakehouse architectures**
* **Strong understanding of data modeling, data quality, and lineage**
* **Databricks platform features**
* **Cloud-native data engineering**
* **Performance tuning & troubleshooting**
****Certifications (Preferred)****
* **Databricks Data Engineer Associate and Professional**