Chief Lakehouse Architect – Databricks Coe

Chief Lakehouse Architect – Databricks CoE1 **Principal architect responsible for defining and executing **enterprise-grade Databricks Lakehouse architecture standards,** engagements and guiding complex solution designs. Drive **cost optimization and financial governance** for Databricks platforms across clients and internal workloads.** ### ****Key Responsibilities**** * **Define Databricks reference architectures (batch, streaming, ML, GenAI)** * **Own standards for Delta Lake, medallion architecture, Unity Catalog** * **Design multi-workspace Databricks platform architectures** * **Lead Databricks migrations from legacy data warehouses programs** * **Design, Review and approve architecture for all Databricks deals** * **Mentor architects and senior Databricks engineers** * **Define Databricks FinOps framework** * **Optimize cluster policies, DBU usage, and job scheduling** * **Work with engineering teams on performance-to-cost optimization** * **Advise leadership and clients on Databricks cost strategies** ### ****Experience**** * ****12–15 years** in data architecture** * ****5–7 years** hands-on Databricks & Apache Spark** * ****3+ years** designing enterprise Databricks platforms, managing Databricks costs at scale** ### ****Skills**** * **Databricks platform internals & optimization** * **Spark performance tuning and scalability** * **Delta Lake internals (ACID, compaction, Z-order)** * **Databricks Jobs, Workflows, CI/CD, IaC** * **Cloud-native Databricks (AWS / Azure / GCP)** * **Cluster tuning & auto-scaling strategies, Databricks DBU model & pricing** * **Cloud billing & monitoring tools** * **Cost optimization patterns for Spark workloads** ****Certifications (Preferred)**** * **Databricks Data Engineer Professional** * **FinOps Practitioner**