Senior Data Engineer

**Job Type:** Permanent **Build a brilliant future with Hiscox**   **Role Overview:** We are seeking an experienced Senior Data Engineer to design, build, and maintain **enterprise data pipelines** and **data solutions** across our Microsoft-centric platform. This hybrid role combines hands-on technical expertise with a strong focus on data **governance**, **quality**, and **collaboration**. **Key Responsibilities:** * **ETL/ELT Pipelines:** Design, develop, and **maintain robust ETL/ELT pipelines** ensuring data is efficiently extracted, transformed, and loaded across systems. * **Data Engineering Projects:** Lead **data refactoring and integration projects** across the platform, optimising data flows and performance. * **Documentation & Governance:** Maintain **high-quality documentation** for data pipelines and architecture. Contribute to data **governance** initiatives to ensure data quality, security, and compliance. * **Cross-Team Collaboration:** Work closely with Dynamics 365, Power Platform, and other cross-functional teams to deliver integrated data solutions. **Engage stakeholders** to understand requirements and provide technical guidance. **Essential Skills & Experience:** * **Database Proficiency:** Deep expertise in **Microsoft SQL** (T-SQL) – able to write, optimise, and troubleshoot complex queries and stored procedures. * **Azure Data Factory (ADF):** Hands-on experience developing and orchestrating pipelines with **Azure Data Factory**. * **Dynamics 365 & Power Platform:** Proven experience working with **Microsoft Dynamics 365** and the **Power Platform** ecosystem. * **Dataverse:** **Strong experience with Microsoft Dataverse** (Common Data Service) – including data modelling and integration. (This is essential or a very strong advantage.) * **Data Architecture:** Solid understanding of **data modeling**, **data warehousing** concepts, and **ETL best practices** in a cloud environment. * **Collaboration & Communication:** Excellent communication skills with the ability to **translate complex data concepts** for technical and non-technical stakeholders. **Team-oriented**, proactive in knowledge sharing, and adept at documentation. * **Problem-Solving:** Demonstrated ability to **troubleshoot** data issues, optimise performance, and ensure reliability and accuracy of data pipelines. **Desirable Skills:** * **Microsoft Fabric:** Experience with **Microsoft Fabric (Azure)** for advanced analytics and data integration. * **Cloud Analytics:** Familiarity with **Azure Synapse Analytics** or **Azure Data Lake** for big data processing and warehousing. * **Scripting & Automation:** Proficiency in a programming/scripting language (e.g., **Python** or **C#** PowerShell) for advanced data transformation and automation. * **CI/CD & DevOps:** Experience implementing **CI/CD pipelines** and version control (e.g., Azure DevOps, Git) for data engineering projects. * **Data Quality & Governance Tools:** Experience using **data quality frameworks** or data governance tools to enforce standards and compliance. **Nice-to-Have Skills:** * **Big Data Tools:** Exposure to **Azure Databricks** * **BI & Reporting:** Knowledge of **Power BI** or similar data visualisation/BI tools for supporting analytics and reporting needs. * **ML Pipelines:** Basic understanding of **machine learning pipelines** or model deployment in a data engineering context. **Other Information:** * **Work Arrangement:** This position is **based in Lisbon** with a hybrid working model (_on-site at our Lisbon office approximately two days per week_). * **Mindset:** The ideal candidate is **detail-oriented**, **self-driven**, and passionate about clean, well-governed data. They thrive in a collaborative environment and take ownership of delivering high-quality solutions. _Work with amazing people and be part of a unique culture_