Senior Data Engineer

n-ix

📍 poland🕐 22d ago🔗 greenhouse

Job Description

Join an exciting journey to create a cutting-edge Consumer Data Lake for a leading global organization based in Europe. This platform will unify, process, and leverage consumer data from various systems, unlocking advanced analytics, insights, and personalization opportunities. As a Senior Data Engineer, you will play a pivotal role in shaping and implementing the platform's architecture, focusing on hands-on technical execution and collaboration with cross-functional teams. Your work will transform consumer data into actionable insights and personalization on a global scale. Using advanced tools to tackle complex challenges, you’ll innovate within a collaborative environment alongside skilled architects, engineers, and leaders. Key Responsibilities: • Hands-On Development: Build, maintain, and optimize data pipelines for ingestion, transformation, and activation. • Create and implement scalable solutions to handle diverse data sources and high volumes of information • Data Modeling & Warehousing: Design and maintain efficient data models and schemas for a cloud-based data platform. • Develop pipelines to ensure data accuracy, integrity, and accessibility for downstream analytics. • Collaboration: Partner with Solution Architects to translate high-level designs into detailed implementation plans. • Work closely with Technical Product Owners to align data solutions with business needs. • Collaborate with global teams to integrate data from diverse platforms, ensuring scalability, security, and accuracy. • Platform Development: Enable data readiness for advanced analytics, reporting, and segmentation. • Implement robust frameworks to monitor data quality, accuracy, and performance. • Testing & Quality Assurance: Implement robust security measures to protect sensitive consumer data at every stage of the pipeline • Ensure compliance with data privacy regulations (e.g., GDPR, CCPA ..) and internal policies. • Monitor and address potential vulnerabilities, ensuring the platform adheres to security best practices. Requirements: • Over 4+ years of experience showcasing technical expertise and critical thinking in data engineering. • Hands-on experience with DBT and strong Python programming skills. • Proficiency in Snowflake and expertise in data modeling are essential. • Demonstrated experience in building consumer data lakes and developing consumer analytics capabilities is required. • In-depth understanding of privacy and security engineering within Snowflake, including concepts like RBAC, dynamic/tag-based data masking, row-level security/access policies, and secure views. • Ability to design, implement, and promote advanced solution patterns and standards for solving complex challenges. • Familiarity with multiple cloud platforms (Azure or GCP preferred, with a focus on Azure). • Practical experience with Big Data batch and streaming tools. • Competence in SQL, NoSQL, relational database design (SAP HANA experience is a bonus), and efficient methods for data retrieval and preparation at scale. • Proven ability to collect and process raw data at scale, including scripting, web scraping, API integration, and SQL querying. • Experience working in global environments and collaborating with virtual teams. • A Bachelor’s or Master’s degree in Data Science, Computer Science, Economics, or a related discipline. We offer*: • Flexible working format - remote, office-based or flexible • A competitive salary and good compensation package • Personalized career growth • Professional development tools (mentorship program, tech talks and trainings, centers of excellence, and more) • Active tech communities with regular knowledge sharing • Education reimbursement • Memorable anniversary presents • Corporate events and team buildings • Other location-specific benefits *not applicable for freelancers