Kafka Engineer

fractal analytics

📍 bengaluru india🕐 15mo ago🔗 workday

Job Description

It's fun to work in a company where people truly BELIEVE in what they are doing! _We're committed to bringing passion and customer focus to the business._ **Job Summary** We are looking for a skilled Kafka Engineer with hands-on experience in Confluent Platform to design, build, and maintain high-performance, real-time data streaming pipelines. The ideal candidate will have expertise in Kafka ecosystem components and be well-versed in deploying and scaling Kafka clusters, both on-prem and in cloud environments. Key Responsibilities * Design, build, and manage Kafka and Confluent infrastructure for high throughput streaming applications * Implement Kafka Connect, Schema Registry, and KSQL (KSQLDB), FlinkSQL * Ensure high availability, performance tuning, and monitoring of Kafka clusters * Collaborate with data engineers and backend teams to integrate streaming pipelines with data lakes, warehouses. * Set up and enforce Kafka security mechanisms (SASL, SSL, ACLs, RBAC) * Create and manage CI/CD pipelines for Kafka components using tools like Git, Jenkins, etc. * Monitor and troubleshoot issues using tools like Confluent Control Center, DataDog **Required Skills** * Experience in Apache Kafka and Confluent Platform * Experience with Kafka Connect, Kafka Streams, Schema Registry, KSQL, and FlinkSQL * Strong background in Java or Python * Good understanding of stream processing and event-driven architecture * Hands-on experience with cloud platforms: AWS / Azure / GCP (esp. Confluent Cloud) * Proficient in Kafka cluster deployment, tuning, and maintenance * Familiarity with CI/CD, Git, Helm, and Kubernetes **Nice to Have** * Knowledge of Terraform, Pulumi, or other Infra as Code tools * Exposure to DataOps / Data Engineering ecosystems If you like wild growth and working with happy, enthusiastic over-achievers, you'll enjoy your career with us! Not the right fit?  Let us know you're interested in a future opportunity by clicking _Introduce Yourself_ in the top-right corner of the page or create an account to set up email alerts as new job postings become available that meet your interest!
Kafka Engineer at fractal analytics | MergeJobs