Associate Principal - Data Engineering

JD
Kafka Architect Responsibilities
• Design, develop, and manage confluent Kafka-based data pipelines
• Capacity planning with kafka clusters
• Work with other big data technologies such as Hadoop, Spark( Batch + Streaming)
• Build Streaming pipelines with realtime and near realtimetime technologies
• Monitor and optimize Kafka clusters
• Troubleshoot Kafka related issues
• Build the solutions in Azure cloud
• Handle customer queries and support
Kafka Architect Requirements & Skills
• Undegrad in Computer Science or related field
• 10+ years of experience in big data or related field
• Strong knowledge of Kafka and other big data technologies
• Hands on Expertise in Big data Architecture using Azure cloud
• Ability to showcase the pros and cons using Kafka for certain use cases.
• Good programming skills in Python, Scala or Java
• Good understanding of distributed systems
• Good communication and interpersonal skills
Min Salary: $140000
Max Salary: $160000