Job Type: Full Time
Job Category: IT
Job Description
Role : Kafka Hadoop Developer
Location: Charlotte, NC
FTE ONLY
Job Summary
We are seeking a highly skilled Kafka Hadoop Developer to design, develop, and maintain scalable big data and streaming data platforms. The ideal candidate will have strong expertise in Apache Kafka, Hadoop ecosystem technologies, and distributed systems, with experience building high-throughput, low-latency data pipelines for real-time and batch processing.
Key Responsibilities
- Design and implement real-time streaming solutions using Apache Kafka
- Develop and maintain big data pipelines using Hadoop ecosystem tools (HDFS, Hive, Spark, HBase, YARN)
- Build Kafka producers, consumers, and stream processing applications
- Integrate Kafka with big data platforms and cloud services
- Optimize data ingestion, processing, and storage performance
- Ensure data quality, reliability, fault tolerance, and scalability
- Collaborate with data engineers, data scientists, and platform teams
- Implement security, monitoring, and governance for data platforms
- Support CI/CD pipelines and DevOps practices for data applications
Required Skills
- Strong hands-on experience with Apache Kafka (Kafka Streams, Kafka Connect)
- Strong knowledge of Hadoop ecosystem (HDFS, Hive, Spark, HBase, YARN)
- Proficiency in Java / Scala / Python
- Experience with Spark Streaming / Flink / Storm
- Knowledge of distributed systems and microservices architecture
- Experience with NoSQL databases (Cassandra, MongoDB, HBase)
- Familiarity with cloud platforms (AWS / Azure / GCP)
- Experience with Docker, Kubernetes
- Strong understanding of data modeling, ETL, and data engineering concepts
Good to Have
- Experience with Confluent Kafka Platform
- Experience with Schema Registry, Avro, Protobuf
- Knowledge of data lake architectures
- Experience with Airflow, Oozie
- Exposure to ML data pipelines
Preferred Qualifications
- Bachelor’s or Master’s degree in Computer Science, Engineering, or related field
- Experience working in high-volume, real-time data environments
- Strong problem-solving and communication skills
Required Skills
Cloud Developer SQL Application Developer