Tuesday, 7 July 2020

configure confluent single node in ubuntu

following are steps to install and configure confluent kafka,ksql,zookkeeper etc:-
1)go to confluent website and click on download
2)sign and download zip file or tar file
3)unzip the file in the folder i extracted in /home directory
4)then to configure for sinngle node create two folder zookeeper and kafka-logs
5)change path in datadir of zookeeper.properties and server.properties give path of newly created zookeeper and kafka-logs folder in respective files
6)look the attached file for more reference
7)then start zookeeper first the kafka
8)go to bin directory inside the confluent folder there you will find all the .sh files
9)run this command to start servies
10)./zookeeper-server-start  /home/devansh/confluent-5.5.1/etc/kafka/zookeeper.properties
  /home/devansh/confluent-5.5.1/etc/kafka/zookeeper.properties this path is the of zookeeper       properties file this is the whole command path will change depending upon youre installaton
11)similarly one can start the other services:-
     ./kafka-server-start /home/devansh/confluent-5.5.1/etc/kafka/server.properties
     ./schema-registry-start /home/devansh/confluent-5.5.1/etc/schema-registry/schema-             registry.properties
    ./ksql-server-start /home/devansh/confluent-5.5.1/etc/ksqldb/ksql-server.properties
12)test the working after installation and configuration
#create topic
./kafka-topics --create --topic first-topic --replication-factor 1 --partitions 1 --zookeeper localhost:2181

#send message
./kafka-console-producer --topic first-topic --broker-list localhost:9092

#read message
./kafka-console-consumer --topic first-topic --bootstrap-server localhost:9092 --from-beginning#create topic
./kafka-topics --create --topic first-topic --replication-factor 1 --partitions 1 --zookeeper localhost:2181

#send message
./kafka-console-producer --topic first-topic --broker-list localhost:9092

#read message
./kafka-console-consumer --topic first-topic --bootstrap-server localhost:9092 --from-beginning
13)one can also use telnet command to ping and check if service is running or not
14)telnet localhost:9002
15)also check my youtube channel for the video of installing and configuration
16)check out the video too on my channel https://youtu.be/4BHiQ02VAJI

I am Devansh Mody and here are a few of my links which contain my public work and different ways to connect with me I am looking forward to ...