主機名
ip 位址
安裝路徑
系統135.36.247.91
135.36.247.91
/board/opt/kafka_2.11-1.0.0
centos linux release 7.3.1611 (core)
135.36.247.92
135.36.247.92
135.36.247.93
135.36.247.93
解壓：tar -zxf kafka_2.12-1.0.0.tgz
1. 檔案zookeeper.properties，各節點一致
ticktime=2000
initlimit=10
synclimit=5
datadir=/board/opt/kafka_2.11-1.0.0/data
clientport=2182
server.1=135.36.247.91:2889:3889
server.2=135.36.247.92:2889:3889
server.3=135.36.247.93:2889:3889
2. 各節點分別建立server-id
echo 1 > /board/opt/kafka_2.11-1.0.0/data/myid
echo 2 > /board/opt/kafka_2.11-1.0.0/data/myid
echo 3 > /board/opt/kafka_2.11-1.0.0/data/myid
3.啟動zookeeper
# /board/opt/kafka_2.11-1.0.0/bin/zookeeper-server-start.sh -daemon /board/opt/kafka_2.11-1.0.0/config/zookeeper.properties
4.檢視zookeeper集群狀態
echo stat | nc 135.36.247.91 2182 | grep mode
mode: follower
echo stat | nc 135.36.247.92 2182 | grep mode
mode: follower
echo stat | nc 135.36.247.93 2182 | grep mode
mode: follower
1.各節點配置檔案server.properties
broker.id=0
listeners=plaintext:
advertised.listeners=plaintext:
log.dirs=/board/opt/kafka_2.11-1.0.0/data
zookeeper.connect=135.36.247.91:2182,135.36.247.92:2182,135.36.247.93:2182
broker.id=1
listeners=plaintext:
advertised.listeners=plaintext:
log.dirs=/board/opt/kafka_2.11-1.0.0/data
zookeeper.connect=135.36.247.91:2182,135.36.247.92:2182,135.36.247.93:2182
broker.id=2
listeners=plaintext:
advertised.listeners=plaintext:
log.dirs=/board/opt/kafka_2.11-1.0.0/data
zookeeper.connect=135.36.247.91:2182,135.36.247.92:2182,135.36.247.93:2182
2. 啟動kafka
# /board/opt/kafka_2.11-1.0.0/bin/kafka-server-start.sh -daemon /board/opt/kafka_2.11-1.0.0/config/server.properties
3. 檢視集群狀態
# echo dump | nc 135.36.247.91 2182 | grep broker
1. 建立topic
# ./kafka-topics.sh --zookeeper 135.36.247.91:2182,135.36.247.92:2182,135.36.247.93:2182 --create --partitions 3 --replication-factor 3 --topic test-topic
created topic "test-topic".
# ./kafka-topics.sh --zookeeper 135.36.247.91:2182,135.36.247.92:2182,135.36.247.93:2182 --describe --topic test-topic
topic:test-topic partitioncount:3 replicationfactor:3 configs:
topic: test-topic partition: 0 leader: 1 replicas: 1,2,0 isr: 1,2,0
topic: test-topic partition: 1 leader: 2 replicas: 2,0,1 isr: 2,0,1
topic: test-topic partition: 2 leader: 0 replicas: 0,1,2 isr: 0,1,2
2. 生產者生產資料
# ./kafka-console-producer.sh --broker-list 135.36.247.91:9092,135.36.247.92:9092,135.36.247.93:9092 --topic test-topic >hello >this is my fisrt kafka !
3. 消費者消費資料
# ./kafka-console-consumer.sh --bootstrap-server bootstrap-servers=135.36.247.91:9092,135.36.247.92:9092,135.36.247.93:9092 --topic test-topic --from-beginning hello this is my fisrt kafka !
Kafka單機多節點部署
基於kafka單機單節點部署，講config目錄下的server.properties檔案複製兩份，分別為 server 1.properties server 2.properties cp config server.properties config server 1.properties c...
Kafka單節點多Broker部署
安裝好zookeeper並啟動服務 broker的編號，必須是唯一的，相當於主鍵 broker.id 0 每個broker監聽的埠 listeners plaintext 9090 日誌目錄，預設目錄在tmp下面，重啟後就會被清空，所以要重新指定乙個目錄 log.dirs root kafka tm...
kafka單節點多broker部署及使用
kafka單節點多broker部署及使用 將配置檔案server.properties複製三份 cp server.properties server 1.properties 更新配置檔案 server 1.properties 中引數 broker.id 1 listeners plaintex...