注意:
需要将集群每个主机节点的IP和主机名对应关系写入hosts。
启动zk
创建zkdata文件和日志文件
mkdir -p /home/tomcat/kafka/zk_data /home/tomcat/zk_logs
创建myid
echo 1 >/home/tomcat/kafka/zk_data/myid
修改配置/home/tomcat/kafka/config/zookeeper.properties
dataDir=/home/tomcat/kafka/zk_data dataLogDir=/home/tomcat/zk_logs clientPort=2181 maxClientCnxns=100 tickTime=2000 initLimit=10 syncLimit=5 server.1=10.10.X.X:2888:3888 server.2=10.10.X.X:2888:3888 server.3=10.10.X.X:2888:3888
启动zk
/home/tomcat/kafka/bin/zookeeper-server-start.sh /home/tomcat/kafka/config/zookeeper.properties &
检查是否启动成功
echo envi |nc 127.0.0.1 2181
查看节点数以及leader
echo stat |nc 127.0.0.1 2181
kafka配置
配置server.properties,修改以下配置项:
broker.id=1 #[每个节点不要一样]
advertised.listeners=PLAINTEXT://10.10.X.X:9092 #[配置本地IP]
log.dirs=/home/tomcat/logs #[尽量独占此目录]
num.partitions=60 #[此值不要太小]
log.retention.hours=168 #[默认7天log删除,标记delete删除]
log.segment.delete.delay.ms=60000 #[真实删除]
zookeeper.connect=x.x.x.x:2181,x.x.x.x:2181,x.x.x.x:2181 #[配置自身zk]
group.initial.rebalance.delay.ms=0 #[空消费组延时rebalance]
delete.topic.enable=true #[禁止删除topic]
auto.create.topics.enable=false #[禁止自动创建topic]
启动kafka
cd /home/tomcat/kafka && bin/kafka-server-start.sh config/server.properties &
No Leanote account ? Sign up now.