Docker安装Kafka（内含zookeeper）

因为kafka是基于zookeeper做的，所以必须要有zookeeper

一、Zookeeper

1.拉取镜像

docker pull zookeeper:3.7.0

2.运行

docker run --restart=always \
  --log-driver json-file \
  --log-opt max-size=100m \
  --log-opt max-file=2  \
  --name zookeeper -p 2181:2181 \
  -v /etc/localtime:/etc/localtime:ro \
  -d zookeeper:3.7.0

3.检查是否运行成功

二、Kafka

1.拉取镜像

wurstmeister是一个官方的镜像仓库直接拉失败了，所以包了一层，要是还不行，去阿里弄个镜像加速器配上

docker pull wurstmeister/kafka:3.4.0

就是这里
https://cr.console.aliyun.com/cn-hangzhou/instances/mirrors

2. 创建挂载目录好日志

2.1创建挂载目录

mkdir -p /home/kafka/{data,config}

2.2创建日志

1. log4j.properties

vim /home/kafka/config/log4j.properties

写入并保存

# 设置根记录器级别为INFO，并指定两个追加器stdout和kafkaAppender
log4j.rootLogger=INFO, stdout, kafkaAppender

# 控制台输出配置
log4j.appender.stdout=org.apache.log4j.ConsoleAppender
log4j.appender.stdout.layout=org.apache.log4j.PatternLayout
log4j.appender.stdout.layout.ConversionPattern=[%d] %p %m (%c)%n

# 文件输出配置
log4j.appender.kafkaAppender=org.apache.log4j.DailyRollingFileAppender
log4j.appender.kafkaAppender.DatePattern=.yyyy-MM-dd
log4j.appender.kafkaAppender.File=/var/log/kafka/kafka.log  # 确保此路径存在且可写
log4j.appender.kafkaAppender.layout=org.apache.log4j.PatternLayout
log4j.appender.kafkaAppender.layout.ConversionPattern=[%d] %p %m (%c)%n

# 设置Kafka相关类别的日志级别
log4j.logger.kafka=INFO, kafkaAppender
log4j.additivity.kafka=false  # 是否继承父logger的appender

# Zookeeper客户端日志级别
log4j.logger.org.I0Itec.zkclient.ZkClient=INFO
log4j.logger.org.apache.zookeeper=INFO

# 请求通道日志级别
log4j.logger.kafka.network.RequestChannel$=WARN
log4j.logger.kafka.request.logger=WARN, kafkaAppender
log4j.additivity.kafka.request.logger=false

2. tools-log4j.properties

vim /home/kafka/config/tools-log4j.properties

写入保存

log4j.rootLogger=INFO, stdout

log4j.appender.stdout=org.apache.log4j.ConsoleAppender
log4j.appender.stdout.layout=org.apache.log4j.PatternLayout
log4j.appender.stdout.layout.ConversionPattern=[%d] %p %m (%c)%n

3.启动

注意：192.168.101.129这个地址需要替换成你自己的服务器IP

docker run \
  --log-driver json-file \
  --log-opt max-size=100m \
  --log-opt max-file=2 \
  --name kafka -p 9092:9092 \
  -e KAFKA_BROKER_ID=0 \
  -e KAFKA_ZOOKEEPER_CONNECT=192.168.101.129:2181/kafka \
  -e KAFKA_ADVERTISED_LISTENERS=PLAINTEXT://192.168.101.129:9092 \
  -e KAFKA_LISTENERS=PLAINTEXT://0.0.0.0:9092 \
  -e ALLOW_PLAINTEXT_LISTENER=yes \
  -e KAFKA_HEAP_OPTS='-Xms512M -Xmx4G' \
  -v /home/kafka/data:/var/lib/kafka/data \
  -v /home/kafka/config:/opt/kafka/config \
  -v /etc/localtime:/etc/localtime:ro \
  -d wurstmeister/kafka:latest

4.测一下

1.进去

docker exec -it kafka /bin/bash

2.创建测试主题

1. 进入kafka

docker exec -it kafka /bin/bash

2. 创建主题

kafka-topics.sh --create --topic test-topic --bootstrap-server 192.168.101.129:9092 --partitions 1 --replication-factor 1

3. 查看你刚才建立的主题

kafka-topics.sh --list --bootstrap-server 192.168.101.129:9092