Analysis of centos6 Using docker to Deploy kafka Project

  • 2021-07-24 11:56:26
  • OfStack

This article illustrates how centos6 deploys an kafka project using docker. Share it for your reference, as follows:

Directory structure:

/kafka
/Dockerfile
/start.sh
/Readme
/kafka_2.11-0.10.2.1.tgz

Dockfile


FROM centos
MAINTAINER qiongtao.li hnatao@126.com
ADD ./kafka_2.11-0.10.2.1.tgz /opt
ADD ./start.sh /start.sh
ENV KAFKA_PORT=9092\
 KAFKA_DIR=/opt/kafka \
 KAFKA_DATA_DIR=/data/kafka
RUN echo "Asia/shanghai" > /etc/timezone \
 && cp /usr/share/zoneinfo/Asia/Shanghai /etc/localtime \
 && yum -y install java \
 && mkdir -p $KAFKA_DATA_DIR \
 && mv /opt/kafka_2.11-0.10.2.1 $KAFKA_DIR
EXPOSE $KAFKA_PORT
ENV PATH=$PATH:$KAFKA_DIR/bin
ENTRYPOINT ["sh", "/start.sh"]

start.sh


conf=$KAFKA_DIR/config/server.properties
sed -i "s|broker.id=0|broker.id=${BROKER_ID:-1}|g" $conf
sed -i "s|#delete.topic.enble=true|delete.topic.enble=true|g" $conf
sed -i "s|log.dirs=/tmp/kafka-logs|log.dirs=${KAFKA_DATA_DIR}|g" $conf
sed -i "s|#advertised.listeners=PLAINTEXT://your.host.name:9092|advertised.listeners=PLAINTEXT://${KAFKA_HOST}:${KAFKA_PORT:-9092}|g" $conf
sed -i "s|zookeeper.connect=localhost:2181|zookeeper.connect=${ZOOKEEPER_HOST}:${ZOOKEEPER_PORT:-2181}|g" $conf
sh kafka-server-start.sh $conf

Readme


docker rm -f kafka
docker rmi -f kafka
docker build -t kafka .
docker run -d \
 -p 9092:9092 \
 --name kafka \
 -e KAFKA_HOST=101.201.111.163 \
 -e ZOOKEEPER_HOST=10.171.8.236 \
 -e BROKER_ID=1 \
  -v /data:/data \
 kafka
docker ps -a
docker logs -f kafka

Description: KAFKA_HOST = host IP, which corresponds to advertised. listeners of the configuration file

Test installation deployment


cat Readme|while read line; do $line; done

kafka download address:

http://mirrors.tuna.tsinghua.edu.cn/apache/kafka/0.10.2.1/kafka_2.11-0.10.2.1.tgz

I hope this article is helpful for everyone to use Docker container.


Related articles: