docker 로 kafka 설치, 실행

docker pull wurstmeister/kafka

docker pull wurstmeister/zookeeper

docker-compose.yml 생성

version: '2' services: zookeeper: image: wurstmeister/zookeeper ports: - "2181:2181" kafka: build: . ports: - "9092:9092" environment: KAFKA_ADVERTISED_HOST_NAME: 127.0.0.1 KAFKA_CREATE_TOPICS: "test:1:1" KAFKA_ZOOKEEPER_CONNECT: zookeeper:2181 volumes: - /var/run/docker.sock:/var/run/docker.sock

docker-compose.yml 파일이 있는 위치에서

docker-compose -f docker-compose.yml up -d

producer

max_request_size = 1048576

consumer

fetch_max_bytes = 52428800 max_partition_fetch_bytes: 1 * 1024 * 1024