Microservice Kafka

Introducing Microservice Kafka !!

Microservice Kafka is space to learn with Kafka.

Contents

Table of Contents

NoTitleRemarks
0환경설정Kafka환경셋팅
1커리큘럼커리큘럼
2설계실습

Learning

Table of Learning

No구분TitleDayRemarks
1온라인아파치 카프카 입문2020.08.30 ~ 2020.08.30Kafka

Get Started(Kafka)

1. Kafka AWS 환경 구성하기

2. AWS Git 설치

sudo yum update -y
sudo yum install git -y
git version

3. telegraf download

Data & Source

Table of Data & Source

NoTitleEducational InstitutionSourceRemarks
1syntax.sol차세대융합콘텐츠산업협회syntax.solsolidity 문법

Syllabus

1. Windows에서 실행

kafka-topics.bat --create --bootstrap-server 13.125.234.182:9092 --replication-factor 1 --partitions 3 --topic test
kafka-console-producer.bat --bootstrap-server 13.125.234.182:9092 --topic test #동작안함. 아래 처럼 함
kafka-console-producer.bat --broker-list 13.125.234.182:9092 --topic test

kafka-console-consumer.bat --bootstrap-server 13.125.234.182:9092 --topic test --from-beginning
kafka-console-consumer.bat --bootstrap-server 13.125.234.182:9092 --topic test -group testgroup --from-beginning
kafka-consumer-groups.bat --bootstrap-server 13.125.234.182:9092 --list
kafka-consumer-groups.bat --bootstrap-server 13.125.234.182:9092 --group testgroup --describe
kafka-consumer-groups.bat --bootstrap-server 13.125.234.182:9092 --group testgroup --topic test --reset-offsets --to-earliest --execute
kafka-consumer-groups.bat --bootstrap-server 13.125.234.182:9092 --group testgroup --topic test:1 --reset-offsets --to-offset 2 --execute
kafka-console-consumer.bat --bootstrap-server 13.125.234.182:9092 --topic test --property print.key=true --property key.separator="-"

2. telegraf 연결

./kafka-topics.sh --create --bootstrap-server 13.125.234.182:9092 --replication-factor 1 --partitions 3 --topic test
./kafka-console-producer.sh --bootstrap-server 13.125.234.182:9092 --topic test
./kafka-console-consumer.sh --bootstrap-server 13.125.234.182:9092 --topic test --from-beginning
./kafka-console-consumer.sh --bootstrap-server 13.125.234.182:9092 --topic test -group testgroup --from-beginning
./kafka-consumer-groups.sh --bootstrap-server 13.125.234.182:9092 --list
./kafka-consumer-groups.sh --bootstrap-server 13.125.234.182:9092 --group testgroup --describe
./kafka-consumer-groups.sh --bootstrap-server 13.125.234.182:9092 --group testgroup --topic test --reset-offsets --to-earliest --execute
./kafka-consumer-groups.sh --bootstrap-server 13.125.234.182:9092 --group testgroup --topic test:1 --reset-offsets --to-offset 10 --execute

kafka-topics.sh --create --bootstrap-server 13.125.234.182:9092 --replication-factor 1 --partitions 5 --topic my-computer-metric

telegraf.conf

[agent]
  interval = "10s"

[[outputs.kafka]]
  brokers = ["13.125.234.182:9092"]
  ## Kafka topic for producer messages
  topic = "my-computer-metric"

[[inputs.cpu]]
  percpu = true
  totalcpu = true
  fielddrop = ["time_*"]

[[inputs.mem]]

Reference

  • gradle 3.0 이 나오면서 compile 은 deprecated 되었고, implementation 또는 api 를 써야 한다.
Go to Contents