Skip to content

Latest commit

 

History

History
65 lines (43 loc) · 2.11 KB

README.md

File metadata and controls

65 lines (43 loc) · 2.11 KB

ansible-kubernetes misc

Elasticsearch

This helm chart comes from github.com/bitnami/charts.

Elasticsearch install:

cd helm/elasticsearch/
helm install gros-elastic .

It will install this elasticsearch architecture :

graph TD;
    cp([Computer])-- port-forward :5601 -->Kibana
    podX-- :9200 -->cn[2 coordinating nodes];
    Kibana-- :9200 -->cn;
    cn-->mn[3 master nodes];
    mn[3 master nodes]-->dn[2 data nodes];
    mn[3 master nodes]-->mpvc[(1 PVC each)]
    dn-->dpvc[(1 PVC each)]
Loading

After installation, to access kibana:

kubectl port-forward --namespace default svc/gros-elastic-kibana 5601:5601

Then open your web browser tp http://localhost:5601/app/home. Or open persistent access with an Ingress or NodePort.

Kafka

The helm chart used comes from github.com/bitnami/charts.

Installation:

kubectl apply -f https://raw.githubusercontent.com/rancher/local-path-provisioner/master/deploy/local-path-storage.yaml
helm repo update
cd helm/kafka
helm install -f values.yaml kafkop bitnami/kafka

Port-forward allowing your local program to access the cluster:

kubectl port-forward pods/kafkop-kafka-0 9093:9093

Kafka administration:

# create an administration pod
kubectl run kafkop-kafka-client --restart='Never' --image docker.io/bitnami/kafka:3.3.1-debian-11-r22 --namespace default --command -- sleep infinity
# enter into it, kafka scripts are available
kubectl exec --tty -i kafkop-kafka-client --namespace default -- bash
# create the topic used by the app
kafka-topics.sh --bootstrap-server kafkop-kafka-0.kafkop-kafka-headless.default.svc.cluster.local:9092 --topic message-log --create --partitions 3 --replication-factor 1

More kafka cli tutorial here: Conduktor kafkademy.

Then you can run this simple program:

cd app/
go run main.go

Upscale kafka brokers:

kubectl scale --replicas=3 sts/kafkop-kafka