蜷缩的蜗牛
蜷缩的蜗牛

Loki快速使用

kbsonlong 收录于 监控体系
 约 1100 字 预计阅读 3 分钟 - 次阅读  

轻量日志采集Loki快速入门

安装 Loki

添加 Helm 仓库 

1
2

helm repo add grafana https://grafana.github.io/helm-charts
helm repo update

loki-values.yaml 

 1
 2
 3
 4
 5
 6
 7
 8
 9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78

global:
  # -- configures cluster domain ("cluster.local" by default)
  clusterDomain: "alongparty.cn"
  dnsService: "kube-dns-coredns"

loki:
  tenants:
    - name: mongo
      password: mongo
    - name: mysql
      password: mysql
  storage:
    bucketNames:
      chunks: loki
      ruler: loki
    type: s3
    s3:
      region: ap-southeast-1
      secretAccessKey: AKIA2C3alongparty.cn
      accessKeyId: jmg9yxa5sR+UVTJKd+6LVTLES75alongparty.cn
  server:
    grpc_server_max_recv_msg_size: 8388608
  limits_config:
    ingestion_rate_mb: 8
    ingestion_burst_size_mb: 16

test:
  enabled: false

monitoring:
  lokiCanary:
    enabled: false
  dashboards:
    enabled: false
  rules:
    enabled: false
  serviceMonitor:
    enabled: false
  selfMonitoring:
    enabled: false

write:
  autoscaling:
    enabled: false
  persistence:
    storageClass: local-path
    enableStatefulSetAutoDeletePVC: false

read:
  autoscaling:
    enabled: false
  persistence:
    storageClass: local-path
    enableStatefulSetAutoDeletePVC: false

backend:
  autoscaling:
    enabled: false
  persistence:
    storageClass: local-path
    enableStatefulSetAutoDeletePVC: false

gateway:
  base_auth:
  enabled: true
  # username: mongo
  # password: mongo

minio:
  enabled: false
  clusterDomain: alongparty.cn
  image:
    repository: registry.cn-hangzhou.aliyuncs.com/seam/minio
  mcImage:
    repository: registry.cn-hangzhou.aliyuncs.com/seam/minio-mc
  persistence:
    size: 50Gi
    stroageClass: local-path

查看版本 

1
2
3
4
5
6

# helm search repo grafana/loki -l | head -5
NAME                        	CHART VERSION	APP VERSION	DESCRIPTION
grafana/loki                	5.6.4        	2.8.2      	Helm chart for Grafana Loki in simple, scalable...
grafana/loki                	5.6.3        	2.8.2      	Helm chart for Grafana Loki in simple, scalable...
grafana/loki                	5.6.2        	2.8.2      	Helm chart for Grafana Loki in simple, scalable...
grafana/loki                	5.6.1        	2.8.2      	Helm chart for Grafana Loki in simple, scalable...

部署 loki 

1

helm install loki grafana/loki -n loki --version 5.6.4 --create-namespace -f loki-values.yaml

更新 

1

helm upgrade --install loki grafana/loki -n loki --version 5.6.4 --create-namespace -f loki-values.yaml

安装 Promtail 日志收集器

promtail-values.yaml 

  1
  2
  3
  4
  5
  6
  7
  8
  9
 10
 11
 12
 13
 14
 15
 16
 17
 18
 19
 20
 21
 22
 23
 24
 25
 26
 27
 28
 29
 30
 31
 32
 33
 34
 35
 36
 37
 38
 39
 40
 41
 42
 43
 44
 45
 46
 47
 48
 49
 50
 51
 52
 53
 54
 55
 56
 57
 58
 59
 60
 61
 62
 63
 64
 65
 66
 67
 68
 69
 70
 71
 72
 73
 74
 75
 76
 77
 78
 79
 80
 81
 82
 83
 84
 85
 86
 87
 88
 89
 90
 91
 92
 93
 94
 95
 96
 97
 98
 99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119

config:
  clients:
  - basic_auth:
      password: mongo
      username: mongo
    url: http://loki-gateway/loki/api/v1/push
  snippets:
    extraScrapeConfigs: |
      # 通过 kubernetes_sd_configs:pod 配置 pod 日志，参考 https://grafana.com/docs/loki/latest/clients/promtail/configuration/#kubernetes_sd_config
      - job_name: kubernetes-pods-app
        pipeline_stages:
          {{- toYaml .Values.config.snippets.podPipelineStages | nindent 4 }}
        kubernetes_sd_configs:
          - role: pod
        relabel_configs:
          # 存在 app.kubernetes.io/name: "percona-server-mongodb" 标签的容器日志采集
          # app.kubernetes.io/name: "percona-server-mongodb"
          - action: keep
            regex: percona-server-mongodb
            source_labels: [__meta_kubernetes_pod_label_app_kubernetes_io_name]
          # 把 pod 所有的标签暴露出来
          - action: labelmap
            regex: __meta_kubernetes_pod_label_(.+)
            replacement: $1
            target_label: $1
          - action: replace
            source_labels:
              - __meta_kubernetes_pod_ip
            target_label: pod_ip
          - action: replace
            source_labels:
              - __meta_kubernetes_pod_label_app
            target_label: app
          - action: replace
            source_labels:
              - __meta_kubernetes_pod_label_app_kubernetes_io_component
            target_label: component
          - action: replace
            source_labels:
              - __meta_kubernetes_pod_label_app_kubernetes_io_replset
            target_label: replset
          - action: replace
            source_labels:
              - __meta_kubernetes_pod_label_app_kubernetes_io_instance
            target_label: app
          - action: replace
            source_labels:
              - __meta_kubernetes_pod_label_topology_kubernetes_io_zone
            target_label: zone
          - action: replace
            source_labels:
              - __meta_kubernetes_pod_node_name
            target_label: node_name
          # 删除标签
          - action: labeldrop
            regex: (app|version|topology|statefulset|controller)_(.+)
          {{- if .Values.config.snippets.addScrapeJobLabel }}
          - action: replace
            replacement: kubernetes-pods-app
            target_label: scrape_job
          {{- end }}
          {{- toYaml .Values.config.snippets.common | nindent 4 }}
    podPipelineStages:
    # Container 是 mongos或者mongod的日志,且包含 `Slow query` 的日志采集
    - match:
        selector: '{container=~"mongos|mongod"} |= "Slow query"'
        action: keep
        stages:
          - docker: {}
    # Container 是 mongos或者mongod的日志,但不包含 `Slow query` 的日志丢弃
    - match:
        selector: '{container=~"mongos|mongod"} != "Slow query"'
        action: drop
        drop_counter_reason: promtail_not_slow_query
    # Container 不是 mongos或者mongod的日志丢弃
    - match:
        selector: '{container!~"mongos|mongod"}'
        action: drop
        drop_counter_reason: promtail_not_other_pod
    - drop:
        older_than: 24h
        drop_counter_reason: "line_too_old"
    scrapeConfigs: ""
defaultVolumeMounts:
- mountPath: /run/promtail
  name: run
- mountPath: /data/k8s/k8s_docker/data/containers
  name: containers
  readOnly: true
- mountPath: /var/log/pods
  name: pods
  readOnly: true
defaultVolumes:
- hostPath:
    path: /run/promtail
  name: run
- hostPath:
    path: /data/k8s/k8s_docker/data/containers
  name: containers
- hostPath:
    path: /var/log/pods
  name: pods
extraArgs:
- -client.external-labels=cluster=dev
extraVolumeMounts:
- mountPath: /etc/localtime
  name: host-time
extraVolumes:
- hostPath:
    path: /etc/localtime
  name: host-time
readinessProbe:
  httpGet:
    path: '{{ printf `%s/metrics` .Values.httpPathPrefix }}'
    port: http-metrics
resources:
  limits:
    cpu: 512m
    memory: 512Mi

部署 promtail 

1
2
3
4
5
6

# helm search repo grafana/promtail -l | head -5
NAME            	CHART VERSION	APP VERSION	DESCRIPTION
grafana/promtail	6.11.3       	2.8.2      	Promtail is an agent which ships the contents o...
grafana/promtail	6.11.2       	2.8.2      	Promtail is an agent which ships the contents o...
grafana/promtail	6.11.1       	2.7.4      	Promtail is an agent which ships the contents o...
grafana/promtail	6.11.0       	2.7.4      	Promtail is an agent which ships the contents o...
1

helm install promtail grafana/promtail -n loki --version 6.11.3 -f promtail-values.yaml

安装 Grafana

grafana-values.yaml 

1
2

service:
  type: NodePort

部署 grafana 

1
2
3
4
5
6
7
8

# helm search repo grafana/grafana -l | head -5
NAME                          	CHART VERSION	APP VERSION	DESCRIPTION
grafana/grafana               	6.57.1       	9.5.3      	The leading tool for querying and visualizing t...
grafana/grafana               	6.57.0       	9.5.2      	The leading tool for querying and visualizing t...
grafana/grafana               	6.56.6       	9.5.2      	The leading tool for querying and visualizing t...
grafana/grafana               	6.56.5       	9.5.2      	The leading tool for querying and visualizing t...

# helm install grafana grafana/grafana -n loki -f grafana-values.yaml
  • Grafana 添加 loki 数据源

https://raw.githubusercontent.com/kbsonlong/notes_statics/main/images20230610215237.png

  • 查看日志

https://raw.githubusercontent.com/kbsonlong/notes_statics/main/images20230610215415.png

更新于 2023-06-15 
CC BY-NC 4.0
阅读原始文档
LINE Myspace
LokiGrafana
返回 | 主页
0%