plg（Loki+Promtail+Grafana）监控nginx日志、messages日志监控平台

news2025/8/6 13:00:00

登录官网：loki官网Like Prometheus, but for logs. Contribute to grafana/loki development by creating an account on GitHub.https://github.com/grafana/loki/releases/

loki安装

----root用户操作
###创建用户
useradd loki
passwd loki

###创建安装目录
mkdir /opt/loki


###授权
chown -R loki:loki /opt/loki
chmod -R 755 /opt/loki

----loki用户操作
###下载二进制包
$ curl -O -L "https://github.com/grafana/loki/releases/download/v2.7.4/loki-linux-amd64.zip"

###解压二进制包
$ unzip "loki-linux-amd64.zip"

### make sure it is executable
$ chmod a+x "loki-linux-amd64"

###编写配置文件
$ vim loki-local-config.yml

更多配置请参考：https://grafana.com/docs/loki/latest/configuration/

auth_enabled: false

server:
  http_listen_port: 3100
  grpc_listen_port: 9096

ingester:
  lifecycler:
    address: 127.0.0.1
    ring:
      kvstore:
        store: inmemory
      replication_factor: 1
    final_sleep: 0s
  chunk_idle_period: 10m
  chunk_retain_period: 30s
schema_config:
  configs:
  - from: 2020-05-15
    store: boltdb
    object_store: filesystem
    schema: v11
    index:
      prefix: index_
      period: 168h
storage_config:
  boltdb:
    directory: /opt/loki/index
  filesystem:
    directory: /opt/loki/chunks  # 块存储路径

limits_config:
  enforce_metric_name: false
  reject_old_samples: true          # 是否拒绝老样本
  reject_old_samples_max_age: 168h  # 168小时之前的样本将会被删除
  ingestion_rate_mb: 200
  ingestion_burst_size_mb: 300
  per_stream_rate_limit: 1000MB
  max_entries_limit_per_query: 10000
chunk_store_config:
  max_look_back_period: 168h        # 为避免查询超过保留期的数据，必须小于或等于下方的时间值
table_manager:
  retention_deletes_enabled: true   # 保留删除开启
  retention_period: 168h            # 超过168h的块数据将被删除

ruler:
  storage:
    type: local
    local:
      directory: /opt/loki/rules
  rule_path: /opt/loki/rules-temp
  alertmanager_url: http://192.168.0.1:9093    # alertmanager地址
  ring:
    kvstore:
      store: inmemory
  enable_api: true
  enable_alertmanager_v2: true

启动脚本

$ vim restart-loki.sh

#!/bin/bash
echo "stop loki"
ps -ef | grep loki-linux-amd64 | grep -v grep | awk '{print $2}'| xargs kill -9 

echo "Begin start loki"
sleep 1
str=$"\n"
nohup ./loki-linux-amd64 --config.file=loki-local-config.yml &
sstr=$(echo -e $str)
echo $sstr

增加执行权限

chmod +x restart-loki.sh

在需要采集日志的主机上都安装Promtail

mkdir /opt/promtail
chown -R loki:loki /opt/promtail
chmod -R loki:loki /opt/promtail


###下载
curl -O -L "https://github.com/grafana/loki/releases/download/v2.7.4/promtail-linux-amd64.zip"


###解压
unzip loki-linux-amd64.zip # 解压


###
mv promtail-linux-amd64 /usr/local/sbin/promtail # 挪到 $PATH下

编写配置文件，vim promtail-local-config.yml

server:
  http_listen_port: 9080
  grpc_listen_port: 0

positions:
  filename: /opt/promtail/positions.yaml

clients:
  - url: http://10.1.5.125:3100/loki/api/v1/push # 填写好Loki地址

scrape_configs:
- job_name: messagelog
  static_configs:
  - targets:
      - localhost
    labels:
      #job: messagelog
      host: namenode01
      __path__: /var/log/messages

- job_name: agentlog
  static_configs:
  - targets:
      - localhost
    labels:
      #job: agentlog
      host: namenode01
      __path__: /ssd/ssd0/agentlog/agent.log

- job_name: datanodelog
  static_configs:
  - targets:
      - localhost
    labels:
#      #job: datanodelog
      host: namenode01
      __path__: /ssd/ssd0/datanodelog/*datanode*.log

Download Grafana | Grafana LabsOverview of how to download and install different versions of Grafana on different operating systems.https://grafana.com/grafana/download

###CentOS系统通过rpm方式安装

wget https://dl.grafana.com/enterprise/release/grafana-enterprise-9.4.3-1.x86_64.rpm

sudo yum install grafana-enterprise-9.4.3-1.x86_64.rpm -y


[root@localhost grafana]# rpm -qa|grep grafana
grafana-enterprise-9.4.3-1.x86_64
[root@localhost grafana]# 


###启动grafana，grafana会占用服务器3000端口
systemctl start grafana-server.service

systemctl status grafana-server.service

导入nginx dashboard

Grafana Loki Dashboard for NGINX Service Mesh | Grafana LabsLoki v2+ showcase using JSON NGINX access logs.https://grafana.com/grafana/dashboards/12559-grafana-loki-dashboard-for-nginx-service-mesh/