metricbeat收集http指标

背景：在 metricbeat收集redis日志以及系统日志、python接收请求参数 基础上进行，部分简单内容省略

一、查看容器ip

docker inspect metricbeat | egrep IPAddress

二、编辑metricbeat.yml配置文件

1. 新增http模块的配置

#--------------------------------- HTTP Module --------------------------------- - module: http metricsets: - json # As client period: 100s hosts: ["192.168.1.110:8001"] namespace: "json_namespace" path: "/api" #body: "" #method: "GET" #username: "user" #password: "secret" #request.enabled: false #response.enabled: false #json.is_array: false #dedot.enabled: false processors: - add_fields: target: '' fields: from: http - module: http metricsets: ["server"] # As a server，only accept post requests host: "172.18.0.2" # If using metricbeat container, here is the container ip port: "8002" server.paths: - path: "/api" namespace: "server_namespace" fields: # added to the the response in root. overwrites existing fields env: "test" processors: - add_fields: target: '' fields: from: http

三、启动python接收请求参数中的脚本

E:\Python\Python38\python3.exe F:/IdeaProjects/my-jooq/my-python/receive_data.py * Serving Flask app "receive_data" (lazy loading) * Environment: production WARNING: This is a development server. Do not use it in a production deployment. Use a production WSGI server instead. * Debug mode: on * Restarting with stat * Debugger is active! * Debugger PIN: 936-026-506 * Running on http://0.0.0.0:8001/ (Press CTRL+C to quit)

四、添加容器对外暴露端口

services: metricbeat: image: elastic/metricbeat:7.7.0 user: root container_name: metricbeat command: ["--strict.perms=false"] volumes: - ${PWD}/config/metricbeat.yml:/usr/share/metricbeat/metricbeat.yml - /var/run/docker.sock:/var/run/docker.sock:ro - /sys/fs/cgroup:/hostfs/sys/fs/cgroup:ro - /proc:/hostfs/proc:ro - /:/hostfs:ro - /etc/timezone:/etc/timezone:ro - /etc/localtime:/etc/localtime:ro ports: - "8002:8002" networks: - shared

 五、重新加载容器

docker-compose up -d

六、查看作为客户端的结果

1. 查看作为http客户端发送的请求结果

2. 查看收集到的指标监控日志 

七、查看作为服务端的结果 

1. 发送请求

curl --header "Content-Type:application/json" -X POST --data '{"logLevel":"ERROR", "msg":"hello world"}' http://localhost:8002/api

1.1 下图为通过容器启动metricbeat的操作结果 

1.2 下图为直接在主机启动metricbeat的操作结果 

注： 从以上操作结果可以看出，如果配置的host是ip地址，那么不能使用localhost替代，同理配置的是localhost，也不能使用ip地址替换

2. 查看收集到的指标监控日志

2.1 下图为通过容器启动metricbeat的操作结果 

2.2 下图为直接在主机启动metricbeat的操作结果 

到此http指标收集成功