在Grafana的日志中显示将日志信息导入到Elasticsearch中

首先

如果要将在Elasticsearch中导入的数据可视化,我认为通常会使用Elastic提供的Kibana创建图表,但在可视化性能信息的情况下,更多人喜欢使用Grafana。
另一方面,如果直接查看日志,我认为Kibana的Discover功能是最方便和容易使用的。
如果希望统一UI并在Grafana中查看日志信息,可以尝试使用名为”Logs”的Visualize功能。

环境

Linux(RHEL7.5)
Elasticsearch 7.6.2
Kibana 7.6.2
Fluentd(td-agent)1.0
Grafana 7.1.0

Linux(RHEL7.5)

搭建Grafana环境

由于在另一篇文章中已经提到了Elasticsearch、Kibana和fluentd,所以在这里将仅描述Grafana。

参考文献:
尝试使用fluentd/Elasticsearch/kibana:(1)安装
fluentd笔记-(1)安装/简易操作

安装Grafana

按照以下描述进行安装:
参考:使用RPM安装

[root@test08 /Inst_Image/grafana]# wget https://dl.grafana.com/oss/release/grafana-7.1.0-1.x86_64.rpm
--2020-07-22 09:02:13--  https://dl.grafana.com/oss/release/grafana-7.1.0-1.x86_64.rpm
dl.grafana.com (dl.grafana.com) をDNSに問いあわせています... 151.101.198.217, 2a04:4e42:d::729
dl.grafana.com (dl.grafana.com)|151.101.198.217|:443 に接続しています... 接続しました。
HTTP による接続要求を送信しました、応答を待っています... 200 OK
長さ: 52219308 (50M) [application/x-redhat-package-manager]
`grafana-7.1.0-1.x86_64.rpm' に保存中

100%[================================================================================>] 52,219,308  1001KB/s 時間 48s

2020-07-22 09:03:01 (1.04 MB/s) - `grafana-7.1.0-1.x86_64.rpm' へ保存完了 [52219308/52219308]


[root@test08 /Inst_Image/grafana]# yum install grafana-7.1.0-1.x86_64.rpm
読み込んだプラグイン:langpacks, product-id, search-disabled-repos, subscription-manager
This system is not registered with an entitlement server. You can use subscription-manager to register.
grafana-7.1.0-1.x86_64.rpm を調べています: grafana-7.1.0-1.x86_64
grafana-7.1.0-1.x86_64.rpm をインストール済みとして設定しています
依存性の解決をしています
--> トランザクションの確認を実行しています。
---> パッケージ grafana.x86_64 0:7.1.0-1 を インストール
--> 依存性解決を終了しました。
bintray--sbt-rpm                                                                                   | 1.3 kB  00:00:00
epel/x86_64/metalink                                                                               | 9.0 kB  00:00:00
epel/x86_64                                                                                        | 4.7 kB  00:00:00
epel/x86_64/updateinfo                                                                             | 1.0 MB  00:00:00
epel/x86_64/primary_db                                                                             | 6.9 MB  00:00:01
file:///run/media/root/RHEL-7.5%20Server.x86_64/repodata/repomd.xml: [Errno 14] curl#37 - "Couldn't open file /run/media/root/RHEL-7.5%20Server.x86_64/repodata/repomd.xml"
他のミラーを試します。
treasuredata/7Server/x86_64                                                                        | 2.9 kB  00:00:00

依存性を解決しました

==========================================================================================================================
 Package                  アーキテクチャー        バージョン               リポジトリー                              容量
==========================================================================================================================
インストール中:
 grafana                  x86_64                  7.1.0-1                  /grafana-7.1.0-1.x86_64                  162 M

トランザクションの要約
==========================================================================================================================
インストール  1 パッケージ

合計容量: 162 M
インストール容量: 162 M
Is this ok [y/d/N]: y
Downloading packages:
Running transaction check
Running transaction test
Transaction test succeeded
Running transaction
  インストール中          : grafana-7.1.0-1.x86_64                                                                    1/1
### NOT starting on installation, please execute the following statements to configure grafana to start automatically using systemd
 sudo /bin/systemctl daemon-reload
 sudo /bin/systemctl enable grafana-server.service
### You can start grafana-server by executing
 sudo /bin/systemctl start grafana-server.service
POSTTRANS: Running script
  検証中                  : grafana-7.1.0-1.x86_64                                                                    1/1

インストール:
  grafana.x86_64 0:7.1.0-1

完了しました!

构成

参考:配置

配置信息被保存在/etc/grafana/grafana.ini文件中。

デフォルトのgrafana.iniファイル/etc/grafana/grafana.ini
##################### Grafana Configuration Example #####################
#
# Everything has defaults so you only need to uncomment things you want to
# change

# possible values : production, development
;app_mode = production

# instance name, defaults to HOSTNAME environment variable value or hostname if HOSTNAME var is empty
;instance_name = ${HOSTNAME}

#################################### Paths ####################################
[paths]
# Path to where grafana can store temp files, sessions, and the sqlite3 db (if that is used)
;data = /var/lib/grafana

# Temporary files in `data` directory older than given duration will be removed
;temp_data_lifetime = 24h

# Directory where grafana can store logs
;logs = /var/log/grafana

# Directory where grafana will automatically scan and look for plugins
;plugins = /var/lib/grafana/plugins

# folder that contains provisioning config files that grafana will apply on startup and while running.
;provisioning = conf/provisioning

#################################### Server ####################################
[server]
# Protocol (http, https, h2, socket)
;protocol = http

# The ip address to bind to, empty will bind to all interfaces
;http_addr =

# The http port to use
;http_port = 3000

# The public facing domain name used to access grafana from a browser
;domain = localhost

# Redirect to correct domain if host header does not match domain
# Prevents DNS rebinding attacks
;enforce_domain = false

# The full public facing url you use in browser, used for redirects and emails
# If you use reverse proxy and sub path specify full url (with sub path)
;root_url = %(protocol)s://%(domain)s:%(http_port)s/

# Serve Grafana from subpath specified in `root_url` setting. By default it is set to `false` for compatibility reasons.
;serve_from_sub_path = false

# Log web requests
;router_logging = false

# the path relative working path
;static_root_path = public

# enable gzip
;enable_gzip = false

# https certs & key file
;cert_file =
;cert_key =

# Unix socket path
;socket =

#################################### Database ####################################
[database]
# You can configure the database connection by specifying type, host, name, user and password
# as separate properties or as on string using the url properties.

# Either “mysql”, “postgres” or “sqlite3”, it’s your choice
;type = sqlite3
;host = 127.0.0.1:3306
;name = grafana
;user = root
# If the password contains # or ; you have to wrap it with triple quotes. Ex “””#password;”””
;password =

# Use either URL or the previous fields to configure the database
# Example: mysql://user:secret@host:port/database
;url =

# For “postgres” only, either “disable”, “require” or “verify-full”
;ssl_mode = disable

;ca_cert_path =
;client_key_path =
;client_cert_path =
;server_cert_name =

# For “sqlite3” only, path relative to data_path setting
;path = grafana.db

# Max idle conn setting default is 2
;max_idle_conn = 2

# Max conn setting default is 0 (mean not set)
;max_open_conn =

# Connection Max Lifetime default is 14400 (means 14400 seconds or 4 hours)
;conn_max_lifetime = 14400

# Set to true to log the sql calls and execution times.
;log_queries =

# For “sqlite3” only. cache mode setting used for connecting to the database. (private, shared)
;cache_mode = private

#################################### Cache server #############################
[remote_cache]
# Either “redis”, “memcached” or “database” default is “database”
;type = database

# cache connectionstring options
# database: will use Grafana primary database.
# redis: config like redis server e.g. `addr=127.0.0.1:6379,pool_size=100,db=0,ssl=false`. Only addr is required. ssl may be ‘true’, ‘false’, or ‘insecure’.
# memcache: 127.0.0.1:11211
;connstr =

#################################### Data proxy ###########################
[dataproxy]

# This enables data proxy logging, default is false
;logging = false

# How long the data proxy waits before timing out, default is 30 seconds.
# This setting also applies to core backend HTTP data sources where query requests use an HTTP client with timeout set.
;timeout = 30

# If enabled and user is not anonymous, data proxy will add X-Grafana-User header with username into the request, default is false.
;send_user_header = false

#################################### Analytics ####################################
[analytics]
# Server reporting, sends usage counters to stats.grafana.org every 24 hours.
# No ip addresses are being tracked, only simple counters to track
# running instances, dashboard and error counts. It is very helpful to us.
# Change this option to false to disable reporting.
;reporting_enabled = true

# Set to false to disable all checks to https://grafana.net
# for new versions (grafana itself and plugins), check is used
# in some UI views to notify that grafana or plugin update exists
# This option does not cause any auto updates, nor send any information
# only a GET request to http://grafana.com to get latest versions
;check_for_updates = true

# Google Analytics universal tracking code, only enabled if you specify an id here
;google_analytics_ua_id =

# Google Tag Manager ID, only enabled if you specify an id here
;google_tag_manager_id =

#################################### Security ####################################
[security]
# disable creation of admin user on first start of grafana
;disable_initial_admin_creation = false

# default admin user, created on startup
;admin_user = admin

# default admin password, can be changed before first start of grafana, or in profile settings
;admin_password = admin

# used for signing
;secret_key = SW2YcwTIb9zpOOhoPsMm

# disable gravatar profile images
;disable_gravatar = false

# data source proxy whitelist (ip_or_domain:port separated by spaces)
;data_source_proxy_whitelist =

# disable protection against brute force login attempts
;disable_brute_force_login_protection = false

# set to true if you host Grafana behind HTTPS. default is false.
;cookie_secure = false

# set cookie SameSite attribute. defaults to `lax`. can be set to “lax”, “strict”, “none” and “disabled”
;cookie_samesite = lax

# set to true if you want to allow browsers to render Grafana in a ,

广告
将在 10 秒后关闭
bannerAds