Rsyslog는 포트의 Logstash 서버에 로그를 보내지 않습니다.

두 개의 rsyslog-client와 rsyslog-server가 있습니다. "logger -p local1.notice SOMETHING"을 시도하면 한 클라이언트의 서버에 대한 정보가 표시되지 않지만 다른 클라이언트의 logstash 출력은 표시됩니다.

rsyslog.conf를 복사했는데 두 서버 모두에서 동일합니다. 뭐가 문제 야?

문제 서버에서 telnet xxxx 10514를 통해 연결을 테스트하면 telnet 연결이 양호하고 tcpdump 로그가 표시됩니다. Logstash 포트를 수신하는 TCP를 514로 변경하면 모든 것이 잘 작동합니다.

문제의 클라이언트에서 logger -p를 실행하면 tcpdump -i에 아무것도 표시되지 않습니다.

그러나 "OK" 클라이언트에서 동일한 작업을 수행하면 tcpdump를 통해 포트 10514(또는 다른 포트)로의 외부 트래픽이 표시됩니다.

Logstash 포트를 514로 변경하니 문제가 해결되었습니다.

[root@centos-25 ~]# cat /etc/rsyslog.conf
# rsyslog configuration file

# For more information see /usr/share/doc/rsyslog-*/rsyslog_conf.html
# If you experience problems, see http://www.rsyslog.com/doc/troubleshoot.html

#### MODULES ####

# The imjournal module bellow is now used as a message source instead of imuxsock.
$ModLoad imuxsock # provides support for local system logging (e.g. via logger command)
$ModLoad imjournal # provides access to the systemd journal
#$ModLoad imklog # reads kernel messages (the same are read from journald)
#$ModLoad immark  # provides --MARK-- message capability

# Provides UDP syslog reception
#$ModLoad imudp
#$UDPServerRun 514

# Provides TCP syslog reception
#$ModLoad imtcp
#$InputTCPServerRun 514


#### GLOBAL DIRECTIVES ####

# Where to place auxiliary files
$WorkDirectory /var/lib/rsyslog

# Use default timestamp format
$ActionFileDefaultTemplate RSYSLOG_TraditionalFileFormat

# File syncing capability is disabled by default. This feature is usually not required,
# not useful and an extreme performance hit
#$ActionFileEnableSync on

# Include all config files in /etc/rsyslog.d/
$IncludeConfig /etc/rsyslog.d/*.conf

# Turn off message reception via local log socket;
# local messages are retrieved through imjournal now.
$OmitLocalLogging on

# File to store the position in the journal
$IMJournalStateFile imjournal.state


#### RULES ####

$template DynFile,"/var/log/kibana/system-%HOSTNAME%.log"

# Log all kernel messages to the console.
# Logging much else clutters up the screen.
#kern.*                                                 /dev/console

# Log anything (except mail) of level info or higher.
# Don't log private authentication messages!
*.info;mail.none;authpriv.none;cron.none                ?DynFile


# The authpriv file has restricted access.
authpriv.*                                              /var/log/secure

# Log all the mail messages in one place.
mail.*                                                  -/var/log/maillog

# Log cron stuff
cron.*                                                  /var/log/cron

# Everybody gets emergency messages
*.emerg                                                 :omusrmsg:*

# Save news errors of level crit and higher in a special file.
uucp,news.crit                                          /var/log/spooler

# Save boot messages also to boot.log
local7.*                                                /var/log/boot.log


# ### begin forwarding rule ###
# The statement between the begin ... end define a SINGLE forwarding
# rule. They belong together, do NOT split them. If you create multiple
# forwarding rules, duplicate the whole block!
# Remote Logging (we use TCP for reliable delivery)
#
# An on-disk queue is created for this action. If the remote host is
# down, messages are spooled to disk and sent when it is up again.
#$ActionQueueFileName fwdRule1 # unique name prefix for spool files
#$ActionQueueMaxDiskSpace 1g   # 1gb space limit (use as much as possible)
#$ActionQueueSaveOnShutdown on # save messages to disk on shutdown
#$ActionQueueType LinkedList   # run asynchronously
#$ActionResumeRetryCount -1    # infinite retries if host is down


#### Logstash #####
# remote host is: name/ip:port, e.g. 192.168.0.1:514, port optional
local1.notice @@192.168.253.26:10514;json-template
# ### end of the forwarding rule ###
$LocalHostName centos-25

# Include /var/log/dmesg for logging
$InputFileName /var/log/dmesg
$InputFileTag dmesg:
$InputFileStateFile stat-file1

$InputFileSeverity notice
$InputFileFacility local1
$InputRunFileMonitor
# end of include dmesg

이것은 OK 클라이언트의 테스트입니다: logger -p local1.notice "test from Problem centos-26"

Logstash 출력:

{
     "@timestamp" => "2017-07-04T10:43:55.121Z",
       "@version" => "1",
        "message" => "Test From Centos-26",
     "sysloghost" => "centos-26",
       "severity" => "notice",
       "facility" => "local1",
    "programname" => "root",
         "procid" => "-",
           "host" => "192.168.253.26",
           "port" => 40962,
           "type" => "rsyslog"
}

이것은 문제 노드에서 온 것입니다: logger -p local1.notice "test from Problem centos-25"

출력 내용

rsyslog.conf는 이러한 클라이언트에서 동일합니다.

이것은 OK 클라이언트에서 온 것입니다:

# rsyslog configuration file

# For more information see /usr/share/doc/rsyslog-*/rsyslog_conf.html
# If you experience problems, see http://www.rsyslog.com/doc/troubleshoot.html

#### MODULES ####

# The imjournal module bellow is now used as a message source instead of imuxsock.
$ModLoad imuxsock # provides support for local system logging (e.g. via logger command)
$ModLoad imjournal # provides access to the systemd journal
#$ModLoad imklog # reads kernel messages (the same are read from journald)
#$ModLoad immark  # provides --MARK-- message capability

# Provides UDP syslog reception
#$ModLoad imudp
#$UDPServerRun 514

# Provides TCP syslog reception
#$ModLoad imtcp
#$InputTCPServerRun 514


#### GLOBAL DIRECTIVES ####

# Where to place auxiliary files
$WorkDirectory /var/lib/rsyslog

# Use default timestamp format
$ActionFileDefaultTemplate RSYSLOG_TraditionalFileFormat

# File syncing capability is disabled by default. This feature is usually not required,
# not useful and an extreme performance hit
#$ActionFileEnableSync on

# Include all config files in /etc/rsyslog.d/
$IncludeConfig /etc/rsyslog.d/*.conf

# Turn off message reception via local log socket;
# local messages are retrieved through imjournal now.
$OmitLocalLogging on

# File to store the position in the journal
$IMJournalStateFile imjournal.state


#### RULES ####

$template DynFile,"/var/log/kibana/system-%HOSTNAME%.log"

# Log all kernel messages to the console.
# Logging much else clutters up the screen.
#kern.*                                                 /dev/console

# Log anything (except mail) of level info or higher.
# Don't log private authentication messages!
*.info;mail.none;authpriv.none;cron.none                ?DynFile


# The authpriv file has restricted access.
authpriv.*                                              /var/log/secure

# Log all the mail messages in one place.
mail.*                                                  -/var/log/maillog

# Log cron stuff
cron.*                                                  /var/log/cron

# Everybody gets emergency messages
*.emerg                                                 :omusrmsg:*

# Save news errors of level crit and higher in a special file.
uucp,news.crit                                          /var/log/spooler

# Save boot messages also to boot.log
local7.*                                                /var/log/boot.log


# ### begin forwarding rule ###
# The statement between the begin ... end define a SINGLE forwarding
# rule. They belong together, do NOT split them. If you create multiple
# forwarding rules, duplicate the whole block!
# Remote Logging (we use TCP for reliable delivery)
#
# An on-disk queue is created for this action. If the remote host is
# down, messages are spooled to disk and sent when it is up again.
#$ActionQueueFileName fwdRule1 # unique name prefix for spool files
#$ActionQueueMaxDiskSpace 1g   # 1gb space limit (use as much as possible)
#$ActionQueueSaveOnShutdown on # save messages to disk on shutdown
#$ActionQueueType LinkedList   # run asynchronously
#$ActionResumeRetryCount -1    # infinite retries if host is down


#### Logstash #####
# remote host is: name/ip:port, e.g. 192.168.0.1:514, port optional
local1.notice @@192.168.253.26:10514;json-template
# ### end of the forwarding rule ###
$LocalHostName centos-26

# Include /var/log/dmesg for logging
$InputFileName /var/log/dmesg
$InputFileTag dmesg:
$InputFileStateFile stat-file1

$InputFileSeverity notice
$InputFileFacility local1
$InputRunFileMonitor
# end of include dmesg