ECS: xDoctor: RAP059: Detected rsyslogd is not running on a node

Article Number: 500620 Article Version: 7 Article Type: Break Fix



ECS Appliance,ECS Appliance Hardware,Elastic Cloud Storage

If this process is not running logging within the docker container will not work correctly.

Timestamp = 2017-12-22_224028 Category = PROCESS Source = PS Severity = ERROR Node = 169.254.1.1 Message = Detected rsyslogd is not running on a node Extra = 169.254.1.1, 169.254.1.2, 169.254.1.3, 169.254.1.4 RAP = RAP059 Solution = 500620 

As you can see below rsyslogd is not running on node 1:

viprexec -i "ps -ef |grep rsyslog |grep -v grep"Output from host : 192.168.219.1root 2440 1 0 Apr07 ? 00:04:31 /usr/sbin/rsyslogd -nOutput from host : 192.168.219.2root 2467 1 0 2016 ? 00:13:46 /usr/sbin/rsyslogd -nroot 109133 109015 0 Feb23 ? 00:10:06 rsyslogdOutput from host : 192.168.219.3root 2560 1 0 2016 ? 00:14:14 /usr/sbin/rsyslogd -nroot 98908 98874 0 Feb23 ? 00:10:20 rsyslogdOutput from host : 192.168.219.4root 2417 1 0 2016 ? 00:13:59 /usr/sbin/rsyslogd -nroot 52765 52641 0 Feb23 ? 00:10:19 rsyslogd 

System is not tolerant to rsyslogd stopping unexpectedly.

Start rsyslogd on all nodes:

# viprexec -c "/usr/sbin/rsyslogd" 

Now verify that process is running again as below

# viprexec "ps -ef |grep rsyslogd |grep -v grep" 

Example output:

ecs-:~ # viprexec 'sudo docker exec -i object-main /usr/sbin/rsyslogd'Output from host : 192.168.219.3Output from host : 192.168.219.4Output from host : 192.168.219.2Already running. If you want to run multiple instances, you need to specify different pid files (use -i option)Output from host : 192.168.219.5Already running. If you want to run multiple instances, you need to specify different pid files (use -i option)Output from host : 192.168.219.1Already running. If you want to run multiple instances, you need to specify different pid files (use -i option)ecs-:~ # viprexec -i "ps -ef |grep rsyslog |grep -v grep"Output from host : 192.168.219.1root 2073 1 0 19:25 ? 00:00:01 /usr/sbin/rsyslogd -nroot 115316 8473 0 22:45 ? 00:00:00 rsyslogdOutput from host : 192.168.219.2root 2083 1 0 20:39 ? 00:00:00 /usr/sbin/rsyslogd -nroot 89721 6664 0 22:45 ? 00:00:00 rsyslogdOutput from host : 192.168.219.3root 2124 1 0 19:53 ? 00:00:00 /usr/sbin/rsyslogd -nroot 43925 6620 0 22:46 ? 00:00:00 /usr/sbin/rsyslogdOutput from host : 192.168.219.4root 2148 1 0 20:13 ? 00:00:00 /usr/sbin/rsyslogd -nroot 115677 6846 0 22:46 ? 00:00:00 /usr/sbin/rsyslogdOutput from host : 192.168.219.5root 1880 1 0 Dec07 ? 00:03:12 /usr/sbin/rsyslogd -nroot 28735 28657 0 Dec12 ? 00:02:24 rsyslogd 

Related:

Leave a Reply