2020-09-15 12:30:19.51809816.0MbinfoStartLoop: disable caching
2020-09-15 12:30:19.51902116.0MbinfoStartLoop: check if we should take any measures before the actual scheduling loop
2020-09-15 12:30:19.52010216.0Mbinfopcntl functions found, installing signal handler
2020-09-15 12:30:19.52019916.0MbinfoStartLoop: check lock and status
2020-09-15 12:30:19.52509516.0MbinfoStartLoop: disconnected from DB
2020-09-15 12:30:19.52516816.0Mbinfo my PID: 23073
2020-09-15 12:30:19.52522116.0Mbinfoprepare infinite loop
2020-09-15 12:30:19.52527416.0MbsuccessLoop started, lock acquired
2020-09-15 12:30:19.52534116.0Mbinfowoke-up, at 1600162219.525328s
2020-09-15 12:30:19.52539316.0Mbinfo > loopDuration: 60.000066s
2020-09-15 12:30:19.52544316.0Mbinfo > reconnect
2020-09-15 12:30:19.71276416.0Mbsuccess -> run HardwareCheck
2020-09-15 12:30:20.02862616.0Mbsuccess -> run QuickReportsPopulate
2020-09-15 12:30:20.42659016.0Mbsuccess -> run ReportsDataPopulate
2020-09-15 12:30:20.84246916.0Mbsuccess -> run AmexGbt
2020-09-15 12:30:21.29252716.0Mbinfosleep duration: 39.707504s (until 1600162261.00s)
2020-09-15 12:31:01.00088516.0Mbinfowoke-up, at 1600162261.000860s
2020-09-15 12:31:01.00096316.0Mbinfo > loopDuration: 41.475532s
2020-09-15 12:31:01.00101316.0Mbinfo > reconnect
2020-09-15 12:31:01.04802616.0Mbinfosleep duration: 59.952002s (until 1600162321.00s)
2020-09-15 12:31:24.94486416.0MbcriticalScript was forcefully stopped
2020-09-15 12:31:24.94499816.0Mbcritical > received SIGTERM(15)
2020-09-15 12:31:24.94506316.0Mbcritical > signinfo: array (
'signo' => 15,
'errno' => 0,
'code' => 0,
)
2020-09-15 12:31:24.95047416.0MbcriticalReconnected to the DB
2020-09-15 12:31:24.95056116.0MbcriticalLock status:
2020-09-15 12:31:24.95159116.0Mbcritical > isLocked: true, DB status: 'should-stop'
2020-09-15 12:31:24.95168016.0Mbcritical > isLockedReasons: array (
)
2020-09-15 12:31:24.95358816.0MbcriticalMark as should-restart, released raw lock
2020-09-15 12:31:24.96684116.0MbcriticalGathering as much system info now:
2020-09-15 12:31:25.00516316.0Mbcritical(ps aux) 2>&1: USER PID %CPU %MEM VSZ RSS TTY STAT START TIME COMMAND
root 1 0.0 0.0 221644 5892 ? Ss May21 2:46 /sbin/init nomdmonddf nomdmonisw
root 2 0.0 0.0 0 0 ? S May21 0:02 [kthreadd]
root 3 0.0 0.0 0 0 ? S May21 0:18 [ksoftirqd/0]
root 5 0.0 0.0 0 0 ? S< May21 0:00 [kworker/0:0H]
root 7 0.0 0.0 0 0 ? S May21 45:36 [rcu_sched]
root 8 0.0 0.0 0 0 ? S May21 0:02 [rcu_bh]
root 9 0.0 0.0 0 0 ? S May21 0:04 [migration/0]
root 10 0.0 0.0 0 0 ? S May21 0:28 [watchdog/0]
root 11 0.0 0.0 0 0 ? S May21 0:26 [watchdog/1]
root 12 0.0 0.0 0 0 ? S May21 0:04 [migration/1]
root 13 0.0 0.0 0 0 ? S May21 1:02 [ksoftirqd/1]
root 15 0.0 0.0 0 0 ? S< May21 0:00 [kworker/1:0H]
root 16 0.0 0.0 0 0 ? S May21 0:26 [watchdog/2]
root 17 0.0 0.0 0 0 ? S May21 0:04 [migration/2]
root 18 0.0 0.0 0 0 ? S May21 0:35 [ksoftirqd/2]
root 20 0.0 0.0 0 0 ? S< May21 0:00 [kworker/2:0H]
root 21 0.0 0.0 0 0 ? S May21 0:24 [watchdog/3]
root 22 0.0 0.0 0 0 ? S May21 0:04 [migration/3]
root 23 0.0 0.0 0 0 ? S May21 0:36 [ksoftirqd/3]
root 25 0.0 0.0 0 0 ? S< May21 0:00 [kworker/3:0H]
root 26 0.0 0.0 0 0 ? S May21 0:00 [kdevtmpfs]
root 27 0.0 0.0 0 0 ? S< May21 0:00 [netns]
root 28 0.0 0.0 0 0 ? S< May21 0:00 [perf]
root 29 0.0 0.0 0 0 ? S May21 0:03 [khungtaskd]
root 30 0.0 0.0 0 0 ? S< May21 0:00 [writeback]
root 31 0.0 0.0 0 0 ? SN May21 0:00 [ksmd]
root 32 0.0 0.0 0 0 ? SN May21 5:40 [khugepaged]
root 33 0.0 0.0 0 0 ? S< May21 0:00 [crypto]
root 34 0.0 0.0 0 0 ? S< May21 0:00 [kintegrityd]
root 35 0.0 0.0 0 0 ? S< May21 0:00 [bioset]
root 36 0.0 0.0 0 0 ? S< May21 0:00 [kblockd]
root 37 0.0 0.0 0 0 ? S< May21 0:00 [ata_sff]
root 38 0.0 0.0 0 0 ? S< May21 0:00 [md]
root 39 0.0 0.0 0 0 ? S< May21 0:00 [devfreq_wq]
root 46 0.0 0.0 0 0 ? S May21 11:09 [kswapd0]
root 47 0.0 0.0 0 0 ? S< May21 0:00 [vmstat]
root 48 0.0 0.0 0 0 ? S May21 0:00 [fsnotify_mark]
root 49 0.0 0.0 0 0 ? S May21 0:00 [ecryptfs-kthrea]
root 65 0.0 0.0 0 0 ? S< May21 0:00 [kthrotld]
root 66 0.0 0.0 0 0 ? S< May21 0:00 [acpi_thermal_pm]
root 67 0.0 0.0 0 0 ? S< May21 0:00 [bioset]
root 68 0.0 0.0 0 0 ? S< May21 0:00 [bioset]
root 69 0.0 0.0 0 0 ? S< May21 0:00 [bioset]
root 70 0.0 0.0 0 0 ? S< May21 0:00 [bioset]
root 71 0.0 0.0 0 0 ? S< May21 0:00 [bioset]
root 72 0.0 0.0 0 0 ? S< May21 0:00 [bioset]
root 73 0.0 0.0 0 0 ? S< May21 0:00 [bioset]
root 74 0.0 0.0 0 0 ? S< May21 0:00 [bioset]
root 80 0.0 0.0 0 0 ? S< May21 0:00 [ipv6_addrconf]
root 93 0.0 0.0 0 0 ? S< May21 0:00 [deferwq]
root 94 0.0 0.0 0 0 ? S< May21 0:00 [charger_manager]
root 137 0.0 0.0 0 0 ? S May21 0:00 [scsi_eh_0]
root 138 0.0 0.0 0 0 ? S< May21 0:00 [scsi_tmf_0]
root 139 0.0 0.0 0 0 ? S May21 0:00 [scsi_eh_1]
root 140 0.0 0.0 0 0 ? S< May21 0:00 [scsi_tmf_1]
root 141 0.0 0.0 0 0 ? S May21 0:00 [scsi_eh_2]
root 142 0.0 0.0 0 0 ? S< May21 0:00 [scsi_tmf_2]
root 143 0.0 0.0 0 0 ? S May21 0:00 [scsi_eh_3]
root 144 0.0 0.0 0 0 ? S< May21 0:00 [scsi_tmf_3]
root 145 0.0 0.0 0 0 ? S May21 0:00 [scsi_eh_4]
root 146 0.0 0.0 0 0 ? S< May21 0:00 [scsi_tmf_4]
root 147 0.0 0.0 0 0 ? S May21 0:00 [scsi_eh_5]
root 148 0.0 0.0 0 0 ? S< May21 0:00 [scsi_tmf_5]
root 155 0.0 0.0 0 0 ? S< May21 0:00 [kfd_process_wq]
root 156 0.0 0.0 0 0 ? S< May21 0:00 [ttm_swap]
root 157 0.0 0.0 0 0 ? S< May21 0:00 [radeon-crtc]
root 158 0.0 0.0 0 0 ? S< May21 0:00 [bioset]
root 159 0.0 0.0 0 0 ? S< May21 0:00 [bioset]
root 160 0.0 0.0 0 0 ? S< May21 0:00 [bioset]
root 167 0.0 0.0 0 0 ? S< May21 0:00 [bioset]
root 168 0.0 0.0 0 0 ? S< May21 0:00 [bioset]
root 171 0.0 0.0 0 0 ? S< May21 0:00 [bioset]
root 176 0.0 0.0 0 0 ? S< May21 0:00 [bioset]
root 177 0.0 0.0 0 0 ? S< May21 0:00 [bioset]
root 181 0.0 0.0 0 0 ? S< May21 0:00 [bioset]
root 184 0.0 0.0 0 0 ? S< May21 0:00 [bioset]
root 185 0.0 0.0 0 0 ? S< May21 0:00 [bioset]
root 186 0.0 0.0 0 0 ? S May21 58:37 [md1_raid1]
root 187 0.0 0.0 0 0 ? S May21 8:24 [md0_raid1]
root 213 0.0 0.0 0 0 ? S< May21 0:00 [raid5wq]
root 243 0.0 0.0 0 0 ? S< May21 22:27 [kworker/3:1H]
root 244 0.0 0.0 0 0 ? S< May21 1:41 [kworker/0:1H]
root 245 0.0 0.0 0 0 ? S< May21 1:06 [kworker/1:1H]
root 249 0.0 0.0 0 0 ? S May21 3:02 [jbd2/md0-8]
root 250 0.0 0.0 0 0 ? S< May21 0:00 [ext4-rsv-conver]
root 291 0.0 0.0 0 0 ? S May21 0:00 [kauditd]
root 307 0.0 0.5 250180 43028 ? S&1
www-data 23097 0.0 0.0 34380 2780 ? RN 12:31 0:00 ps aux
www-data 24188 0.0 0.4 366920 34732 ? SN Aug28 9:23 php -f /srv/www/devel/cristiana.matache/TINA3_alt/project/disp.php module=Admin/CronJobs/Main action=startLoop mainCronJobLogId=20048
www-data 28082 0.0 0.2 362824 20528 ? SN May22 18:58 php -f /srv/www/devel/staging/instances/1u7-ujodu/tina/disp.php module=Admin/CronJobs/Main action=startLoop mainCronJobLogId=7
2020-09-15 12:31:25.04770316.0Mbcritical(w) 2>&1: 12:31:25 up 116 days, 22:39, 0 users, load average: 0.46, 1.21, 4.18
USER TTY FROM LOGIN@ IDLE JCPU PCPU WHAT
2020-09-15 12:31:25.06381916.0Mbcritical(who -a) 2>&1: system boot May 21 13:52
LOGIN tty1 May 21 13:52 1521 id=tty1
run-level 5 May 21 13:53
pts/0 Sep 15 12:13 19489 id=ts/0 term=0 exit=0
pts/3 Jul 13 10:56 9176 id=ts/3 term=0 exit=0
2020-09-15 12:31:25.07391416.0Mbcritical(dmesg | tail -n 50) 2>&1: [10103259.049810] [] schedule+0x35/0x80
[10103259.049814] [] schedule_preempt_disabled+0xe/0x10
[10103259.049817] [] __mutex_lock_slowpath+0xb7/0x130
[10103259.049820] [] mutex_lock+0x1f/0x30
[10103259.049824] [] path_openat+0x512/0x1360
[10103259.049827] [] ? putname+0x54/0x60
[10103259.049831] [] do_filp_open+0x91/0x100
[10103259.049835] [] ? __alloc_fd+0xc7/0x190
[10103259.049838] [] do_sys_open+0x138/0x2a0
[10103259.049841] [] SyS_openat+0x14/0x20
[10103259.049845] [] entry_SYSCALL_64_fastpath+0x22/0xcb
[10103259.049848] INFO: task apache2:20904 blocked for more than 120 seconds.
[10103259.049937] Not tainted 4.4.0-145-generic #171-Ubuntu
[10103259.050021] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[10103259.050133] apache2 D ffff880112eb7c58 0 20904 1815 0x00000000
[10103259.050137] ffff880112eb7c58 0000000000000001 ffff880216360e00 ffff8801387c1c00
[10103259.050140] ffff880112eb8000 ffff88010b6e76d4 ffff8801387c1c00 00000000ffffffff
[10103259.050144] ffff88010b6e76d8 ffff880112eb7c70 ffffffff8185dea5 ffff88010b6e76d0
[10103259.050147] Call Trace:
[10103259.050151] [] schedule+0x35/0x80
[10103259.050154] [] schedule_preempt_disabled+0xe/0x10
[10103259.050157] [] __mutex_lock_slowpath+0xb7/0x130
[10103259.050160] [] mutex_lock+0x1f/0x30
[10103259.050164] [] path_openat+0x512/0x1360
[10103259.050167] [] ? putname+0x54/0x60
[10103259.050171] [] do_filp_open+0x91/0x100
[10103259.050175] [] ? __alloc_fd+0xc7/0x190
[10103259.050178] [] do_sys_open+0x138/0x2a0
[10103259.050181] [] SyS_openat+0x14/0x20
[10103259.050185] [] entry_SYSCALL_64_fastpath+0x22/0xcb
[10103259.050188] INFO: task apache2:20907 blocked for more than 120 seconds.
[10103259.050277] Not tainted 4.4.0-145-generic #171-Ubuntu
[10103259.050361] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[10103259.050473] apache2 D ffff8801079efc58 0 20907 1815 0x00000000
[10103259.050477] ffff8801079efc58 0000000000000001 ffff880216360e00 ffff8801387c0e00
[10103259.050480] ffff8801079f0000 ffff88010b6e76d4 ffff8801387c0e00 00000000ffffffff
[10103259.050484] ffff88010b6e76d8 ffff8801079efc70 ffffffff8185dea5 ffff88010b6e76d0
[10103259.050488] Call Trace:
[10103259.050491] [] schedule+0x35/0x80
[10103259.050494] [] schedule_preempt_disabled+0xe/0x10
[10103259.050497] [] __mutex_lock_slowpath+0xb7/0x130
[10103259.050500] [] mutex_lock+0x1f/0x30
[10103259.050504] [] path_openat+0x512/0x1360
[10103259.050507] [] ? putname+0x54/0x60
[10103259.050511] [] ? unlock_page+0x69/0x70
[10103259.050514] [] do_filp_open+0x91/0x100
[10103259.050519] [] ? __alloc_fd+0xc7/0x190
[10103259.050522] [] do_sys_open+0x138/0x2a0
[10103259.050525] [] SyS_openat+0x14/0x20
[10103259.050529] [] entry_SYSCALL_64_fastpath+0x22/0xcb