Discussion:
[Check_mk (english)] Check_MK 1.5.0p7 Agent (Disk IO Summary) not compatible with kernel 4.19
Marc Saubert
2018-11-19 16:19:49 UTC
Permalink
Hi all,

I am suspecting that Check_MK 1.5.0 is not compatible with Linux Kernel 4.19. After upgrading Fedora 29 kernel from 4.18.* to 4.19.2 on a monitored host that runs Check_MK Agent 1.5.0p7, Check_MK 1.5.0p7 server will display the following for this monitored host:

Disk IO SUMMARY - UNKN - Error: ValueError('too many values to unpack',) File "/omd/sites/monitor/lib/python/cmk_base/data_sources/host_sections.py", line 260, in _update_with_parse_function return parse_function(section_content) File "/omd/sites/monitor/share/check_mk/checks/diskstat", line 124, in parse_diskstat ios_in_prog, total_ticks, rq_ticks = line

This will also result in:

Check_MK Discovery - UNKN - check failed - please submit a crash report!

Removing the now faulty "Disk IO Summary" check for the monitored host will still leave Check_MK Discovery crashing.

------

Some OS info:

# uname -a

Linux blah 4.19.2-300.fc29.x86_64 #1 SMP Wed Nov 14 19:05:24 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux

# cat /etc/os-release

NAME=Fedora
VERSION="29 (Twenty Nine)"
<...>

------

Best regards

Marc Saubert
Viprinet Europe GmbH
Marc Saubert
2018-11-21 22:50:43 UTC
Permalink
Hi there,

here is some relevant crash reporting regarding the kernel 4.19 diskstat issue, which persists with FC29 hotfix kernel version 4.19.2-301.fc29.x86_64:


Crash Type check
Time 2018-11-21 23:32:40
Operating System el7
Check_MK Version 1.5.0p7
Edition cre
Core nagios
Python Version 2.7.15 (default, Oct 22 2018, 22:56:01) [GCC 7.2.0]
Exception
ValueError (too many values to unpack)


Traceback
File "/omd/sites/monitor/lib/python/cmk_base/checking.py", line 81, in wrapped_check_func
status, infotexts, long_infotexts, perfdata = check_func(hostname, *args, **kwargs)

File "/omd/sites/monitor/lib/python/cmk_base/discovery.py", line 322, in check_discovery
services = _get_host_services(hostname, ipaddress, sources, multi_host_sections, on_error="raise")

File "/omd/sites/monitor/lib/python/cmk_base/discovery.py", line 979, in _get_host_services
return _get_node_services(hostname, ipaddress, sources, multi_host_sections, on_error)

File "/omd/sites/monitor/lib/python/cmk_base/discovery.py", line 984, in _get_node_services
services = _get_discovered_services(hostname, ipaddress, sources, multi_host_sections, on_error)

File "/omd/sites/monitor/lib/python/cmk_base/discovery.py", line 1022, in _get_discovered_services
new_items = _discover_services(hostname, ipaddress, sources, multi_host_sections, on_error)

File "/omd/sites/monitor/lib/python/cmk_base/discovery.py", line 688, in _discover_services
for item, paramstring in _execute_discovery(multi_host_sections, hostname, ipaddress, check_plugin_name, on_error):

File "/omd/sites/monitor/lib/python/cmk_base/data_sources/host_sections.py", line 260, in _update_with_parse_function
return parse_function(section_content)

File "/omd/sites/monitor/share/check_mk/checks/diskstat", line 124, in parse_diskstat
ios_in_prog, total_ticks, rq_ticks = line


Python Module Paths /opt/omd/versions/1.5.0p7.cre/bin
/omd/sites/monitor/local/lib/python
/omd/sites/monitor/lib/python
/omd/sites/monitor/lib/python
/omd/sites/monitor/local/lib/python
/omd/sites/monitor/lib/python27.zip
/omd/sites/monitor/lib/python2.7
/omd/sites/monitor/lib/python2.7/plat-linux2
/omd/sites/monitor/lib/python2.7/lib-tk
/omd/sites/monitor/lib/python2.7/lib-old
/omd/sites/monitor/lib/python2.7/lib-dynload
/omd/sites/monitor/lib/python2.7/site-packages


Host whatever
Is Cluster Host No
Check Type discovery
Manual Check No
Uses SNMP No
Inline-SNMP No
Check Item
Description Check_MK Discovery
Parameters None

cal Variables
{'device_names': [u'sda', u'sda1', u'sda2'],
'disks': {},
'info': [[None, u'1542839564'],
[None,
u'8',
u'0',
u'sda',
u'25929',
u'142',
u'1095466',
u'22803',
u'2154',
u'641',
u'99128',
u'3702',
u'0',
u'6143',
u'24719',
u'0',
u'0',
u'0',
u'0'],
[None,
u'8',
u'1',
u'sda1',
u'25767',
u'142',
u'1084858',
u'22746',
u'2137',
u'641',
u'99128',
u'3700',
u'0',
u'6120',
u'24655',
u'0',
u'0',
u'0',
u'0'],
[None,
u'8',
u'2',
u'sda2',
u'128',
u'0',
u'7504',
u'41',
u'0',
u'0',
u'0',
u'0',
u'0',
u'14',
u'39',
u'0',
u'0',
u'0',
u'0'],
[None, u'[dmsetup_info]'],
[None, u'No', u'devices', u'found']],
'line': [None,
u'8',
u'0',
u'sda',
u'25929',
u'142',
u'1095466',
u'22803',
u'2154',
u'641',
u'99128',
u'3702',
u'0',
u'6143',
u'24719',
u'0',
u'0',
u'0',
u'0'],
'name_info': {},
'proc_diskstat': [[None,
u'8',
u'0',
u'sda',
u'25929',
u'142',
u'1095466',
u'22803',
u'2154',
u'641',
u'99128',
u'3702',
u'0',
u'6143',
u'24719',
u'0',
u'0',
u'0',
u'0'],
[None,
u'8',
u'1',
u'sda1',
u'25767',
u'142',
u'1084858',
u'22746',
u'2137',
u'641',
u'99128',
u'3700',
u'0',
u'6120',
u'24655',
u'0',
u'0',
u'0',
u'0'],
[None,
u'8',
u'2',
u'sda2',
u'128',
u'0',
u'7504',
u'41',
u'0',
u'0',
u'0',
u'0',
u'0',
u'14',
u'39',
u'0',
u'0',
u'0',
u'0']],
'real_partitions': set([u'sda1', u'sda2']),
'timestamp': 1542839564,
'timestamp_str': 1542839564}


<<<check_mk>>>
Version: 1.5.0p7
AgentOS: linux
Hostname: whatever
AgentDirectory: /etc/check_mk
DataDirectory: /var/lib/check_mk_agent
SpoolDirectory: /var/lib/check_mk_agent/spool
PluginsDirectory: /usr/lib/check_mk_agent/plugins
LocalDirectory: /usr/lib/check_mk_agent/local
OnlyFrom:
<<<df>>>
devtmpfs devtmpfs 1266004 0 1266004 0% /dev
tmpfs tmpfs 1277276 0 1277276 0% /dev/shm
tmpfs tmpfs 1277276 512 1276764 1% /run
tmpfs tmpfs 1277276 0 1277276 0% /sys/fs/cgroup
/dev/sda1 ext4 23605692 8510072 13873476 39% /
tmpfs tmpfs 1277276 0 1277276 0% /tmp
<<<df>>>
[df_inodes_start]
devtmpfs devtmpfs 316501 405 316096 1% /dev
tmpfs tmpfs 319319 1 319318 1% /dev/shm
tmpfs tmpfs 319319 511 318808 1% /run
tmpfs tmpfs 319319 17 319302 1% /sys/fs/cgroup
/dev/sda1 ext4 1507328 196413 1310915 14% /
tmpfs tmpfs 319319 19 319300 1% /tmp
[df_inodes_end]
<<<nfsmounts>>>
<<<cifsmounts>>>
<<<mounts>>>
/dev/sda1 / ext4 rw,seclabel,relatime 0 0
<...>
<<<diskstat>>>
1542839524
8 0 sda 13014 142 692538 18855 1974 500 35704 3053 0 3792 20181 0 0 0 0
8 1 sda1 12852 142 681930 18797 1969 500 35704 3052 0 3769 20117 0 0 0 0
8 2 sda2 128 0 7504 41 0 0 0 0 0 14 39 0 0 0 0
[dmsetup_info]
No devices found
<...>


Best regards

Marc Saubert
Viprinet Europe GmbH


----- Ursprüngliche Mail -----
Von: "Marc Saubert" <***@viprinet.com>
An: "checkmk-***@lists.mathias-kettner.de" <checkmk-***@lists.mathias-kettner.de>
Gesendet: Montag, 19. November 2018 17:19:49
Betreff: [Check_mk (english)] Check_MK 1.5.0p7 Agent (Disk IO Summary) not compatible with kernel 4.19

Hi all,

I am suspecting that Check_MK 1.5.0 is not compatible with Linux Kernel 4.19. After upgrading Fedora 29 kernel from 4.18.* to 4.19.2 on a monitored host that runs Check_MK Agent 1.5.0p7, Check_MK 1.5.0p7 server will display the following for this monitored host:

Disk IO SUMMARY - UNKN - Error: ValueError('too many values to unpack',) File "/omd/sites/monitor/lib/python/cmk_base/data_sources/host_sections.py", line 260, in _update_with_parse_function return parse_function(section_content) File "/omd/sites/monitor/share/check_mk/checks/diskstat", line 124, in parse_diskstat ios_in_prog, total_ticks, rq_ticks = line

This will also result in:

Check_MK Discovery - UNKN - check failed - please submit a crash report!

Removing the now faulty "Disk IO Summary" check for the monitored host will still leave Check_MK Discovery crashing.

------

Some OS info:

# uname -a

Linux blah 4.19.2-300.fc29.x86_64 #1 SMP Wed Nov 14 19:05:24 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux

# cat /etc/os-release

NAME=Fedora
VERSION="29 (Twenty Nine)"
<...>

------

Best regards

Marc Saubert
Viprinet Europe GmbH
_______________________________________________
checkmk-en mailing list
checkmk-***@lists.mathias-kettner.de
Manage your subscription or unsubscribe
http://lists.mathias-kettner.de/mailman/listinfo/checkmk-en
Marc Saubert
2018-11-22 21:20:39 UTC
Permalink
Hi all,

This issue has been fixed in https://mathias-kettner.de/check_mk-werks.php?werk_id=6893 and will be included in Check_MK 1.5.0p8.
For those who can't wait: https://to.to/5J2MJ (copy to share/check_mk/checks/diskstat (1.5.0p7: fixes diskstat crashes with kernel 4.19.*))

Best regards

Marc Saubert
Viprinet Europe GmbH

Loading...