poller-debug

From Putrid Dove, 1 Year ago, written in Plain Text.
URL https://p.libren.ms/view/0835bea2
Embed
Download Paste or View Raw
  1. librenms@librenms:~$ ./poller.php -r -f -p -d -h <REDACTED> -m storage
  2. LibreNMS Poller
  3. SQL[select `migration` from `migrations` order by `id` desc limit 1 [] 0.4ms]
  4.  
  5. SQL[select count(*) as aggregate from `migrations` [] 0.2ms]
  6.  
  7. SQL[select version() [] 0.16ms]
  8.  
  9. ===========================================
  10. Component | Version
  11. --------- | -------
  12. LibreNMS  | 23.2.0-3-gc0fd1e15e (2023-02-24T12:10:10+00:00)
  13. DB Schema | 2022_08_15_084507_add_rrd_type_to_wireless_sensors_table (248)
  14. PHP       | 8.2.3
  15. Python    | 3.10.6
  16. Database  | MariaDB 10.11.2-MariaDB
  17. RRDTool   | 1.7.2
  18. SNMP      | 5.9.1
  19. ===========================================
  20. DEBUG!
  21. Updating os_def.cache
  22. Override poller modules: storage
  23. Starting polling run:
  24.  
  25. SQL[SELECT * FROM `devices` WHERE `disabled` = 0 AND `hostname` = '<REDACTED>' ORDER BY `device_id` ASC [] 0.64ms]
  26.  
  27. SQL[select * from `devices` where `device_id` = ? limit 1 [41] 0.25ms]
  28.  
  29. SQL[select * from `devices_attribs` where `devices_attribs`.`device_id` = ? and `devices_attribs`.`device_id` is not null [41] 0.18ms]
  30.  
  31. Attempting to initialize OS: truenas
  32. OS initialized as Generic
  33. Hostname:    <REDACTED>
  34. Device ID:   41
  35. OS:          truenas
  36. Resolved IP: 10.0.20.7
  37.  
  38.  
  39. [FPING] '/usr/bin/fping' '-e' '-q' '-c' '3' '-p' '500' '-t' '500' '-O' '0' '<REDACTED>'
  40.  
  41. response: xmt/rcv/%loss = 3/3/0%, min/avg/max = 2.28/4.92/10.1
  42. SNMP['/usr/bin/snmpget' '-M' '/opt/librenms/mibs:/opt/librenms/mibs/ixsystems' '-v3' '-l' 'authPriv' '-n' "" '-x' 'AES' '-X' 'PASSWORD' '-a' 'SHA' '-A' 'PASSWORD' '-u' 'USER' '-OQXUte' 'udp:HOSTNAME:161' 'SNMPv2-MIB::sysObjectID.0']
  43. SNMPv2-MIB::sysObjectID.0 = SNMPv2-SMI::enterprises.50536.3.1
  44.  
  45.  
  46. SQL[insert into `device_perf` (`min`, `max`, `avg`, `xmt`, `rcv`, `loss`, `debug`, `device_id`, `timestamp`) values (?, ?, ?, ?, ?, ?, ?, ?, ?) [2.28,10.1,4.92,3,3,0,"{\"poller_name\":\"librenms\"}",41,"2023-02-28 14:29:27"] 1.02ms]
  47.  
  48. SQL[update `devices` set `last_ping_timetaken` = ? where `device_id` = ? [4.92,41] 0.32ms]
  49.  
  50. SQL[select * from `device_outages` where `device_outages`.`device_id` = ? and `device_outages`.`device_id` is not null and `up_again` is null order by `going_down` desc limit 1 [41] 0.35ms]
  51.  
  52. Modules status: Global+
  53. OS
  54. Device
  55.  
  56. #### Load poller module core ####
  57. SNMP['/usr/bin/snmpget' '-M' '/opt/librenms/mibs:/opt/librenms/mibs/ixsystems' '-v3' '-l' 'authPriv' '-n' "" '-x' 'AES' '-X' 'PASSWORD' '-a' 'SHA' '-A' 'PASSWORD' '-u' 'USER' '-OQXUte' '-On' 'udp:HOSTNAME:161' 'SNMPv2-MIB::sysUpTime.0']
  58. .*.*.0 = 10630219
  59.  
  60.  
  61. SNMP['/usr/bin/snmpget' '-M' '/opt/librenms/mibs:/opt/librenms/mibs/ixsystems' '-v3' '-l' 'authPriv' '-n' "" '-x' 'AES' '-X' 'PASSWORD' '-a' 'SHA' '-A' 'PASSWORD' '-u' 'USER' '-OQXUte' 'udp:HOSTNAME:161' 'SNMP-FRAMEWORK-MIB::snmpEngineTime.0' 'HOST-RESOURCES-MIB::hrSystemUptime.0']
  62. SNMP-FRAMEWORK-MIB::snmpEngineTime.0 = 106302
  63. HOST-RESOURCES-MIB::hrSystemUptime.0 = 26400890
  64.  
  65.  
  66. Uptime seconds: 264009
  67.  
  68. Uptime: 3 days 1 hour 20 minutes 9 seconds
  69. SQL[update `devices` set `uptime` = ? where `device_id` = ? [264009,41] 0.42ms]
  70.  
  71.  
  72. >> Runtime for poller module 'core': 0.0663 seconds with 107168 bytes
  73. >> SNMP: [2/0.06s] MySQL: [1/0.00s]
  74. #### Unload poller module core ####
  75.  
  76. Modules status: Global+
  77. OS
  78. Device
  79.  
  80. #### Load poller module storage ####
  81. SQL[SELECT * FROM storage WHERE device_id = ? [41] 0.35ms]
  82.  
  83. Storage tank/.system/cores: freenas-dataset
  84.  
  85.  
  86.  
  87. SNMP['/usr/bin/snmpbulkwalk' '-v3' '-l' 'authPriv' '-n' "" '-a' 'SHA' '-A' 'PASSWORD' '-u' 'USER' '-x' 'AES' '-X' 'PASSWORD' '-OQUs' '-m' 'FREENAS-MIB' '-M' '/opt/librenms/mibs:/opt/librenms/mibs/ixsystems' 'udp:HOSTNAME:161' 'datasetTable']
  88. datasetIndex.1 = 1
  89. datasetIndex.2 = 2
  90. datasetIndex.3 = 3
  91. datasetIndex.4 = 4
  92. datasetIndex.5 = 5
  93. datasetIndex.6 = 6
  94. datasetIndex.7 = 7
  95. datasetIndex.8 = 8
  96. datasetIndex.9 = 9
  97. datasetIndex.10 = 10
  98. datasetIndex.11 = 11
  99. datasetIndex.12 = 12
  100. datasetIndex.13 = 13
  101. datasetIndex.14 = 14
  102. datasetIndex.15 = 15
  103. datasetIndex.16 = 16
  104. datasetIndex.17 = 17
  105. datasetDescr.1 = tank/.system/cores
  106. datasetDescr.2 = tank/.system/samba4
  107. datasetDescr.3 = tank/.system/services
  108. datasetDescr.4 = tank/.system/configs-8f179c8648fc4419af075a5cf26c19f8
  109. datasetDescr.5 = tank/<REDACTED>
  110. datasetDescr.6 = tank
  111. datasetDescr.7 = tank/homes
  112. datasetDescr.8 = tank/.system/ctdb_shared_vol
  113. datasetDescr.9 = tank/.system/rrd-8f179c8648fc4419af075a5cf26c19f8
  114. datasetDescr.10 = tank/<REDACTED>
  115. datasetDescr.11 = tank/<REDACTED>
  116. datasetDescr.12 = boot-pool/grub
  117. datasetDescr.13 = tank/.system/glusterd
  118. datasetDescr.14 = boot-pool/ROOT/22.12.1
  119. datasetDescr.15 = tank/.system/webui
  120. datasetDescr.16 = tank/.system
  121. datasetDescr.17 = tank/.system/syslog-8f179c8648fc4419af075a5cf26c19f8
  122. datasetAllocationUnits.1 = 261888
  123. datasetAllocationUnits.2 = 797568
  124. datasetAllocationUnits.3 = 261888
  125. datasetAllocationUnits.4 = 773760
  126. datasetAllocationUnits.5 = 654983012928
  127. datasetAllocationUnits.6 = 3562475308416
  128. datasetAllocationUnits.7 = 583296
  129. datasetAllocationUnits.8 = 261888
  130. datasetAllocationUnits.9 = 32093184
  131. datasetAllocationUnits.10 = 2907384516672
  132. datasetAllocationUnits.11 = 261888
  133. datasetAllocationUnits.12 = 8585216
  134. datasetAllocationUnits.13 = 279744
  135. datasetAllocationUnits.14 = 2833498112
  136. datasetAllocationUnits.15 = 261888
  137. datasetAllocationUnits.16 = 49824192
  138. datasetAllocationUnits.17 = 14344320
  139. datasetSize.1 = 1073479936
  140. datasetSize.2 = 19542032824960
  141. datasetSize.3 = 19542032824960
  142. datasetSize.4 = 19542032824960
  143. datasetSize.5 = 19542032824960
  144. datasetSize.6 = 19542032824960
  145. datasetSize.7 = 19542032824960
  146. datasetSize.8 = 19542032824960
  147. datasetSize.9 = 19542032824960
  148. datasetSize.10 = 19542032824960
  149. datasetSize.11 = 19542032824960
  150. datasetSize.12 = 95988752384
  151. datasetSize.13 = 19542032824960
  152. datasetSize.14 = 95988752384
  153. datasetSize.15 = 19542032824960
  154. datasetSize.16 = 19542032824960
  155. datasetSize.17 = 19542032824960
  156. datasetUsed.1 = 261888
  157. datasetUsed.2 = 797568
  158. datasetUsed.3 = 261888
  159. datasetUsed.4 = 773760
  160. datasetUsed.5 = 654983012928
  161. datasetUsed.6 = 380928
  162. datasetUsed.7 = 583296
  163. datasetUsed.8 = 261888
  164. datasetUsed.9 = 32093184
  165. datasetUsed.10 = 2907384516672
  166. datasetUsed.11 = 261888
  167. datasetUsed.12 = 8585216
  168. datasetUsed.13 = 279744
  169. datasetUsed.14 = 2821681152
  170. datasetUsed.15 = 261888
  171. datasetUsed.16 = 488064
  172. datasetUsed.17 = 14344320
  173.  
  174. array (
  175.   'dataset' =>
  176.   array (
  177.     1 =>
  178.     array (
  179.       'datasetIndex' => '1',
  180.       'datasetDescr' => 'tank/.system/cores',
  181.       'datasetAllocationUnits' => '261888',
  182.       'datasetSize' => '1073479936',
  183.       'datasetUsed' => '261888',
  184.     ),
  185.     2 =>
  186.     array (
  187.       'datasetIndex' => '2',
  188.       'datasetDescr' => 'tank/.system/samba4',
  189.       'datasetAllocationUnits' => '797568',
  190.       'datasetSize' => '19542032824960',
  191.       'datasetUsed' => '797568',
  192.     ),
  193.     3 =>
  194.     array (
  195.       'datasetIndex' => '3',
  196.       'datasetDescr' => 'tank/.system/services',
  197.       'datasetAllocationUnits' => '261888',
  198.       'datasetSize' => '19542032824960',
  199.       'datasetUsed' => '261888',
  200.     ),
  201.     4 =>
  202.     array (
  203.       'datasetIndex' => '4',
  204.       'datasetDescr' => 'tank/.system/configs-8f179c8648fc4419af075a5cf26c19f8',
  205.       'datasetAllocationUnits' => '773760',
  206.       'datasetSize' => '19542032824960',
  207.       'datasetUsed' => '773760',
  208.     ),
  209.     5 =>
  210.     array (
  211.       'datasetIndex' => '5',
  212.       'datasetDescr' => 'tank/<REDACTED>',
  213.       'datasetAllocationUnits' => '654983012928',
  214.       'datasetSize' => '19542032824960',
  215.       'datasetUsed' => '654983012928',
  216.     ),
  217.     6 =>
  218.     array (
  219.       'datasetIndex' => '6',
  220.       'datasetDescr' => 'tank',
  221.       'datasetAllocationUnits' => '3562475308416',
  222.       'datasetSize' => '19542032824960',
  223.       'datasetUsed' => '380928',
  224.     ),
  225.     7 =>
  226.     array (
  227.       'datasetIndex' => '7',
  228.       'datasetDescr' => 'tank/homes',
  229.       'datasetAllocationUnits' => '583296',
  230.       'datasetSize' => '19542032824960',
  231.       'datasetUsed' => '583296',
  232.     ),
  233.     8 =>
  234.     array (
  235.       'datasetIndex' => '8',
  236.       'datasetDescr' => 'tank/.system/ctdb_shared_vol',
  237.       'datasetAllocationUnits' => '261888',
  238.       'datasetSize' => '19542032824960',
  239.       'datasetUsed' => '261888',
  240.     ),
  241.     9 =>
  242.     array (
  243.       'datasetIndex' => '9',
  244.       'datasetDescr' => 'tank/.system/rrd-8f179c8648fc4419af075a5cf26c19f8',
  245.       'datasetAllocationUnits' => '32093184',
  246.       'datasetSize' => '19542032824960',
  247.       'datasetUsed' => '32093184',
  248.     ),
  249.     10 =>
  250.     array (
  251.       'datasetIndex' => '10',
  252.       'datasetDescr' => 'tank/<REDACTED>',
  253.       'datasetAllocationUnits' => '2907384516672',
  254.       'datasetSize' => '19542032824960',
  255.       'datasetUsed' => '2907384516672',
  256.     ),
  257.     11 =>
  258.     array (
  259.       'datasetIndex' => '11',
  260.       'datasetDescr' => 'tank/<REDACTED>',
  261.       'datasetAllocationUnits' => '261888',
  262.       'datasetSize' => '19542032824960',
  263.       'datasetUsed' => '261888',
  264.     ),
  265.     12 =>
  266.     array (
  267.       'datasetIndex' => '12',
  268.       'datasetDescr' => 'boot-pool/grub',
  269.       'datasetAllocationUnits' => '8585216',
  270.       'datasetSize' => '95988752384',
  271.       'datasetUsed' => '8585216',
  272.     ),
  273.     13 =>
  274.     array (
  275.       'datasetIndex' => '13',
  276.       'datasetDescr' => 'tank/.system/glusterd',
  277.       'datasetAllocationUnits' => '279744',
  278.       'datasetSize' => '19542032824960',
  279.       'datasetUsed' => '279744',
  280.     ),
  281.     14 =>
  282.     array (
  283.       'datasetIndex' => '14',
  284.       'datasetDescr' => 'boot-pool/ROOT/22.12.1',
  285.       'datasetAllocationUnits' => '2833498112',
  286.       'datasetSize' => '95988752384',
  287.       'datasetUsed' => '2821681152',
  288.     ),
  289.     15 =>
  290.     array (
  291.       'datasetIndex' => '15',
  292.       'datasetDescr' => 'tank/.system/webui',
  293.       'datasetAllocationUnits' => '261888',
  294.       'datasetSize' => '19542032824960',
  295.       'datasetUsed' => '261888',
  296.     ),
  297.     16 =>
  298.     array (
  299.       'datasetIndex' => '16',
  300.       'datasetDescr' => 'tank/.system',
  301.       'datasetAllocationUnits' => '49824192',
  302.       'datasetSize' => '19542032824960',
  303.       'datasetUsed' => '488064',
  304.     ),
  305.     17 =>
  306.     array (
  307.       'datasetIndex' => '17',
  308.       'datasetDescr' => 'tank/.system/syslog-8f179c8648fc4419af075a5cf26c19f8',
  309.       'datasetAllocationUnits' => '14344320',
  310.       'datasetSize' => '19542032824960',
  311.       'datasetUsed' => '14344320',
  312.     ),
  313.   ),
  314. )
  315. Reporting disabled by user setting
  316. array (
  317.   'storage_id' => 670,
  318.   'device_id' => 41,
  319.   'storage_mib' => 'freenas-dataset',
  320.   'storage_index' => '1',
  321.   'storage_type' => 'dataset',
  322.   'storage_descr' => 'tank/.system/cores',
  323.   'storage_size' => 281131513479168,
  324.   'storage_units' => 261888,
  325.   'storage_used' => 281131513479168,
  326.   'storage_free' => 0,
  327.   'storage_perc' => 100,
  328.   'storage_perc_warn' => 60,
  329.   'storage_deleted' => 0,
  330.   'units' => '261888',
  331.   'size' => 281131513479168,
  332.   'free' => 0,
  333.   'used' => 281131513479168,
  334. )
  335. 100% SQL[UPDATE `storage` set `storage_used`=?,`storage_free`=?,`storage_size`=?,`storage_units`=?,`storage_perc`=? WHERE `storage_id` = ? ["281131513479168","0","281131513479168",261888,100,670] 0.36ms]
  336.  
  337.  
  338. Storage tank/.system/samba4: freenas-dataset
  339.  
  340.  
  341.  
  342. array (
  343.   'storage_id' => 671,
  344.   'device_id' => 41,
  345.   'storage_mib' => 'freenas-dataset',
  346.   'storage_index' => '2',
  347.   'storage_type' => 'dataset',
  348.   'storage_descr' => 'tank/.system/samba4',
  349.   'storage_size' => 9223372036854775807,
  350.   'storage_units' => 797568,
  351.   'storage_used' => 9223372036854775807,
  352.   'storage_free' => 0,
  353.   'storage_perc' => 100,
  354.   'storage_perc_warn' => 60,
  355.   'storage_deleted' => 0,
  356.   'units' => '797568',
  357.   'size' => 1.5586100036137697E+19,
  358.   'free' => 0,
  359.   'used' => 1.5586100036137697E+19,
  360. )
  361. 100% SQL[UPDATE `storage` set `storage_used`=?,`storage_free`=?,`storage_size`=?,`storage_units`=?,`storage_perc`=? WHERE `storage_id` = ? ["1.5586100036138E+19","0","1.5586100036138E+19",797568,100,671] 0.19ms]
  362.  
  363.  
  364. Storage tank/.system/services: freenas-dataset
  365.  
  366.  
  367.  
  368. array (
  369.   'storage_id' => 672,
  370.   'device_id' => 41,
  371.   'storage_mib' => 'freenas-dataset',
  372.   'storage_index' => '3',
  373.   'storage_type' => 'dataset',
  374.   'storage_descr' => 'tank/.system/services',
  375.   'storage_size' => 5118101114344931328,
  376.   'storage_units' => 261888,
  377.   'storage_used' => 5118101114344931328,
  378.   'storage_free' => 0,
  379.   'storage_perc' => 100,
  380.   'storage_perc_warn' => 60,
  381.   'storage_deleted' => 0,
  382.   'units' => '261888',
  383.   'size' => 5117823892463124480,
  384.   'free' => 0,
  385.   'used' => 5117823892463124480,
  386. )
  387. 100% SQL[UPDATE `storage` set `storage_used`=?,`storage_free`=?,`storage_size`=?,`storage_units`=?,`storage_perc`=? WHERE `storage_id` = ? ["5117823892463124480","0","5117823892463124480",261888,100,672] 0.37ms]
  388.  
  389.  
  390. Storage tank/.system/configs-8f179c8648fc4419af075a5cf26c19f8: freenas-dataset
  391.  
  392.  
  393.  
  394. array (
  395.   'storage_id' => 673,
  396.   'device_id' => 41,
  397.   'storage_mib' => 'freenas-dataset',
  398.   'storage_index' => '4',
  399.   'storage_type' => 'dataset',
  400.   'storage_descr' => 'tank/.system/configs-8f179c8648fc4419af075a5cf26c19f8',
  401.   'storage_size' => 9223372036854775807,
  402.   'storage_units' => 773760,
  403.   'storage_used' => 9223372036854775807,
  404.   'storage_free' => 0,
  405.   'storage_perc' => 100,
  406.   'storage_perc_warn' => 60,
  407.   'storage_deleted' => 0,
  408.   'units' => '773760',
  409.   'size' => 1.512084331864105E+19,
  410.   'free' => 0,
  411.   'used' => 1.512084331864105E+19,
  412. )
  413. 100% SQL[UPDATE `storage` set `storage_used`=?,`storage_free`=?,`storage_size`=?,`storage_units`=?,`storage_perc`=? WHERE `storage_id` = ? ["1.5120843318641E+19","0","1.5120843318641E+19",773760,100,673] 0.16ms]
  414.  
  415.  
  416. Storage tank/<REDACTED>: freenas-dataset
  417.  
  418.  
  419.  
  420. array (
  421.   'storage_id' => 674,
  422.   'device_id' => 41,
  423.   'storage_mib' => 'freenas-dataset',
  424.   'storage_index' => '5',
  425.   'storage_type' => 'dataset',
  426.   'storage_descr' => 'tank/<REDACTED>',
  427.   'storage_size' => 9223372036854775807,
  428.   'storage_units' => 2147483647,
  429.   'storage_used' => 9223372036854775807,
  430.   'storage_free' => 0,
  431.   'storage_perc' => 100,
  432.   'storage_perc_warn' => 60,
  433.   'storage_deleted' => 0,
  434.   'units' => '654983012928',
  435.   'size' => 1.2799699538430177E+25,
  436.   'free' => 0,
  437.   'used' => 1.2799699538430177E+25,
  438. )
  439. 100% SQL[UPDATE `storage` set `storage_used`=?,`storage_free`=?,`storage_size`=?,`storage_units`=?,`storage_perc`=? WHERE `storage_id` = ? ["1.279969953843E+25","0","1.279969953843E+25",654983012928,100,674] 0.17ms]
  440.  
  441.  
  442. Storage tank: freenas-dataset
  443.  
  444.  
  445.  
  446. array (
  447.   'storage_id' => 675,
  448.   'device_id' => 41,
  449.   'storage_mib' => 'freenas-dataset',
  450.   'storage_index' => '6',
  451.   'storage_type' => 'dataset',
  452.   'storage_descr' => 'tank',
  453.   'storage_size' => 9223372036854775807,
  454.   'storage_units' => 2147483647,
  455.   'storage_used' => 9223372036854775807,
  456.   'storage_free' => 0,
  457.   'storage_perc' => 100,
  458.   'storage_perc_warn' => 60,
  459.   'storage_deleted' => 0,
  460.   'units' => '3562475308416',
  461.   'size' => 6.961800941517497E+25,
  462.   'free' => 0,
  463.   'used' => 6.961800941517497E+25,
  464. )
  465. 100% SQL[UPDATE `storage` set `storage_used`=?,`storage_free`=?,`storage_size`=?,`storage_units`=?,`storage_perc`=? WHERE `storage_id` = ? ["6.9618009415175E+25","0","6.9618009415175E+25",3562475308416,100,675] 0.16ms]
  466.  
  467.  
  468. Storage tank/homes: freenas-dataset
  469.  
  470.  
  471.  
  472. array (
  473.   'storage_id' => 676,
  474.   'device_id' => 41,
  475.   'storage_mib' => 'freenas-dataset',
  476.   'storage_index' => '7',
  477.   'storage_type' => 'dataset',
  478.   'storage_descr' => 'tank/homes',
  479.   'storage_size' => 9223372036854775807,
  480.   'storage_units' => 583296,
  481.   'storage_used' => 9223372036854775807,
  482.   'storage_free' => 0,
  483.   'storage_perc' => 100,
  484.   'storage_perc_warn' => 60,
  485.   'storage_deleted' => 0,
  486.   'units' => '583296',
  487.   'size' => 1.1398789578667868E+19,
  488.   'free' => 0,
  489.   'used' => 1.1398789578667868E+19,
  490. )
  491. 100% SQL[UPDATE `storage` set `storage_used`=?,`storage_free`=?,`storage_size`=?,`storage_units`=?,`storage_perc`=? WHERE `storage_id` = ? ["1.1398789578668E+19","0","1.1398789578668E+19",583296,100,676] 0.15ms]
  492.  
  493.  
  494. Storage tank/.system/ctdb_shared_vol: freenas-dataset
  495.  
  496.  
  497.  
  498. array (
  499.   'storage_id' => 677,
  500.   'device_id' => 41,
  501.   'storage_mib' => 'freenas-dataset',
  502.   'storage_index' => '8',
  503.   'storage_type' => 'dataset',
  504.   'storage_descr' => 'tank/.system/ctdb_shared_vol',
  505.   'storage_size' => 5118101114344931328,
  506.   'storage_units' => 261888,
  507.   'storage_used' => 5118101114344931328,
  508.   'storage_free' => 0,
  509.   'storage_perc' => 100,
  510.   'storage_perc_warn' => 60,
  511.   'storage_deleted' => 0,
  512.   'units' => '261888',
  513.   'size' => 5117823892463124480,
  514.   'free' => 0,
  515.   'used' => 5117823892463124480,
  516. )
  517. 100% SQL[UPDATE `storage` set `storage_used`=?,`storage_free`=?,`storage_size`=?,`storage_units`=?,`storage_perc`=? WHERE `storage_id` = ? ["5117823892463124480","0","5117823892463124480",261888,100,677] 0.25ms]
  518.  
  519.  
  520. Storage tank/.system/rrd-8f179c8648fc4419af075a5cf26c19f8: freenas-dataset
  521.  
  522.  
  523.  
  524. array (
  525.   'storage_id' => 678,
  526.   'device_id' => 41,
  527.   'storage_mib' => 'freenas-dataset',
  528.   'storage_index' => '9',
  529.   'storage_type' => 'dataset',
  530.   'storage_descr' => 'tank/.system/rrd-8f179c8648fc4419af075a5cf26c19f8',
  531.   'storage_size' => 9223372036854775807,
  532.   'storage_units' => 32021760,
  533.   'storage_used' => 9223372036854775807,
  534.   'storage_free' => 0,
  535.   'storage_perc' => 100,
  536.   'storage_perc_warn' => 60,
  537.   'storage_deleted' => 0,
  538.   'units' => '32093184',
  539.   'size' => 6.271660551854811E+20,
  540.   'free' => 0,
  541.   'used' => 6.271660551854811E+20,
  542. )
  543. 100% SQL[UPDATE `storage` set `storage_used`=?,`storage_free`=?,`storage_size`=?,`storage_units`=?,`storage_perc`=? WHERE `storage_id` = ? ["6.2716605518548E+20","0","6.2716605518548E+20",32093184,100,678] 0.23ms]
  544.  
  545.  
  546. Storage tank/<REDACTED>: freenas-dataset
  547.  
  548.  
  549.  
  550. array (
  551.   'storage_id' => 679,
  552.   'device_id' => 41,
  553.   'storage_mib' => 'freenas-dataset',
  554.   'storage_index' => '10',
  555.   'storage_type' => 'dataset',
  556.   'storage_descr' => 'tank/<REDACTED>',
  557.   'storage_size' => 9223372036854775807,
  558.   'storage_units' => 2147483647,
  559.   'storage_used' => 9223372036854775807,
  560.   'storage_free' => 0,
  561.   'storage_perc' => 100,
  562.   'storage_perc_warn' => 60,
  563.   'storage_deleted' => 0,
  564.   'units' => '2907384516672',
  565.   'size' => 5.681620365958469E+25,
  566.   'free' => 0,
  567.   'used' => 5.681620365958469E+25,
  568. )
  569. 100% SQL[UPDATE `storage` set `storage_used`=?,`storage_free`=?,`storage_size`=?,`storage_units`=?,`storage_perc`=? WHERE `storage_id` = ? ["5.6816203659585E+25","0","5.6816203659585E+25",2907384516672,100,679] 0.14ms]
  570.  
  571.  
  572. Storage tank/<REDACTED>: freenas-dataset
  573.  
  574.  
  575.  
  576. array (
  577.   'storage_id' => 680,
  578.   'device_id' => 41,
  579.   'storage_mib' => 'freenas-dataset',
  580.   'storage_index' => '11',
  581.   'storage_type' => 'dataset',
  582.   'storage_descr' => 'tank/<REDACTED>',
  583.   'storage_size' => 5118101114344931328,
  584.   'storage_units' => 261888,
  585.   'storage_used' => 5118101114344931328,
  586.   'storage_free' => 0,
  587.   'storage_perc' => 100,
  588.   'storage_perc_warn' => 60,
  589.   'storage_deleted' => 0,
  590.   'units' => '261888',
  591.   'size' => 5117823892463124480,
  592.   'free' => 0,
  593.   'used' => 5117823892463124480,
  594. )
  595. 100% SQL[UPDATE `storage` set `storage_used`=?,`storage_free`=?,`storage_size`=?,`storage_units`=?,`storage_perc`=? WHERE `storage_id` = ? ["5117823892463124480","0","5117823892463124480",261888,100,680] 0.2ms]
  596.  
  597.  
  598. Storage boot-pool/grub: freenas-dataset
  599.  
  600.  
  601.  
  602. array (
  603.   'storage_id' => 681,
  604.   'device_id' => 41,
  605.   'storage_mib' => 'freenas-dataset',
  606.   'storage_index' => '12',
  607.   'storage_type' => 'dataset',
  608.   'storage_descr' => 'boot-pool/grub',
  609.   'storage_size' => 824084489272557568,
  610.   'storage_units' => 8585216,
  611.   'storage_used' => 824084489272557568,
  612.   'storage_free' => 0,
  613.   'storage_perc' => 100,
  614.   'storage_perc_warn' => 60,
  615.   'storage_deleted' => 0,
  616.   'units' => '8585216',
  617.   'size' => 824084172787154944,
  618.   'free' => 0,
  619.   'used' => 824084172787154944,
  620. )
  621. 100% SQL[UPDATE `storage` set `storage_used`=?,`storage_free`=?,`storage_size`=?,`storage_units`=?,`storage_perc`=? WHERE `storage_id` = ? ["824084172787154944","0","824084172787154944",8585216,100,681] 0.19ms]
  622.  
  623.  
  624. Storage tank/.system/glusterd: freenas-dataset
  625.  
  626.  
  627.  
  628. array (
  629.   'storage_id' => 682,
  630.   'device_id' => 41,
  631.   'storage_mib' => 'freenas-dataset',
  632.   'storage_index' => '13',
  633.   'storage_type' => 'dataset',
  634.   'storage_descr' => 'tank/.system/glusterd',
  635.   'storage_size' => 5467062553959358464,
  636.   'storage_units' => 279744,
  637.   'storage_used' => 5467062553959358464,
  638.   'storage_free' => 0,
  639.   'storage_perc' => 100,
  640.   'storage_perc_warn' => 60,
  641.   'storage_deleted' => 0,
  642.   'units' => '279744',
  643.   'size' => 5466766430585610240,
  644.   'free' => 0,
  645.   'used' => 5466766430585610240,
  646. )
  647. 100% SQL[UPDATE `storage` set `storage_used`=?,`storage_free`=?,`storage_size`=?,`storage_units`=?,`storage_perc`=? WHERE `storage_id` = ? ["5466766430585610240","0","5466766430585610240",279744,100,682] 0.19ms]
  648.  
  649.  
  650. Storage boot-pool/ROOT/22.12.1: freenas-dataset
  651.  
  652.  
  653.  
  654. array (
  655.   'storage_id' => 683,
  656.   'device_id' => 41,
  657.   'storage_mib' => 'freenas-dataset',
  658.   'storage_index' => '14',
  659.   'storage_type' => 'dataset',
  660.   'storage_descr' => 'boot-pool/ROOT/22.12.1',
  661.   'storage_size' => 9223372036854775807,
  662.   'storage_units' => 2147483647,
  663.   'storage_used' => 9223372036854775807,
  664.   'storage_free' => 0,
  665.   'storage_perc' => 100,
  666.   'storage_perc_warn' => 60,
  667.   'storage_deleted' => 0,
  668.   'units' => '2833498112',
  669.   'size' => 2.719839486532995E+20,
  670.   'free' => 0,
  671.   'used' => 2.719839486532995E+20,
  672. )
  673. 100% SQL[UPDATE `storage` set `storage_used`=?,`storage_free`=?,`storage_size`=?,`storage_units`=?,`storage_perc`=? WHERE `storage_id` = ? ["2.719839486533E+20","0","2.719839486533E+20",2833498112,100,683] 0.15ms]
  674.  
  675.  
  676. Storage tank/.system/webui: freenas-dataset
  677.  
  678.  
  679.  
  680. array (
  681.   'storage_id' => 684,
  682.   'device_id' => 41,
  683.   'storage_mib' => 'freenas-dataset',
  684.   'storage_index' => '15',
  685.   'storage_type' => 'dataset',
  686.   'storage_descr' => 'tank/.system/webui',
  687.   'storage_size' => 5118101114344931328,
  688.   'storage_units' => 261888,
  689.   'storage_used' => 5118101114344931328,
  690.   'storage_free' => 0,
  691.   'storage_perc' => 100,
  692.   'storage_perc_warn' => 60,
  693.   'storage_deleted' => 0,
  694.   'units' => '261888',
  695.   'size' => 5117823892463124480,
  696.   'free' => 0,
  697.   'used' => 5117823892463124480,
  698. )
  699. 100% SQL[UPDATE `storage` set `storage_used`=?,`storage_free`=?,`storage_size`=?,`storage_units`=?,`storage_perc`=? WHERE `storage_id` = ? ["5117823892463124480","0","5117823892463124480",261888,100,684] 0.19ms]
  700.  
  701.  
  702. Storage tank/.system: freenas-dataset
  703.  
  704.  
  705.  
  706. array (
  707.   'storage_id' => 686,
  708.   'device_id' => 41,
  709.   'storage_mib' => 'freenas-dataset',
  710.   'storage_index' => '16',
  711.   'storage_type' => 'dataset',
  712.   'storage_descr' => 'tank/.system',
  713.   'storage_size' => 9223372036854775807,
  714.   'storage_units' => 49752768,
  715.   'storage_used' => 9223372036854775807,
  716.   'storage_free' => 0,
  717.   'storage_perc' => 100,
  718.   'storage_perc_warn' => 60,
  719.   'storage_deleted' => 0,
  720.   'units' => '49824192',
  721.   'size' => 9.736659955411094E+20,
  722.   'free' => 0,
  723.   'used' => 9.736659955411094E+20,
  724. )
  725. 100% SQL[UPDATE `storage` set `storage_used`=?,`storage_free`=?,`storage_size`=?,`storage_units`=?,`storage_perc`=? WHERE `storage_id` = ? ["9.7366599554111E+20","0","9.7366599554111E+20",49824192,100,686] 0.2ms]
  726.  
  727.  
  728. Storage tank/.system/syslog-8f179c8648fc4419af075a5cf26c19f8: freenas-dataset
  729.  
  730.  
  731.  
  732. array (
  733.   'storage_id' => 701,
  734.   'device_id' => 41,
  735.   'storage_mib' => 'freenas-dataset',
  736.   'storage_index' => '17',
  737.   'storage_type' => 'dataset',
  738.   'storage_descr' => 'tank/.system/syslog-8f179c8648fc4419af075a5cf26c19f8',
  739.   'storage_size' => 9223372036854775807,
  740.   'storage_units' => 14344320,
  741.   'storage_used' => 9223372036854775807,
  742.   'storage_free' => 0,
  743.   'storage_perc' => 100,
  744.   'storage_perc_warn' => 60,
  745.   'storage_deleted' => 0,
  746.   'units' => '14344320',
  747.   'size' => 2.803171722917302E+20,
  748.   'free' => 0,
  749.   'used' => 2.803171722917302E+20,
  750. )
  751. 100% SQL[UPDATE `storage` set `storage_used`=?,`storage_free`=?,`storage_size`=?,`storage_units`=?,`storage_perc`=? WHERE `storage_id` = ? ["2.8031717229173E+20","0","2.8031717229173E+20",14344320,100,701] 0.15ms]
  752.  
  753.  
  754.  
  755. >> Runtime for poller module 'storage': 0.2281 seconds with 15240 bytes
  756. >> SNMP: [1/0.22s] MySQL: [18/0.04s]
  757. #### Unload poller module storage ####
  758.  
  759.  
  760. Polled in 1.356 seconds
  761. ### Start Device Groups ###
  762. SQL[select * from `device_groups` [] 0.2ms]
  763.  
  764. SQL[select * from `device_group_device` where `device_group_device`.`device_id` = ? [41] 0.21ms]
  765.  
  766. Groups Added:
  767. Groups Removed:
  768. ### End Device Groups, runtime: 0.0023s ###
  769.  
  770. #### Start Alerts ####
  771. SQL[select `device_groups`.*, `device_group_device`.`device_id` as `pivot_device_id`, `device_group_device`.`device_group_id` as `pivot_device_group_id` from `device_groups` inner join `device_group_device` on `device_groups`.`id` = `device_group_device`.`device_group_id` where `device_group_device`.`device_id` = ? [41] 0.23ms]
  772.  
  773. SQL[select * from `locations` where `locations`.`id` = ? limit 1 [13] 0.19ms]
  774.  
  775. SQL[select exists(select * from `alert_schedule` where (`start` &lt;= ? and `end` >= ? and (`recurring` = ? or (`recurring` = ? and ((time(`start`) < time xss=removed> ?) or (time(`start`) > time(`end`) and (time(`start`) &lt;= ? or time(`end`) > ?))) and (`recurring_day` like ? or `recurring_day` is null)))) and (exists (select * from `devices` inner join `alert_schedulables` on `devices`.`device_id` = `alert_schedulables`.`alert_schedulable_id` where `alert_schedule`.`schedule_id` = `alert_schedulables`.`schedule_id` and `alert_schedulables`.`alert_schedulable_type` = ? and `alert_schedulables`.`alert_schedulable_id` = ?) or exists (select * from `locations` inner join `alert_schedulables` on `locations`.`id` = `alert_schedulables`.`alert_schedulable_id` where `alert_schedule`.`schedule_id` = `alert_schedulables`.`schedule_id` and `alert_schedulables`.`alert_schedulable_type` = ? and `alert_schedulables`.`alert_schedulable_id` = ?))) as `exists` ["2023-02-28T14:29:27.635927Z","2023-02-28T14:29:27.635927Z",0,1,"14:29:27","14:29:27","14:29:27","14:29:27","%","device",41,"location",13] 0.42ms]
  776.  
  777. SQL[select * from `devices` where `devices`.`device_id` = ? limit 1 [41] 0.28ms]
  778.  
  779. SQL[SELECT DISTINCT a.* FROM alert_rules a
  780.         LEFT JOIN alert_device_map d ON a.id=d.rule_id AND (a.invert_map = 0 OR a.invert_map = 1 AND d.device_id = ?)
  781.         LEFT JOIN alert_group_map g ON a.id=g.rule_id AND (a.invert_map = 0 OR a.invert_map = 1 AND g.group_id IN (SELECT DISTINCT device_group_id FROM device_group_device WHERE device_id = ?))
  782.         LEFT JOIN alert_location_map l ON a.id=l.rule_id AND (a.invert_map = 0 OR a.invert_map = 1 AND l.location_id IN (SELECT DISTINCT location_id FROM devices WHERE device_id = ?))
  783.         LEFT JOIN devices ld ON l.location_id=ld.location_id AND ld.device_id = ?
  784.         LEFT JOIN device_group_device dg ON g.group_id=dg.device_group_id AND dg.device_id = ?
  785.         WHERE a.disabled = 0 AND (
  786.             (d.device_id IS NULL AND g.group_id IS NULL AND l.location_id IS NULL)
  787.             OR (a.invert_map = 0 AND (d.device_id=? OR dg.device_id=? OR ld.device_id=?))
  788.             OR (a.invert_map = 1  AND (d.device_id != ? OR d.device_id IS NULL) AND (dg.device_id != ? OR dg.device_id IS NULL) AND (ld.device_id != ? OR ld.device_id IS NULL))
  789.         ) [41,41,41,41,41,41,41,41,41,41,41] 0.63ms]
  790.  
  791. Rule #1 (Devices up/down):
  792.  
  793. SQL[SELECT * FROM devices WHERE (devices.device_id = ?) AND (devices.status = 0 && (devices.disabled = 0 && devices.ignore = 0)) = 1 [41] 0.26ms]
  794.  
  795. SQL[SELECT state FROM alerts WHERE rule_id = ? AND device_id = ? ORDER BY id DESC LIMIT 1 [1,41] 0.16ms]
  796.  
  797. Status: NOCHG
  798. Rule #5 (Processor usage over 85%):
  799.  
  800. SQL[SELECT * FROM devices,processors WHERE (devices.device_id = ? AND devices.device_id = processors.device_id) AND processors.processor_usage > 85 AND (devices.status = 1 && (devices.disabled = 0 && devices.ignore = 0)) = 1 [41] 0.27ms]
  801.  
  802. SQL[SELECT state FROM alerts WHERE rule_id = ? AND device_id = ? ORDER BY id DESC LIMIT 1 [5,41] 0.15ms]
  803.  
  804. Status: NOCHG
  805. #### End Alerts ####
  806. ./poller.php <REDACTED> 2023-02-28 14:29:27 - 1 devices polled in 1.471 secs
  807.  
  808. SNMP [4/0.32s]: Snmpget[3/0.10s] Snmpwalk[1/0.22s]
  809. SQL [40/0.11s]: Select[20/0.06s] Insert[1/0.01s] Update[19/0.04s]


Reply to "poller-debug"