librenms@librenms:~$ ./discovery.php -d -h <REDACTED> -m storage
LibreNMS Discovery
SQL[select `migration` from `migrations` order by `id` desc limit 1 [] 0.31ms]

SQL[select count(*) as aggregate from `migrations` [] 0.23ms]

SQL[select version() [] 0.21ms]

===========================================
Component | Version
--------- | -------
LibreNMS  | 23.2.0-3-gc0fd1e15e (2023-02-24T12:10:10+00:00)
DB Schema | 2022_08_15_084507_add_rrd_type_to_wireless_sensors_table (248)
PHP       | 8.2.3
Python    | 3.10.6
Database  | MariaDB 10.11.2-MariaDB
RRDTool   | 1.7.2
SNMP      | 5.9.1
===========================================
DEBUG!
Updating os_def.cache
Override discovery modules: storage
SQL[SELECT * FROM `devices` WHERE disabled = 0 AND `hostname` LIKE '<REDACTED>' ORDER BY device_id DESC [] 0.62ms]

SQL[select * from `devices` where `device_id` = ? limit 1 [41] 0.3ms]

SQL[select * from `devices_attribs` where `devices_attribs`.`device_id` = ? and `devices_attribs`.`device_id` is not null [41] 0.23ms]

<REDACTED> 41 truenas [FPING] '/usr/bin/fping' '-e' '-q' '-c' '3' '-p' '500' '-t' '500' '-O' '0' '<REDACTED>'

response: xmt/rcv/%loss = 3/3/0%, min/avg/max = 3.58/6.33/9.74
SNMP['/usr/bin/snmpget' '-M' '/opt/librenms/mibs:/opt/librenms/mibs/ixsystems' '-v3' '-l' 'authPriv' '-n' "" '-x' 'AES' '-X' 'PASSWORD' '-a' 'SHA' '-A' 'PASSWORD' '-u' 'USER' '-OQXUte' 'udp:HOSTNAME:161' 'SNMPv2-MIB::sysObjectID.0']
SNMPv2-MIB::sysObjectID.0 = SNMPv2-SMI::enterprises.50536.3.1


Modules status: Global+
OS
Device

#### Load disco module core ####
Attempting to initialize OS: truenas
OS initialized as Generic
SNMP['/usr/bin/snmpget' '-M' '/opt/librenms/mibs:/opt/librenms/mibs/ixsystems' '-v3' '-l' 'authPriv' '-n' "" '-x' 'AES' '-X' 'PASSWORD' '-a' 'SHA' '-A' 'PASSWORD' '-u' 'USER' '-OQXUte' '-On' 'udp:HOSTNAME:161' 'SNMPv2-MIB::sysObjectID.0' 'SNMPv2-MIB::sysDescr.0' 'SNMPv2-MIB::sysName.0']
.*.*.0 = .*.4.1.50536.3.1
.*.*.0 = TrueNAS-SCALE-22.12.1. Hardware: x86_64 Intel(R) Atom(TM) CPU  C2758  @ 2.40GHz. Software: Linux 5.15.79+truenas (revision #1 SMP Fri Feb 17 21:41:41 UTC 2023)
.*.*.0 = <REDACTED>


| TrueNAS-SCALE-22.12.1. Hardware: x86_64 Intel(R) Atom(TM) CPU  C2758  @ 2.40GHz. Software: Linux 5.15.79+truenas (revision #1 SMP Fri Feb 17 21:41:41 UTC 2023) | .1.3.6.1.4.1.50536.3.1 |

OS: TrueNAS (truenas)

Attempting to initialize OS: truenas
OS initialized as Generic

>> Runtime for discovery module 'core': 0.0260 seconds with 227736 bytes
>> SNMP: [1/0.02s] MySQL: [0/0.00s] RRD: [0/0.00s]
#### Unload disco module core ####

Modules status: Global+
OS
Device

#### Load disco module storage ####
SNMP['/usr/bin/snmpbulkwalk' '-v3' '-l' 'authPriv' '-n' "" '-a' 'SHA' '-A' 'PASSWORD' '-u' 'USER' '-x' 'AES' '-X' 'PASSWORD' '-OQUs' '-m' 'IBM-AIX-MIB' '-M' '/opt/librenms/mibs:/opt/librenms/mibs/ixsystems' 'udp:HOSTNAME:161' 'aixFsTableEntry']
Exitcode: 1
MIB search path: /opt/librenms/mibs:/opt/librenms/mibs/ixsystems
Cannot find module (IBM-AIX-MIB): At line 1 in (none)
aixFsTableEntry: Unknown Object Identifier (Sub-id not found: (top) -> aixFsTableEntry)

MIB search path: /opt/librenms/mibs:/opt/librenms/mibs/ixsystems
Cannot find module (IBM-AIX-MIB): At line 1 in (none)
aixFsTableEntry: Unknown Object Identifier (Sub-id not found: (top) -> aixFsTableEntry)
aix_filesystem : SNMP['/usr/bin/snmpbulkwalk' '-v3' '-l' 'authPriv' '-n' "" '-a' 'SHA' '-A' 'PASSWORD' '-u' 'USER' '-x' 'AES' '-X' 'PASSWORD' '-OQUs' '-m' 'DATA-DOMAIN-MIB' '-M' '/opt/librenms/mibs:/opt/librenms/mibs/ixsystems:/opt/librenms/mibs/datadomain' 'udp:HOSTNAME:161' 'fileSystemSpaceTable']
fileSystemSpaceTable = No Such Object available on this agent at this OID

Invalid snmp_walk() data = fileSystemSpaceTable = No Such Object available on this agent at this OID
SNMP['/usr/bin/snmpbulkwalk' '-v3' '-l' 'authPriv' '-n' "" '-a' 'SHA' '-A' 'PASSWORD' '-u' 'USER' '-x' 'AES' '-X' 'PASSWORD' '-OQUs' '-m' 'FREENAS-MIB' '-M' '/opt/librenms/mibs:/opt/librenms/mibs/ixsystems' 'udp:HOSTNAME:161' 'datasetTable']
datasetIndex.1 = 1
datasetIndex.2 = 2
datasetIndex.3 = 3
datasetIndex.4 = 4
datasetIndex.5 = 5
datasetIndex.6 = 6
datasetIndex.7 = 7
datasetIndex.8 = 8
datasetIndex.9 = 9
datasetIndex.10 = 10
datasetIndex.11 = 11
datasetIndex.12 = 12
datasetIndex.13 = 13
datasetIndex.14 = 14
datasetIndex.15 = 15
datasetIndex.16 = 16
datasetIndex.17 = 17
datasetDescr.1 = tank/.system/cores
datasetDescr.2 = tank/.system/samba4
datasetDescr.3 = tank/.system/services
datasetDescr.4 = tank/.system/configs-8f179c8648fc4419af075a5cf26c19f8
datasetDescr.5 = tank/<REDACTED>
datasetDescr.6 = tank
datasetDescr.7 = tank/homes
datasetDescr.8 = tank/.system/ctdb_shared_vol
datasetDescr.9 = tank/.system/rrd-8f179c8648fc4419af075a5cf26c19f8
datasetDescr.10 = tank/<REDACTED>
datasetDescr.11 = tank/<REDACTED>
datasetDescr.12 = boot-pool/grub
datasetDescr.13 = tank/.system/glusterd
datasetDescr.14 = boot-pool/ROOT/22.12.1
datasetDescr.15 = tank/.system/webui
datasetDescr.16 = tank/.system
datasetDescr.17 = tank/.system/syslog-8f179c8648fc4419af075a5cf26c19f8
datasetAllocationUnits.1 = 261888
datasetAllocationUnits.2 = 797568
datasetAllocationUnits.3 = 261888
datasetAllocationUnits.4 = 773760
datasetAllocationUnits.5 = 602277814848
datasetAllocationUnits.6 = 3460047376128
datasetAllocationUnits.7 = 583296
datasetAllocationUnits.8 = 261888
datasetAllocationUnits.9 = 32009856
datasetAllocationUnits.10 = 2857662449088
datasetAllocationUnits.11 = 261888
datasetAllocationUnits.12 = 8585216
datasetAllocationUnits.13 = 279744
datasetAllocationUnits.14 = 2833498112
datasetAllocationUnits.15 = 261888
datasetAllocationUnits.16 = 49693248
datasetAllocationUnits.17 = 14296704
datasetSize.1 = 1073479936
datasetSize.2 = 19644460757248
datasetSize.3 = 19644460757248
datasetSize.4 = 19644460757248
datasetSize.5 = 19644460757248
datasetSize.6 = 19644460757248
datasetSize.7 = 19644460757248
datasetSize.8 = 19644460757248
datasetSize.9 = 19644460757248
datasetSize.10 = 19644460757248
datasetSize.11 = 19644460757248
datasetSize.12 = 95988789248
datasetSize.13 = 19644460757248
datasetSize.14 = 95988789248
datasetSize.15 = 19644460757248
datasetSize.16 = 19644460757248
datasetSize.17 = 19644460757248
datasetUsed.1 = 261888
datasetUsed.2 = 797568
datasetUsed.3 = 261888
datasetUsed.4 = 773760
datasetUsed.5 = 602277814848
datasetUsed.6 = 380928
datasetUsed.7 = 583296
datasetUsed.8 = 261888
datasetUsed.9 = 32009856
datasetUsed.10 = 2857662449088
datasetUsed.11 = 261888
datasetUsed.12 = 8585216
datasetUsed.13 = 279744
datasetUsed.14 = 2821681152
datasetUsed.15 = 261888
datasetUsed.16 = 488064
datasetUsed.17 = 14296704

SQL[SELECT `storage_descr` FROM `storage` WHERE `device_id`  = '41' AND `storage_type` != 'dataset' [] 0.52ms]

Reporting disabled by user setting
Discover Storage: 1, dataset, freenas-dataset, tank/.system/cores, 281131513479168, 261888, 281131513479168
SQL[SELECT * FROM `storage` WHERE `storage_index` = ? AND `device_id` = ? AND `storage_mib` = ? [1,41,"freenas-dataset"] 0.29ms]

SQL[UPDATE `storage` set `storage_descr`=?,`storage_type`=?,`storage_units`=?,`storage_size`=? WHERE `device_id` = ? AND `storage_index` = ? AND `storage_mib` = ? ["tank\/.system\/cores","dataset","261888",281131513479168,41,1,"freenas-dataset"] 0.22ms]

.Discover Storage: 2, dataset, freenas-dataset, tank/.system/samba4, 1.5667793277237E+19, 797568, 1.5667793277237E+19
SQL[SELECT * FROM `storage` WHERE `storage_index` = ? AND `device_id` = ? AND `storage_mib` = ? [2,41,"freenas-dataset"] 0.22ms]

SQL[UPDATE `storage` set `storage_descr`=?,`storage_type`=?,`storage_units`=?,`storage_size`=? WHERE `device_id` = ? AND `storage_index` = ? AND `storage_mib` = ? ["tank\/.system\/samba4","dataset","797568",1.5667793277236773e+19,41,2,"freenas-dataset"] 0.18ms]

.Discover Storage: 3, dataset, freenas-dataset, tank/.system/services, 5144648538794164224, 261888, 5144648538794164224
SQL[SELECT * FROM `storage` WHERE `storage_index` = ? AND `device_id` = ? AND `storage_mib` = ? [3,41,"freenas-dataset"] 0.22ms]

SQL[UPDATE `storage` set `storage_descr`=?,`storage_type`=?,`storage_units`=?,`storage_size`=? WHERE `device_id` = ? AND `storage_index` = ? AND `storage_mib` = ? ["tank\/.system\/services","dataset","261888",5144648538794164224,41,3,"freenas-dataset"] 0.28ms]

UDiscover Storage: 4, dataset, freenas-dataset, tank/.system/configs-8f179c8648fc4419af075a5cf26c19f8, 1.5200097955528E+19, 773760, 1.5200097955528E+19
SQL[SELECT * FROM `storage` WHERE `storage_index` = ? AND `device_id` = ? AND `storage_mib` = ? [4,41,"freenas-dataset"] 0.21ms]

SQL[UPDATE `storage` set `storage_descr`=?,`storage_type`=?,`storage_units`=?,`storage_size`=? WHERE `device_id` = ? AND `storage_index` = ? AND `storage_mib` = ? ["tank\/.system\/configs-8f179c8648fc4419af075a5cf26c19f8","dataset","773760",1.5200097955528212e+19,41,4,"freenas-dataset"] 0.18ms]

.Discover Storage: 5, dataset, freenas-dataset, tank/<REDACTED>, 1.1831422898743E+25, 602277814848, 1.1831422898743E+25
SQL[SELECT * FROM `storage` WHERE `storage_index` = ? AND `device_id` = ? AND `storage_mib` = ? [5,41,"freenas-dataset"] 0.2ms]

SQL[UPDATE `storage` set `storage_descr`=?,`storage_type`=?,`storage_units`=?,`storage_size`=? WHERE `device_id` = ? AND `storage_index` = ? AND `storage_mib` = ? ["tank\/<REDACTED>","dataset","602277814848",1.1831422898742613e+25,41,5,"freenas-dataset"] 0.17ms]

.Discover Storage: 6, dataset, freenas-dataset, tank, 6.7970764898565E+25, 3460047376128, 6.7970764898565E+25
SQL[SELECT * FROM `storage` WHERE `storage_index` = ? AND `device_id` = ? AND `storage_mib` = ? [6,41,"freenas-dataset"] 0.22ms]

SQL[UPDATE `storage` set `storage_descr`=?,`storage_type`=?,`storage_units`=?,`storage_size`=? WHERE `device_id` = ? AND `storage_index` = ? AND `storage_mib` = ? ["tank","dataset","3460047376128",6.7970764898565406e+25,41,6,"freenas-dataset"] 0.17ms]

.Discover Storage: 7, dataset, freenas-dataset, tank/homes, 1.145853538186E+19, 583296, 1.145853538186E+19
SQL[SELECT * FROM `storage` WHERE `storage_index` = ? AND `device_id` = ? AND `storage_mib` = ? [7,41,"freenas-dataset"] 0.2ms]

SQL[UPDATE `storage` set `storage_descr`=?,`storage_type`=?,`storage_units`=?,`storage_size`=? WHERE `device_id` = ? AND `storage_index` = ? AND `storage_mib` = ? ["tank\/homes","dataset","583296",1.145853538185973e+19,41,7,"freenas-dataset"] 0.17ms]

.Discover Storage: 8, dataset, freenas-dataset, tank/.system/ctdb_shared_vol, 5144648538794164224, 261888, 5144648538794164224
SQL[SELECT * FROM `storage` WHERE `storage_index` = ? AND `device_id` = ? AND `storage_mib` = ? [8,41,"freenas-dataset"] 0.2ms]

SQL[UPDATE `storage` set `storage_descr`=?,`storage_type`=?,`storage_units`=?,`storage_size`=? WHERE `device_id` = ? AND `storage_index` = ? AND `storage_mib` = ? ["tank\/.system\/ctdb_shared_vol","dataset","261888",5144648538794164224,41,8,"freenas-dataset"] 0.23ms]

UDiscover Storage: 9, dataset, freenas-dataset, tank/.system/rrd-8f179c8648fc4419af075a5cf26c19f8, 6.2881636003716E+20, 32009856, 6.2881636003716E+20
SQL[SELECT * FROM `storage` WHERE `storage_index` = ? AND `device_id` = ? AND `storage_mib` = ? [9,41,"freenas-dataset"] 0.21ms]

SQL[UPDATE `storage` set `storage_descr`=?,`storage_type`=?,`storage_units`=?,`storage_size`=? WHERE `device_id` = ? AND `storage_index` = ? AND `storage_mib` = ? ["tank\/.system\/rrd-8f179c8648fc4419af075a5cf26c19f8","dataset","32009856",6.288163600371594e+20,41,9,"freenas-dataset"] 0.22ms]

UDiscover Storage: 10, dataset, freenas-dataset, tank/<REDACTED>, 5.613723783857E+25, 2857662449088, 5.613723783857E+25
SQL[SELECT * FROM `storage` WHERE `storage_index` = ? AND `device_id` = ? AND `storage_mib` = ? [10,41,"freenas-dataset"] 0.22ms]

SQL[UPDATE `storage` set `storage_descr`=?,`storage_type`=?,`storage_units`=?,`storage_size`=? WHERE `device_id` = ? AND `storage_index` = ? AND `storage_mib` = ? ["tank\/<REDACTED>","dataset","2857662449088",5.613723783857043e+25,41,10,"freenas-dataset"] 0.17ms]

.Discover Storage: 11, dataset, freenas-dataset, tank/<REDACTED>, 5144648538794164224, 261888, 5144648538794164224
SQL[SELECT * FROM `storage` WHERE `storage_index` = ? AND `device_id` = ? AND `storage_mib` = ? [11,41,"freenas-dataset"] 0.21ms]

SQL[UPDATE `storage` set `storage_descr`=?,`storage_type`=?,`storage_units`=?,`storage_size`=? WHERE `device_id` = ? AND `storage_index` = ? AND `storage_mib` = ? ["tank\/<REDACTED>","dataset","261888",5144648538794164224,41,11,"freenas-dataset"] 0.23ms]

UDiscover Storage: 12, dataset, freenas-dataset, boot-pool/grub, 824084489272557568, 8585216, 824084489272557568
SQL[SELECT * FROM `storage` WHERE `storage_index` = ? AND `device_id` = ? AND `storage_mib` = ? [12,41,"freenas-dataset"] 0.21ms]

SQL[UPDATE `storage` set `storage_descr`=?,`storage_type`=?,`storage_units`=?,`storage_size`=? WHERE `device_id` = ? AND `storage_index` = ? AND `storage_mib` = ? ["boot-pool\/grub","dataset","8585216",824084489272557568,41,12,"freenas-dataset"] 0.17ms]

.Discover Storage: 13, dataset, freenas-dataset, tank/.system/glusterd, 5495420030075584512, 279744, 5495420030075584512
SQL[SELECT * FROM `storage` WHERE `storage_index` = ? AND `device_id` = ? AND `storage_mib` = ? [13,41,"freenas-dataset"] 0.2ms]

SQL[UPDATE `storage` set `storage_descr`=?,`storage_type`=?,`storage_units`=?,`storage_size`=? WHERE `device_id` = ? AND `storage_index` = ? AND `storage_mib` = ? ["tank\/.system\/glusterd","dataset","279744",5495420030075584512,41,13,"freenas-dataset"] 0.24ms]

UDiscover Storage: 14, dataset, freenas-dataset, boot-pool/ROOT/22.12.1, 2.7198405310737E+20, 2833498112, 2.7198405310737E+20
SQL[SELECT * FROM `storage` WHERE `storage_index` = ? AND `device_id` = ? AND `storage_mib` = ? [14,41,"freenas-dataset"] 0.2ms]

SQL[UPDATE `storage` set `storage_descr`=?,`storage_type`=?,`storage_units`=?,`storage_size`=? WHERE `device_id` = ? AND `storage_index` = ? AND `storage_mib` = ? ["boot-pool\/ROOT\/22.12.1","dataset","2833498112",2.719840531073739e+20,41,14,"freenas-dataset"] 0.17ms]

.Discover Storage: 15, dataset, freenas-dataset, tank/.system/webui, 5144648538794164224, 261888, 5144648538794164224
SQL[SELECT * FROM `storage` WHERE `storage_index` = ? AND `device_id` = ? AND `storage_mib` = ? [15,41,"freenas-dataset"] 0.2ms]

SQL[UPDATE `storage` set `storage_descr`=?,`storage_type`=?,`storage_units`=?,`storage_size`=? WHERE `device_id` = ? AND `storage_index` = ? AND `storage_mib` = ? ["tank\/.system\/webui","dataset","261888",5144648538794164224,41,15,"freenas-dataset"] 0.23ms]

UDiscover Storage: 16, dataset, freenas-dataset, tank/.system, 9.7619706023619E+20, 49693248, 9.7619706023619E+20
SQL[SELECT * FROM `storage` WHERE `storage_index` = ? AND `device_id` = ? AND `storage_mib` = ? [16,41,"freenas-dataset"] 0.21ms]

SQL[UPDATE `storage` set `storage_descr`=?,`storage_type`=?,`storage_units`=?,`storage_size`=? WHERE `device_id` = ? AND `storage_index` = ? AND `storage_mib` = ? ["tank\/.system","dataset","49693248",9.761970602361926e+20,41,16,"freenas-dataset"] 0.22ms]

UDiscover Storage: 17, dataset, freenas-dataset, tank/.system/syslog-8f179c8648fc4419af075a5cf26c19f8, 2.8085104068599E+20, 14296704, 2.8085104068599E+20
SQL[SELECT * FROM `storage` WHERE `storage_index` = ? AND `device_id` = ? AND `storage_mib` = ? [17,41,"freenas-dataset"] 0.2ms]

SQL[UPDATE `storage` set `storage_descr`=?,`storage_type`=?,`storage_units`=?,`storage_size`=? WHERE `device_id` = ? AND `storage_index` = ? AND `storage_mib` = ? ["tank\/.system\/syslog-8f179c8648fc4419af075a5cf26c19f8","dataset","14296704",2.808510406859905e+20,41,17,"freenas-dataset"] 0.17ms]

.SNMP['/usr/bin/snmpbulkwalk' '-v3' '-l' 'authPriv' '-n' "" '-a' 'SHA' '-A' 'PASSWORD' '-u' 'USER' '-x' 'AES' '-X' 'PASSWORD' '-OQUs' '-m' 'FREENAS-MIB' '-M' '/opt/librenms/mibs:/opt/librenms/mibs/ixsystems' 'udp:HOSTNAME:161' 'zpoolTable']
zpoolIndex.1 = 1
zpoolIndex.2 = 2
zpoolDescr.1 = boot-pool
zpoolDescr.2 = tank
zpoolAllocationUnits.1 = "ONLINE"
zpoolAllocationUnits.2 = "ONLINE"
zpoolSize.1 = 57017
zpoolSize.2 = 2155925
zpoolUsed.1 = 582787
zpoolUsed.2 = 149106024
zpoolAvailable.1 = 606175232
zpoolAvailable.2 = 331025756160
zpoolHealth.1 = 5253480448
zpoolHealth.2 = 7532888367104
zpoolReadOps.1 = 16
zpoolReadOps.2 = 20
zpoolWriteOps.1 = 0
zpoolWriteOps.2 = 14751
zpoolReadBytes.1 = 409600
zpoolReadBytes.2 = 102400
zpoolWriteBytes.1 = 0
zpoolWriteBytes.2 = 841232384

SQL[SELECT `storage_descr` FROM `storage` WHERE `device_id`  = '41' AND `storage_type` != 'zpool' [] 0.56ms]

Error discovering storage module for <REDACTED>. TypeError: Unsupported operand types: string * string in /opt/librenms/includes/discovery/storage/freenas-zpool.inc.php:13
Stack trace:
#0 /opt/librenms/includes/include-dir.inc.php(6): include()
#1 /opt/librenms/includes/discovery/storage.inc.php(7): require('...')
#2 /opt/librenms/includes/discovery/functions.inc.php(153): include('...')
#3 /opt/librenms/discovery.php(106): discover_device()
#4 {main}
SQL[insert into `eventlog` (`reference`, `type`, `datetime`, `severity`, `message`, `username`, `device_id`) values (?, ?, ?, ?, ?, ?, ?) [null,"discovery","2023-02-28 13:28:55",5,"Error discovering storage module. Check log file for more details.","",41] 0.4ms]

Unsupported operand types: string * string {"exception":"[object] (TypeError(code: 0): Unsupported operand types: string * string at /opt/librenms/includes/discovery/storage/freenas-zpool.inc.php:13)"}

>> Runtime for discovery module 'storage': 0.4170 seconds with 576432 bytes
>> SNMP: [4/0.40s] MySQL: [37/0.09s] RRD: [0/0.00s]
#### Unload disco module storage ####

SQL[UPDATE `devices` set `last_discovered`=NOW(),`last_discovered_timetaken`=? WHERE `device_id` = ? [1.484,41] 0.33ms]

Discovered in 1.484 seconds

./discovery.php <REDACTED> 2023-02-28 13:28:55 - 1 devices discovered in 1.591 secs

SNMP [6/0.45s]: Snmpget[2/0.05s] Snmpwalk[4/0.40s]
SQL [45/0.11s]: Select[26/0.07s] Update[18/0.04s] Insert[1/0.00s]
RRD [0/0.00s]: