I was having this error “Input/output error on /usr/local/………….”
I did a mmdiag –waiters on all the NSD Nodes. There are no issues reported.
# mmlsdisk gpfs0 disk driver sector failure holds holds storage name type size group metadata data status availability pool ------------ -------- ------ ------- -------- ----- ------------- ------------ ------------ dcs3700A_2 nsd 512 4714 yes yes ready down system dcs3700A_3 nsd 512 4715 yes yes ready up system dcs3700A_4 nsd 512 4714 yes yes ready down system dcs3700A_5 nsd 512 4715 yes yes ready up system dcs3700A_6 nsd 512 4714 yes yes ready up system dcs3700A_7 nsd 512 4715 yes yes ready up system dcs3700B_2 nsd 512 4716 yes yes ready up system dcs3700B_3 nsd 512 4717 yes yes ready up system dcs3700B_4 nsd 512 4716 yes yes ready up system dcs3700B_5 nsd 512 4717 yes yes ready up system dcs3700B_6 nsd 512 4716 yes yes ready up system dcs3700B_7 nsd 512 4717 yes yes ready up system
[root@gpfsnsd1]# mmchdisk gpfs0 start -d dcs3700A_2 mmnsddiscover: Attempting to rediscover the disks. This may take a while ... mmnsddiscover: Finished. gpfsnsd6: Rediscovered nsd server access to dcs3700A_2. gpfsnsd5: Rediscovered nsd server access to dcs3700A_2. gpfsnsd10: Rediscovered nsd server access to dcs3700A_2. gpfsnsd9: Rediscovered nsd server access to dcs3700A_2. Scanning file system metadata, phase 1 ... 6 % complete on Wed Apr 27 13:33:47 2016 25 % complete on Wed Apr 27 13:33:50 2016 41 % complete on Wed Apr 27 13:33:53 2016 58 % complete on Wed Apr 27 13:33:56 2016 76 % complete on Wed Apr 27 13:33:59 2016 90 % complete on Wed Apr 27 13:34:02 2016 100 % complete on Wed Apr 27 13:34:04 2016 Scan completed successfully. Scanning file system metadata, phase 2 ... Scan completed successfully. Scanning file system metadata, phase 3 ... Scan completed successfully. Scanning file system metadata, phase 4 ... Scan completed successfully. Scanning user file metadata ... 50.23 % complete on Wed Apr 27 13:34:25 2016 ( 26607616 inodes 38050968 MB) 100.00 % complete on Wed Apr 27 13:34:45 2016 Scan completed successfully.
References:
The Linux Cluster 