EqualLogic commands

diag

grpparams show 

grpparams ftp-service enable 

grpparams ftp-service disable 

member select TOREQPNAST1 show enclosure

member select *membername* show disk - show disk status

member select *membername* show enclosure - show temperature, power supply status etc

member select *membername* show controller - show which controller active passive or failed

member select *membername* show - show everything in general including copy to spare %

account select grpadmin passwd - to change password for grpadmin

S3BEQPX13GRP4(member_S3BEQPX13GRP4T2 eth_0)> show --show eth0 mac adress

---------------------------------------------

Check power cmd

Monday, 23 October, 2023

7:56 PM

vPOD60-FARM4GRP1> member select vPOD60-FARM4GRP1T0 show enc

 

 

_____________________________ Temperature Sensors _____________________________

 

Name                                Value     Normal Range    Status

----------------------------------- --------- --------------- ---------------

Backplane sensor 0                  26        2-45            normal

Backplane sensor 1                  27        2-45            normal

Control module 0 processor          49        10-90           normal

Control module 0 chipset            37        10-70           normal

Control module 1 processor          47        10-90           normal

Control module 1 chipset            33        10-70           normal

Control module 0 SAS Controller     51        10-110          normal

Control module 1 SAS Controller     49        10-110          normal

Control module 0 Battery            28        -5-58           normal

Control module 1 Battery            27        -5-58           normal

 

 

____________________________________ Fans _____________________________________

 

Name                           Speed     Normal Range    Status

------------------------------ --------- --------------- ---------------

Power Cooling Module 0 Fan 0   6270      3500-13500      normal

Power Cooling Module 0 Fan 1   6200      3500-13500      normal

Power Cooling Module 1 Fan 0   6270      3500-13500      normal

Power Cooling Module 1 Fan 1   6270      3500-13500      normal

 

 

_______________________________ Power Supplies ________________________________

 

Name                                     Status   FanStatus       Fw Rev

---------------------------------------- -------- --------------- --------

Power Cooling Module 0                   on       fan-present     00.03.13

Power Cooling Module 1                   on       fan-present     00.03.13

VNX quick commands

Check Faults

[nasadmin@vnx02 ~]$ /nas/sbin/navicli -h spa Faults -list

The array is operating normally.

 

[nasadmin@vnx02c01 ~]$ /nas/sbin/navicli -h spb Faults -list

The array is operating normally.

Collect logs

[nasadmin@vnx02c01 ~]$ /nas/sbin/navicli -h spa spcollect

 

[nasadmin@vnx02c01 ~]$ /nas/sbin/navicli -h spb spcollect

how to get sp collect on VNX

[nasadmin@SYSTEM_NAME ~]$ cd /nas/tools/

[nasadmin@SYSTEM_NAME tools]$ ./.get_spcollect

This script runs spcollect on the storage

Once done can use winscp, copy to laptop

 

how to run support material

/nas/tools/collect_support_materials -getsp

 

Below is the procedure to collect support materials:

1. Login to control station using putty or terminal

2. [nasadmin@ ~]$ cd /nas/tools

3. [nasadmin@ tools]$ ./collect_support_materials

4. [nasadmin@ ~]$ cd /nas/var/emcsupport (location where the support materials are collected)

5. [nasadmin@ emcsupport]$ ll

Attach the latest set of support materials to the service request.

Brocade Quick Command

RECON WORK

#mapsdb --show

#switchshow

CLEAR

#statsclear

#slotstatsclear

Data Domain KB Links

Power Off and Power On to Reboot Data Domain
https://www.dell.com/support/kbdoc/en-my/000019772/power-cycle-reboot-data-domain

Data Domain - Unfail Disk sample

sysadmin@******dd01# disk show state

Enclosure        Disk

  Row(disk-id)    1  2  3  4  5  6  7  8  9  10 11 12

--------------   -------------------------------------

1                 .  .  s  .  .  .  .  .

2                |--------|--------|--------|--------|

                 | Pack 1 | Pack 2 | Pack 3 | Pack 4 |

     E(49-60)    |.  .  s |.  .  . |.  .  . |.  U  . |

     D(37-48)    |.  .  . |.  .  . |.  .  . |.  .  s |

     C(25-36)    |.  .  s |.  .  . |.  .  . |.  .  . |

     B(13-24)    |.  .  . |.  .  . |.  .  . |.  .  . |

     A( 1-12)    |.  .  . |.  .  . |.  .  . |.  .  . |

                 |--------|--------|--------|--------|

--------------   -------------------------------------

 

Legend   State           Count

------   -------------   -----

.        In Use Disks    63

s        Spare Disks     4

U        Unknown Disks   1

------   -------------   -----

Total 68 disks

sysadmin@******dd01# disk unfail 2.59

 

The 'disk unfail' command will add the disk to the active storage tier

and mark it as a spare. Any existing data on this disk will be lost.

        Are you sure? (yes|no) [no]: yes

 

ok, proceeding.

 

sysadmin@******dd01# disk show state

Enclosure        Disk

  Row(disk-id)    1  2  3  4  5  6  7  8  9  10 11 12

--------------   -------------------------------------

1                 .  .  s  .  .  .  .  .

2                |--------|--------|--------|--------|

                 | Pack 1 | Pack 2 | Pack 3 | Pack 4 |

     E(49-60)    |.  .  s |.  .  . |.  .  . |.  s  . |

     D(37-48)    |.  .  . |.  .  . |.  .  . |.  .  s |

     C(25-36)    |.  .  s |.  .  . |.  .  . |.  .  . |

     B(13-24)    |.  .  . |.  .  . |.  .  . |.  .  . |

     A( 1-12)    |.  .  . |.  .  . |.  .  . |.  .  . |

                 |--------|--------|--------|--------|

--------------   -------------------------------------

 

Legend   State          Count

------   ------------   -----

.        In Use Disks   63

s        Spare Disks    5

------   ------------   -----

Total 68 disks

sysadmin@******dd01#

Data Domain - Clearing Alerts

 View all the current alerts, select Health > Alerts > Current Alerts.

Data Domain quick commands

quick commands

************************************************* 

Health checks: 

# sy sh se 

# alert show current 

# disk show state 

# enclosure show summary 

# disk show hardware 

  

•To check active alerts 

----------------------- 

# alerts show current 

# alerts show history    to check history alerts 

  

•Capacity 

---------- 

# df -h 

# storage show all 

# disk show state 

# disk show reliability-data 

# filesys show uptime 

# iostat 2      - To check IOs 

# fi st 

# cifs status 

# nfs status 

# ddboost status 

# fi st 

# fi enable      - to enable file system 

# ddboost enable - to enable file system 

# vtl enable - to enable file system 

# nfs enable - to enable file system 

can use disable to disable all the protocols. 

System settings: 

---------------- 

# system show modelno 

# system show serial 

# system show uptime 

  

Cleaning: 

---------- 

# filesys clean start 

# filesys clean watch 

# filesys clean status 

# filesys clean stop 

  

mtree/quota 

----------- 

# mtree list 

# quota show all  

  

Client connections: 

-------------------- 

# ddboost show connections 

# nfs show clients 

# nfs show active 

# cifs show active 

1. boostsfs 

2. protect point 

  

Users list: 

------------ 

#user show list 

 

Unfail 2.7 

disk beacon 3.57        - to blink the disk 

enclosure beacon 3 - to blink the enclosure 

Data Domain - Power Down Command sample

sysadmin@***dd01# system show serialno

Serial number: XXX00000000000

sysadmin@***dd01# system poweroff

 

The 'system poweroff' command shutdowns the system and turns off the power.

        Are you sure? (yes|no) [no]: yes

 

ok, proceeding.

 

The system is going down.

 

Broadcast message from root (Wed Jan 24 13:22:26 2024):

 

The system is going down for system halt NOW!

sysadmin@***dd01#

sysadmin@***dd01# alerts show current

No active alerts.

sysadmin@***dd01# system upgrade history

Version            Partition   State     Time                Package

                   Number

----------------   ---------   -------   -----------------   ---------

6.1.2.30-615547    1           INSTALL   02/07/19 21:28:54

6.1.2.50-632120    2           UPGRADE   08/05/19 23:39:34   ddr

6.2.1.40-671977    1           UPGRADE   05/13/21 16:02:20   ddr

6.2.1.40-671977    1           UPGRADE   07/18/22 18:28:01   DD-bundle

7.7.2.10-1011249   2           UPGRADE   07/18/22 20:10:02   ddr

7.7.4.0-1017976    1           UPGRADE   03/28/23 19:54:22   ddr

7.7.5.25-1078970   2           UPGRADE   01/10/24 22:04:55   ddr

----------------   ---------   -------   -----------------   ---------

sysadmin@***dd01# ipmi show config

**** This operation is not supported on this platform.

sysadmin@***dd01# enclosure show io-cards

This command may take up to a minute to complete. Please wait...

Enclosure 1

        Slot   Device       FW Revision   Interface   Ports   MAC/WWNN/WWPN/SASADDR

        ----   ----------   -----------   ---------   -----   ---------------------

        M      Intel Corp   21.5.9        10GbE       ethMa   00:0c:29:1c:3e:5b

                                                      ethMb   00:0c:29:1c:3e:6f

                                                      ethMc   00:0c:29:1c:3e:79

                                                      ethMd   00:0c:29:1c:3e:83

        ----   ----------   -----------   ---------   -----   ---------------------

sysadmin@***dd01# enclosure show firmware

Device                    Current Firmware   Required Firmware

-----------------------   ----------------   -----------------

Configure                 7.2.0-1            7.2.0-1

Vulcand                   7.2.0-4            7.2.0-4

Powertools                7.2.0-2            7.2.0-2

iDRAC                     5.10.50.202        5.10.50.202

BIOS                      2.15.1             2.15.1

PERC H730                 25.5.9.0001        25.5.9.0001

Backplane Expander        2.52               2.52

Backplane Non-Expander    4.35               4.35

NIC (Intel X710)          n/a                21.5.9

NIC (Intel X550)          21.5.9             21.5.9

NIC (Broadcom BCM5720)    n/a                22.20.11

NIC (Broadcom BCM57412)   n/a                22.21.07.80

NIC (QLogic QL41112)      n/a                16.00.19

NIC (QLogic QL41164)      n/a                16.00.19

-----------------------   ----------------   -----------------

**   'n/a' - error retrieving data or device not present.

sysadmin@***dd01#

Isilon

#################################################################

#     initial checking command

#################################################################

​​# isi status

# isi services -a | grep -i esrs

# isi_for_array -s ps auwxx | grep -i esrs | grep -v grep

# isi network pools list -v

# isi license list

# isi esrs view

Note the Primary Gateway IP from the output of above command.

# isi_for_array -s 'nc -z <Primary_Gateway_IP> 9443'

# isi_for_array -s 'nc -z <Primary_Gateway_IP> 443'

# isi_for_array -s 'nc -z <Primary_Gateway_IP> 8118'

#################################################################

#     Restart ESRS service

#################################################################

Please run the below command to restart isi_esrs_d and isi_rsapi_d:​

# isi services -a isi_esrs_d disable

# isi services -a isi_rsapi_d disable

After 30 sec run the below:

# isi services -a isi_esrs_d enable

# isi services -a isi_rsapi_d enable

and check #isi esrs view if gateway connectivity  is showing as connected, if not then try the below:

# isi esrs modify --enabled=true --primary-esrs-gateway=x.x.x.x  --gateway-access-pools=x.x --username < customer's support site account> ​

and then check  gateway Connectivity   status and share the output of the above.​

*** isi esrs modify --enabled=true --username=Global_team@email.com --password=*********

----------------------------------------------------------------------------------

Sample Case: SR# 188834247

From the issue description, I understand that the following issue has been detected on cluster A***ISI01-4 .

Critical Events                                   FAIL

  FAIL: Critical event 1049042 for node All: 3 attempts to contact the configured ESRS gateway(s) failed

  FAIL: Critical event 1054478 for node 4: Unhealthy boot disks (data drive containing var1), mirror is degraded or missing components.

  INFO: For more information refer to KB article 000050913 found at https://www.dell.com/support/kbdoc/000050913.

 

As per the latest logs

Before:

 

A***ISI01-4-4]$ cat gmirror_status

                 Name    Status  Components

         mirror/root1  COMPLETE  ada0p5 (ACTIVE)

                                 ada1p5 (ACTIVE)

            mirror/hw  COMPLETE  ada1p14 (ACTIVE)

                                 ada0p14 (ACTIVE)

      mirror/keystore  COMPLETE  ada1p13 (ACTIVE)

                                 ada0p13 (ACTIVE)

mirror/journal-backup  COMPLETE  ada1p12 (ACTIVE)

                                 ada0p12 (ACTIVE)

     mirror/var-crash  COMPLETE  ada1p10 (ACTIVE)

                                 ada0p10 (ACTIVE)

           mirror/mfg  COMPLETE  ada1p8 (ACTIVE)

                                 ada0p8 (ACTIVE)

          mirror/var1  DEGRADED  da34p3 (ACTIVE)

          mirror/var0  COMPLETE  da35p3 (ACTIVE)

                                 da36p3 (ACTIVE)

         mirror/root0  COMPLETE  ada1p4 (ACTIVE)

                                 ada0p4 (ACTIVE)

 

 

Kindly login to Node 4 and at Node 4' prompt run the following command

 

isi_var_migrate --rebalance

 

 

post that check the status of boot partitions 

gmirror status

 

 

After:

A***ISI01-4-4# isi_var_migrate --rebalance

No drives added to var0, 2 copies already exist

Adding ['da32'] to var1

Deleting da33p3

A***ISI01-4# gmirror status

                 Name    Status  Components

         mirror/root1  COMPLETE  ada0p5 (ACTIVE)

                                 ada1p5 (ACTIVE)

            mirror/hw  COMPLETE  ada1p14 (ACTIVE)

                                 ada0p14 (ACTIVE)

      mirror/keystore  COMPLETE  ada1p13 (ACTIVE)

                                 ada0p13 (ACTIVE)

mirror/journal-backup  COMPLETE  ada1p12 (ACTIVE)

                                 ada0p12 (ACTIVE)

     mirror/var-crash  COMPLETE  ada1p10 (ACTIVE)

                                 ada0p10 (ACTIVE)

           mirror/mfg  COMPLETE  ada1p8 (ACTIVE)

                                 ada0p8 (ACTIVE)

          mirror/var1  COMPLETE  da34p3 (ACTIVE)

                                 da32p3 (ACTIVE)

          mirror/var0  COMPLETE  da35p3 (ACTIVE)

                                 da36p3 (ACTIVE)

         mirror/root0  COMPLETE  ada1p4 (ACTIVE)

                                 ada0p4 (ACTIVE)