SUMMARY: X4500 disks missing on boot

From: Chris Banal <banal_at_rhythm.com>
Date: Fri May 01 2009 - 14:06:44 EDT
After jumping through many patch/firmware hoops with Sun support. The 
motherboard was replaced and we haven't seen any additional problems. We 
also re-loaded the original patch set and still have not seen any issues.
 

Thank you,
Chris Banal


Chris Banal wrote:
> We received a refurbished X4500 yesterday and right from power up have 
> been seeing disks appear and disappear between reboots. The disks that 
> go missing can sometimes be the same disks a few times in a row but 
> are not always the same disks after several reboots. It is usually 2 - 
> 4 disks out of the 48. When doing a verbose boot I can clearly see a 
> long pause where the drive detection times out but no errors are 
> reported. The ILOM shows the drives as "[Present][Hot Spare]".
>
> The only message in the ILOM event log that appears to be related is 
> similar to the following:
>
> ID = 45 : 04/23/2009 : 11:55:26 : Drive Slot : hdd15.state : Hot Spare
>
> We're running a patched version of Sol10U4 which is the same revision 
> on 4 other X4500 which aren't having any trouble.
>
> We're opening a call with Sun Support as well since this is most 
> likely a hardware issue but any help you could provide would be very 
> much appreciated. Below is an example of the zpool status output.
>
>
> # zpool status
>  pool: a
> state: DEGRADED
> status: One or more devices could not be opened.  Sufficient replicas 
> exist for
>        the pool to continue functioning in a degraded state.
> action: Attach the missing device and online it using 'zpool online'.
>   see: http://www.sun.com/msg/ZFS-8000-D3
> scrub: resilver completed with 0 errors on Thu Apr 23 11:54:55 2009
> config:
>
>        NAME        STATE     READ WRITE CKSUM
>        a           DEGRADED     0     0     0
>          mirror    ONLINE       0     0     0
>            c0t0d0  ONLINE       0     0     0
>            c1t0d0  ONLINE       0     0     0
> ... snip ...
>            c1t5d0  ONLINE       0     0     0
>          mirror    DEGRADED     0     0     0
>            c4t5d0  UNAVAIL      0     0     0  cannot open
>            c5t5d0  ONLINE       0     0     0
>          mirror    ONLINE       0     0     0
>            c6t5d0  ONLINE       0     0     0
>            c7t5d0  ONLINE       0     0     0
>          mirror    ONLINE       0     0     0
>            c0t6d0  ONLINE       0     0     0
>            c1t6d0  ONLINE       0     0     0
>          mirror    ONLINE       0     0     0
>            c4t6d0  ONLINE       0     0     0
>            c5t6d0  ONLINE       0     0     0
>          mirror    ONLINE       0     0     0
>            c6t6d0  ONLINE       0     0     0
>            c7t6d0  ONLINE       0     0     0
>          mirror    ONLINE       0     0     0
>            c0t7d0  ONLINE       0     0     0
>            c1t7d0  ONLINE       0     0     0
>          mirror    DEGRADED     0     0     0
>            c4t7d0  UNAVAIL      0     0     0  cannot open
>            c5t7d0  ONLINE       0     0     0
>        spares
>          c6t7d0    AVAIL
>          c7t7d0    AVAIL
>
> errors: No known data errors
>
>
> # ./hd
>
> platform = Sun Fire X4500
>
>
> Device    Serial        Vendor   Model             Rev  Temperature
> ------    ------        ------   -----             ---- -----------
> c0t0d0p0  XXXXXXXXXXX  ATA      HITACHI HDS7250S  AV0A 36 C (96 F)
> c0t1d0p0  XXXXXXXXXXX  ATA      HITACHI HDS7250S  AV0A 38 C (100 F)
> c0t2d0p0  XXXXXXXXXXX  ATA      HITACHI HDS7250S  AV0A 39 C (102 F)
> c0t3d0p0  XXXXXXXXXXX  ATA      HITACHI HDS7250S  AV0A 41 C (105 F)
> c0t4d0p0  XXXXXXXXXXX  ATA      HITACHI HDS7250S  AV0A 37 C (98 F)
> c0t5d0p0  XXXXXXXXXXX  ATA      HITACHI HDS7250S  AV0A 39 C (102 F)
> c0t6d0p0  XXXXXXXXXXX  ATA      HITACHI HDS7250S  AV0A 40 C (104 F)
> c0t7d0p0  XXXXXXXXXXX  ATA      HITACHI HDS7250S  AV0A 42 C (107 F)
> c1t0d0p0  XXXXXXXXXXX  ATA      HITACHI HDS7250S  AV0A 36 C (96 F)
> c1t1d0p0  XXXXXXXXXXX  ATA      HITACHI HDS7250S  AV0A 39 C (102 F)
> c1t2d0p0  XXXXXXXXXXX  ATA      HITACHI HDS7250S  AV0A 40 C (104 F)
> c1t3d0p0  XXXXXXXXXXX  ATA      HITACHI HDS7250S  AV0A 41 C (105 F)
> c1t4d0p0  XXXXXXXXXXX  ATA      HITACHI HDS7250S  AV0A 36 C (96 F)
> c1t5d0p0  XXXXXXXXXXX  ATA      HITACHI HDS7250S  AV0A 38 C (100 F)
> c1t6d0p0  XXXXXXXXXXX  ATA      HITACHI HDS7250S  AV0A 39 C (102 F)
> c1t7d0p0  XXXXXXXXXXX  ATA      HITACHI HDS7250S  AV0A 41 C (105 F)
> c4t0d0p0  XXXXXXXXXXX  ATA      HITACHI HDS7250S  AV0A 37 C (98 F)
> c4t1d0p0  XXXXXXXXXXX  ATA      HITACHI HDS7250S  AV0A 38 C (100 F)
> c4t2d0p0  XXXXXXXXXXX  ATA      HITACHI HDS7250S  AV0A 40 C (104 F)
> c4t3d0p0  XXXXXXXXXXX  ATA      HITACHI HDS7250S  AV0A 42 C (107 F)
> c4t4d0p0  XXXXXXXXXXX  ATA      HITACHI HDS7250S  AV0A 36 C (96 F)
> c4t6d0p0  XXXXXXXXXXX  ATA      HITACHI HDS7250S  AV0A 41 C (105 F)
> c5t0d0p0  XXXXXXXXXXX  ATA      HITACHI HDS7250S  AV0A 37 C (98 F)
> c5t1d0p0  XXXXXXXXXXX  ATA      HITACHI HDS7250S  AV0A 39 C (102 F)
> c5t2d0p0  XXXXXXXXXXX  ATA      HITACHI HDS7250S  AV0A 41 C (105 F)
> c5t3d0p0  XXXXXXXXXXX  ATA      HITACHI HDS7250S  AV0A 42 C (107 F)
> c5t4d0p0  XXXXXXXXXXX  ATA      HITACHI HDS7250S  AV0A 37 C (98 F)
> c5t5d0p0  XXXXXXXXXXX  ATA      HITACHI HDS7250S  AV0A 38 C (100 F)
> c5t6d0p0  XXXXXXXXXXX  ATA      HITACHI HDS7250S  AV0A 40 C (104 F)
> c5t7d0p0  XXXXXXXXXXX  ATA      HITACHI HDS7250S  AV0A 42 C (107 F)
> c6t0d0p0  XXXXXXXXXXX  ATA      HITACHI HDS7250S  AV0A 36 C (96 F)
> c6t1d0p0  XXXXXXXXXXX  ATA      HITACHI HDS7250S  AV0A 38 C (100 F)
> c6t2d0p0  XXXXXXXXXXX  ATA      HITACHI HDS7250S  AV0A 39 C (102 F)
> c6t3d0p0  XXXXXXXXXXX  ATA      HITACHI HDS7250S  AV0A 41 C (105 F)
> c6t4d0p0  XXXXXXXXXXX  ATA      HITACHI HDS7250S  AV0A 36 C (96 F)
> c6t5d0p0  XXXXXXXXXXX  ATA      HITACHI HDS7250S  AV0A 38 C (100 F)
> c6t6d0p0  XXXXXXXXXXX  ATA      HITACHI HDS7250S  AV0A 39 C (102 F)
> c6t7d0p0  XXXXXXXXXXX  ATA      HITACHI HDS7250S  AV0A 40 C (104 F)
> c7t0d0p0  XXXXXXXXXXX  ATA      HITACHI HDS7250S  AV0A 37 C (98 F)
> c7t1d0p0  XXXXXXXXXXX  ATA      HITACHI HDS7250S  AV0A 38 C (100 F)
> c7t2d0p0  XXXXXXXXXXX  ATA      HITACHI HDS7250S  AV0A 39 C (102 F)
> c7t3d0p0  XXXXXXXXXXX  ATA      HITACHI HDS7250S  AV0A 41 C (105 F)
> c7t4d0p0  XXXXXXXXXXX  ATA      HITACHI HDS7250S  AV0A 36 C (96 F)
> c7t5d0p0  XXXXXXXXXXX  ATA      HITACHI HDS7250S  AV0A 38 C (100 F)
> c7t6d0p0  XXXXXXXXXXX  ATA      HITACHI HDS7250S  AV0A 39 C (102 F)
> c7t7d0p0  XXXXXXXXXXX  ATA      HITACHI HDS7250S  AV0A 41 C (105 F)
>
> ---------------------SunFireX4500------Rear----------------------------
>
> 36:   37:   38:   39:   40:   41:   42:   43:   44:   45:   46:   47:
> c5t3  c5t7  c4t3  c4t7  c7t3  c7t7  c6t3  c6t7  c1t3  c1t7  c0t3  c0t7
> ^++   ^++   ^++   ^--   ^++   ^++   ^++   ^++   ^++   ^++   ^++   ^++
> 24:   25:   26:   27:   28:   29:   30:   31:   32:   33:   34:   35:
> c5t2  c5t6  c4t2  c4t6  c7t2  c7t6  c6t2  c6t6  c1t2  c1t6  c0t2  c0t6
> ^++   ^++   ^++   ^++   ^++   ^++   ^++   ^++   ^++   ^++   ^++   ^++
> 12:   13:   14:   15:   16:   17:   18:   19:   20:   21:   22:   23:
> c5t1  c5t5  c4t1  c4t5  c7t1  c7t5  c6t1  c6t5  c1t1  c1t5  c0t1  c0t5
> ^++   ^++   ^++   ^--   ^++   ^++   ^++   ^++   ^++   ^++   ^++   ^++
> 0:    1:    2:    3:    4:    5:    6:    7:    8:    9:   10:   11:
> c5t0  c5t4  c4t0  c4t4  c7t0  c7t4  c6t0  c6t4  c1t0  c1t4  c0t0  c0t4
> ^b+   ^b+   ^++   ^++   ^++   ^++   ^++   ^++   ^++   ^++   ^++   ^++
> -------*-----------*-SunFireX4500--*---Front-----*-----------*----------
_______________________________________________
sunmanagers mailing list
sunmanagers@sunmanagers.org
http://www.sunmanagers.org/mailman/listinfo/sunmanagers
Received on Fri May 1 14:07:23 2009

This archive was generated by hypermail 2.1.8 : Thu Mar 03 2016 - 06:44:14 EST