SCIENTIFIC-LINUX-USERS Archives

March 2009

SCIENTIFIC-LINUX-USERS@LISTSERV.FNAL.GOV

Options: Use Monospaced Font
Show Text Part by Default
Show All Mail Headers

Message: [<< First] [< Prev] [Next >] [Last >>]
Topic: [<< First] [< Prev] [Next >] [Last >>]
Author: [<< First] [< Prev] [Next >] [Last >>]

Print Reply
Subject:
From:
Jon Peatfield <[log in to unmask]>
Reply To:
Jon Peatfield <[log in to unmask]>
Date:
Thu, 12 Mar 2009 01:59:04 +0000
Content-Type:
TEXT/PLAIN
Parts/Attachments:
TEXT/PLAIN (139 lines)
On Wed, 11 Mar 2009, Miles O'Neal wrote:

> Jon Peatfield said...
>
> [snip]
>
> |Re-configuring your RAID controllers to export as <2TB slices isn't fun,
> |but it should be possible without a re-install (if a bit fiddly).
>
> Thanks for all of this.
>
> I'll look again, but I didn't notice anything obvious in the Adaptec
> screens at boot that would do this.  Any key phrases to look for?

With luck it is somewhere in the 'container' documentation/descriptions.

I don't have a lot of experience with recent Adaptec raid controllers, on 
one box with ~3TB of disk on an adaptec 216010SA it had to be configured 
as 2 RAID-5 sets each over parts of the same disks which sounds horrid I 
know...

ie in aaccli (yes this is old!) we see:

CLI > open aac0
Executing: open "aac0"

AAC0> disk list
Executing: disk list

C:ID:L  Device Type     Blocks    Bytes/Block Usage            Shared Rate
------  --------------  --------- ----------- ---------------- ------ ----
0:00:0   Disk            488397168 512         Initialized      NO     264
0:01:0   Disk            488397168 512         Initialized      NO     264
0:02:0   Disk            488397168 512         Initialized      NO     264
0:03:0   Disk            488397168 512         Initialized      NO     264
0:04:0   Disk            488397168 512         Initialized      NO     264
0:05:0   Disk            488397168 512         Initialized      NO     264
0:06:0   Disk            488397168 512         Initialized      NO     264
0:07:0   Disk            488397168 512         Initialized      NO     264
1:00:0   Disk            488397168 512         Initialized      NO     264
1:01:0   Disk            488397168 512         Initialized      NO     264
1:02:0   Disk            488397168 512         Initialized      NO     264
1:03:0   Disk            488397168 512         Initialized      NO     264
1:04:0   Disk            488397168 512         Initialized      NO     264
1:05:0   Disk            488397168 512         Initialized      NO     264
1:07:0   Disk            488397168 512         Initialized      NO     264

AAC0> disk show part
Executing: disk show partition


Scsi   Partition     Container  MultiLevel
C:ID:L Offset:Size   Num Type   Num Type   R/W
------ ------------- --- ------ --- ------ ---
0:00:0 64.0KB: 116GB  0  RAID-5  0  None   RW
0:00:0  116GB: 116GB  1  RAID-5  0  None   RW
0:01:0 64.0KB: 116GB  0  RAID-5  0  None   RW
0:01:0  116GB: 116GB  1  RAID-5  0  None   RW
0:03:0 64.0KB: 116GB  0  RAID-5  0  None   RW
0:03:0  116GB: 116GB  1  RAID-5  0  None   RW
0:04:0 64.0KB: 116GB  0  RAID-5  0  None   RW
0:04:0  116GB: 116GB  1  RAID-5  0  None   RW
0:05:0 64.0KB: 116GB  0  RAID-5  0  None   RW
0:05:0  116GB: 116GB  1  RAID-5  0  None   RW
0:06:0 64.0KB: 116GB  0  RAID-5  0  None   RW
0:06:0  116GB: 116GB  1  RAID-5  0  None   RW
0:07:0 64.0KB: 116GB  0  RAID-5  0  None   RW
0:07:0  116GB: 116GB  1  RAID-5  0  None   RW
1:00:0 64.0KB: 116GB  0  RAID-5  0  None   RW
1:00:0  116GB: 116GB  1  RAID-5  0  None   RW
1:01:0 64.0KB: 116GB  0  RAID-5  0  None   RW
1:01:0  116GB: 116GB  1  RAID-5  0  None   RW
1:02:0 64.0KB: 116GB  0  RAID-5  0  None   RW
1:02:0  116GB: 116GB  1  RAID-5  0  None   RW
1:03:0 64.0KB: 116GB  0  RAID-5  0  None   RW
1:03:0  116GB: 116GB  1  RAID-5  0  None   RW
1:04:0 64.0KB: 116GB  0  RAID-5  0  None   RW
1:04:0  116GB: 116GB  1  RAID-5  0  None   RW
1:05:0 64.0KB: 116GB  0  RAID-5  0  None   RW
1:05:0  116GB: 116GB  1  RAID-5  0  None   RW
1:07:0 64.0KB: 116GB  1  RAID-5  0  None   RW
1:07:0  116GB: 116GB  0  RAID-5  0  None   RW

AAC0> contain list
Executing: container list
Num          Total  Oth Stripe          Scsi   Partition
Label Type   Size   Ctr Size   Usage   C:ID:L Offset:Size
----- ------ ------ --- ------ ------- ------ -------------
  0    RAID-5 1.47TB       64KB Open    0:00:0 64.0KB: 116GB
  /dev/sda             SubData          0:01:0 64.0KB: 116GB
                                        0:04:0 64.0KB: 116GB
                                        0:03:0 64.0KB: 116GB
                                        1:07:0  116GB: 116GB
                                        0:05:0 64.0KB: 116GB
                                        0:06:0 64.0KB: 116GB
                                        0:07:0 64.0KB: 116GB
                                        1:00:0 64.0KB: 116GB
                                        1:01:0 64.0KB: 116GB
                                        1:02:0 64.0KB: 116GB
                                        1:03:0 64.0KB: 116GB
                                        1:04:0 64.0KB: 116GB
                                        1:05:0 64.0KB: 116GB

  1    RAID-5 1.47TB       64KB Open    0:00:0  116GB: 116GB
  /dev/sdb             SubData2         0:01:0  116GB: 116GB
                                        0:04:0  116GB: 116GB
                                        0:03:0  116GB: 116GB
                                        1:07:0 64.0KB: 116GB
                                        0:05:0  116GB: 116GB
                                        0:06:0  116GB: 116GB
                                        0:07:0  116GB: 116GB
                                        1:00:0  116GB: 116GB
                                        1:01:0  116GB: 116GB
                                        1:02:0  116GB: 116GB
                                        1:03:0  116GB: 116GB
                                        1:04:0  116GB: 116GB
                                        1:05:0  116GB: 116GB

AAC0> contain show fail
Executing: container show failover

Container Scsi C:ID:L
--------- ----------------------------------
  GLOBAL   0:02:0
  MISSING
   0       --- No Devices Assigned ---
   1       --- No Devices Assigned ---

so it seems to be treating regions of each disk as a 'partition' and 
making up 2 raid-5 sets.  At some point when a drive got failed/replaced 
it seems to have added the bits from a hot-spare in the other order.

The interface on some other devices (e.g. Infortrend and PERC/6) is a 
little nicer in that you make a single large RAID set and then export some 
portions of it to the host (or possibly to different hosts for devices 
with multiple interfaces).

  -- Jon

ATOM RSS1 RSS2