SCIENTIFIC-LINUX-USERS Archives

February 2007

SCIENTIFIC-LINUX-USERS@LISTSERV.FNAL.GOV

Options: Use Monospaced Font
Show Text Part by Default
Show All Mail Headers

Message: [<< First] [< Prev] [Next >] [Last >>]
Topic: [<< First] [< Prev] [Next >] [Last >>]
Author: [<< First] [< Prev] [Next >] [Last >>]

Print Reply
Subject:
From:
Devin Bougie <[log in to unmask]>
Reply To:
Devin Bougie <[log in to unmask]>
Date:
Mon, 5 Feb 2007 12:44:57 -0500
Content-Type:
text/plain
Parts/Attachments:
text/plain (65 lines)
Hi Jan,

On Feb 5, 2007, at 12:36 PM, Jan Iven wrote:
> On 05/02/07 16:39, Devin Bougie wrote:
> ..
>
>> The 3ware controller splits this 6.82TB RAID volume into
>> 2TB volumes (sd[c-f]) that we combine into one volume group.
> ..
>
>> Please let me know if there's any other information we can  
>> provide.  Any
>> suggestions or help would be greatly appreciate.
>
> What is the physical extent size of your volume group?

32M (I think everything I didn't list is the default).

> the default 32M
> would limit you to ~2TB (~64k extents per volume group, see vgcreate 
> (1)).
>
> I believe the 2.4 kernels have a 2TB limit per block device.
> http://www.redhat.com/rhel/details/limits/#five
> agrees with this.

Correct; which is why the 3ware controller splits the RAID array into  
2TB volumes.  The operating system sees 3ware array as three 2TB and  
one 800GB block devices.

[root@lnx113 root]# vgdisplay vg1
--- Volume group ---
VG Name               vg1
VG Access             read/write
VG Status             available/resizable
VG #                  1
MAX LV                256
Cur LV                2
Open LV               2
MAX LV Size           2 TB
Max PV                256
Cur PV                4
Act PV                4
VG Size               6.82 TB
PE Size               32 MB
Total PE              223510
Alloc PE / Size       124800 / 3.81 TB
Free  PE / Size       98710 / 3.01 TB
VG UUID               Mcy66r-Dtge-05od-TAvJ-724U-0HZ1-DK4qgG


[root@lnx113 root]# pvscan
pvscan -- reading all physical volumes (this may take a while...)
pvscan -- WARNING: physical volume "/dev/sda4" belongs to a meta device
pvscan -- WARNING: physical volume "/dev/sdb4" belongs to a meta device
pvscan -- ACTIVE   PV "/dev/sdc"  of VG "vg1" [2 TB / 0 free]
pvscan -- ACTIVE   PV "/dev/sdd"  of VG "vg1" [2 TB / 195.94 GB free]
pvscan -- ACTIVE   PV "/dev/sde"  of VG "vg1" [2 TB / 2 TB free]
pvscan -- ACTIVE   PV "/dev/sdf"  of VG "vg1" [840.78 GB / 840.78 GB  
free]
pvscan -- ACTIVE   PV "/dev/md2"  of VG "vg"  [68.72 GB / 49.17 GB free]
pvscan -- total: 7 [6.89 TB] / in use: 7 [6.89 TB] / in no VG: 0 [0]

Devin

ATOM RSS1 RSS2