<html><head><meta http-equiv="content-type" content="text/html; charset=utf-8"></head><body dir="auto"><div>I would expect in rhel5 that the limit is that of an unsigned 64 bit integer. But you're going to want a FS that has that limit... I recommend btrfs. It effectively replaces LVM/LVM2. It gives you multiple devices, self-healing, faster reconstruction than mdraid, faster, atomic snapshots, and so on. <br><br>Sent from my iPad</div><div><br>On Mar 5, 2015, at 10:56 AM, Lightner, Jeff <<a href="mailto:JLightner@dsservices.com">JLightner@dsservices.com</a>> wrote:<br><br></div><blockquote type="cite"><div>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
<meta name="Generator" content="Microsoft Word 14 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri","sans-serif";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
span.EmailStyle17
{mso-style-type:personal-compose;
font-family:"Calibri","sans-serif";
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri","sans-serif";}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
<div class="WordSection1">
<p class="MsoNormal">BASIC QUESTION: <o:p></o:p></p>
<p class="MsoNormal">Is there a SIZE limit for Volume Group (VG) or Physical Volume (PV) in LVM2?<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Mainly I’m interested in this as it relates to RHEL5 (or derivatives such as CentOS5) but any general Linux limitations known would be appreciated.<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">DETAILS:<o:p></o:p></p>
<p class="MsoNormal">After doing much searching I can’t find anything that explicitly suggests SIZE limits in lvm2 on RHEL5 (or Linux in general) for a VG or a PV. I did find notes that suggest limits (or lack thereof) for QUANTITY but not SIZE for lvm2
where lvm1 did have such QUANTITY limits.<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Note: <o:p></o:p></p>
<p class="MsoNormal">My question is aimed at SIZE limits. NOT at performance. <o:p>
</o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">I already know RAID6 is not optimal for databases. I opted to do the RAID6 to maximize available storage for a test/dev environment. We do RHEL5 because the Production environment is RHEL5 and that isn’t going to change any time soon
so need to insure the test/dev environments match.<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">The 20 TB RAID 6 LUN is from a Dell MD1220 disk array.<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Many of the limit I see in RHEL5’s limits document show 16 TB (supported – 1 EB theoretical) but it has no discussion at all of lvm2 limits specifically. <o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Ultimately I successfully did the following:<o:p></o:p></p>
<p class="MsoNormal">-Created that single 20 TB LUN (RAID6)<o:p></o:p></p>
<p class="MsoNormal">-The OS did discover it and set it as a /dev/sd* device, /dev/sdaer (we have many other LUNs from a separate SAN array).<o:p></o:p></p>
<p class="MsoNormal">-Used parted and changed it from msdos to GPT partition table.<o:p></o:p></p>
<p class="MsoNormal">-Created a single partition using all space from the drive.<o:p></o:p></p>
<p class="MsoNormal">-Created a udev rules file to make create the partition as new device /dev/dmd1200s1 (instead of /dev/sdaer1) to insure we have a persistent name after reboots. (I chose dmd* to avoid confusion with dm-* device mapper and md* meta disks.)<o:p></o:p></p>
<p class="MsoNormal">-Did a pvcreate of the partition device /dev/dmd1200s1<o:p></o:p></p>
<p class="MsoNormal">-Did a vgcreate using only that PV<o:p></o:p></p>
<p class="MsoNormal">-Did lvcreates of 12 logical volumes (LVs) the largest of which are 6.3 TB from that VG.<o:p></o:p></p>
<p class="MsoNormal">-Did the mkfs.ext4 on the 12 LVs. (6.3 TB is well within the 16 TB supported limit RHEL5 lists for ext4).<o:p></o:p></p>
<p class="MsoNormal">-Created mountpoint directories then mounted the 12 LVs on same (via fstab entries and “mount –a).<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">So far we’ve not put any sort of data on the filesystems but given the above worked it seems likely this shouldn’t be an issue (other than performance) but I’d feel better if I could find something that explicitly states lvm2 is valid for
the 20 TB VG/PV it is using in this case. <o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">From my reading it appears some of the limits I saw for things like ext4 were related to the tools in e2fsprog rather than the filesystem itself. Since the LVM tools worked flawlessly I suspect there is no similar issue for lvm2 itself
or its tools but I’m just wondering if there is any place that definitively states size limits (or that none exist) for VG and PV in LVM2? <o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">RHEL5 by the way has a 2.6.x kernel. I did find some discussion of 2.4 kernel limitations related to lvm1/lvm2 but those don’t apply. I also found discussion on HP-UX regarding lvm 2 but since lvm has been on HP-UX longer than it has
been in Linux I’ve never been certain how (or if) they related to each other so wouldn’t think that would be helpful (especially since HP-UX only runs on itanium these days and formerly ran on PA-RISC).<o:p></o:p></p>
</div>
<p style="font-size:10pt; line-height:10pt; font-family: 'Arial','times roman',serif;">
CONFIDENTIALITY NOTICE: This e-mail may contain privileged or confidential information and is for the sole use of the intended recipient(s). If you are not the intended recipient, any disclosure, copying, distribution, or use of the contents of this information
is prohibited and may be unlawful. If you have received this electronic transmission in error, please reply immediately to the sender that you have received the message in error, and delete it. Thank you
</p>
<span style="padding-top:10px; font-weight:color:#CC0000; font-size:10pt; font-family: 'Arial',Arial,sans-serif; ">
<p></p>
</span><br>
<br>
<div></div>
</div></blockquote><blockquote type="cite"><div><span>_______________________________________________</span><br><span>Ale mailing list</span><br><span><a href="mailto:Ale@ale.org">Ale@ale.org</a></span><br><span><a href="http://mail.ale.org/mailman/listinfo/ale">http://mail.ale.org/mailman/listinfo/ale</a></span><br><span>See JOBS, ANNOUNCE and SCHOOLS lists at</span><br><span><a href="http://mail.ale.org/mailman/listinfo">http://mail.ale.org/mailman/listinfo</a></span><br></div></blockquote></body></html>