Welcome to the { mindfrost82.com } forums.

You are currently viewing our boards as a guest which gives you limited access to view most discussions and access our other features. By joining our free community you will have access to post topics, communicate privately with other members (PM), respond to polls, upload content and access many other special features. Registration is fast, simple and absolutely free so please, join our community today!

If you have any problems with the registration process or your account login, please contact contact us.

Go Back   { mindfrost82.com } > Gadget Corner > Tech Newsgroups > Linux > Linux Hardware

Reply
 
LinkBack Thread Tools Search this Thread Display Modes
  #1 (permalink)  
Old 01-23-2008, 06:22 PM
Ignoramus11153
 
Posts: n/a
Partition troubles on a GIANT storage server

We have a storage server with a 3ware RAID drive.

It has a bunch of disks that together form a 5TB storage array.

Linux sees that array as /dev/sdb. The capacity is 5 TB (as I said).
fdisk sees it as follows:

### Disk /dev/sdb: 5249.9 GB, 5249921187840 bytes
### 255 heads, 63 sectors/track, 638266 cylinders
### Units = cylinders of 16065 * 512 = 8225280 bytes
### Disk identifier: 0xcf00cb1c
###
### Device Boot Start End Blocks Id System
### /dev/sdb1 1 267349 2147480811 5 Extended
### /dev/sdb5 1 267349 2147480779+ 83 Linux

Which is the way I want. I formatted this disk with fdisk a while
ago. There is one giant extended partition, and a almost the same size
logical partition inside, holding Linux data.

The device /dev/sdb5 is mounted on /data. However, df -k /data says:

Filesystem 1K-blocks Used Available Use% Mounted on
/dev/sdb5 2113784952 239323764 1767087152 12% /data

The above is wrong (or at least is not the way I expect), as I expect
1K-blocks count to say 5 million instead of 2 million.

This got worse as I continued looking. If I start gparted /dev/sdb, it
tells me that the only partition is /dev/sdb1 (ignoring /dev/sdb5),
which according to it occupies the whole array and is in use.

Somehow gparted does not see /dev/sdb5 at all, I think.

The same exact thing happens to QTParted.

The server works fine.

I am very worried that 1) I am using less than half of what is
available and 2) that something wrong could heppen.

Some clarification will be appreciated.

i
Reply With Quote
  #2 (permalink)  
Old 01-23-2008, 06:25 PM
Ignoramus11153
 
Posts: n/a
Re: Partition troubles on a GIANT storage server


Also fdisk says on top:

WARNING: GPT (GUID Partition Table) detected on '/dev/sdb'! The util
fdisk doesn't support GPT. Use GNU Parted.

Reply With Quote
  #3 (permalink)  
Old 01-23-2008, 07:28 PM
Bill Marcum
 
Posts: n/a
Re: Partition troubles on a GIANT storage server

["Followup-To:" header set to comp.os.linux.misc.]
On 2008-01-23, Ignoramus11153 <ignoramus11153@NOSPAM.11153.invalid> wrote:
>
>
> We have a storage server with a 3ware RAID drive.
>
> It has a bunch of disks that together form a 5TB storage array.
>
> Linux sees that array as /dev/sdb. The capacity is 5 TB (as I said).
> fdisk sees it as follows:
>
> ### Disk /dev/sdb: 5249.9 GB, 5249921187840 bytes
> ### 255 heads, 63 sectors/track, 638266 cylinders
> ### Units = cylinders of 16065 * 512 = 8225280 bytes
> ### Disk identifier: 0xcf00cb1c
> ###
> ### Device Boot Start End Blocks Id System
> ### /dev/sdb1 1 267349 2147480811 5 Extended
> ### /dev/sdb5 1 267349 2147480779+ 83 Linux
>
> Which is the way I want. I formatted this disk with fdisk a while
> ago. There is one giant extended partition, and a almost the same size
> logical partition inside, holding Linux data.
>
> The device /dev/sdb5 is mounted on /data. However, df -k /data says:
>
> Filesystem 1K-blocks Used Available Use% Mounted on
> /dev/sdb5 2113784952 239323764 1767087152 12% /data
>
> The above is wrong (or at least is not the way I expect), as I expect
> 1K-blocks count to say 5 million instead of 2 million.
>
> This got worse as I continued looking. If I start gparted /dev/sdb, it
> tells me that the only partition is /dev/sdb1 (ignoring /dev/sdb5),
> which according to it occupies the whole array and is in use.
>

Does it show sdb1 as an extended partition? Perhaps you should back up
your data, just in case, and create a logical partition with gparted.
You might need to resize the filesystem to use the entire partition.

> Somehow gparted does not see /dev/sdb5 at all, I think.
>
> The same exact thing happens to QTParted.
>
> The server works fine.
>
> I am very worried that 1) I am using less than half of what is
> available and 2) that something wrong could heppen.
>
> Some clarification will be appreciated.
>
> i

Reply With Quote
  #4 (permalink)  
Old 01-23-2008, 07:36 PM
stan@worldbadminton.com
 
Posts: n/a
Re: Partition troubles on a GIANT storage server

In comp.os.linux.misc Ignoramus11153 <ignoramus11153@nospam.11153.invalid> wrote:
> We have a storage server with a 3ware RAID drive.
>
> Filesystem 1K-blocks Used Available Use% Mounted on
> /dev/sdb5 2113784952 239323764 1767087152 12% /data
>
> The above is wrong (or at least is not the way I expect), as I expect
> 1K-blocks count to say 5 million instead of 2 million.
>
> This got worse as I continued looking. If I start gparted /dev/sdb, it
> tells me that the only partition is /dev/sdb1 (ignoring /dev/sdb5),
> which according to it occupies the whole array and is in use.
>


Well- that's "billion" not "million", right?

2,113,784,952

In which case it looks suspiciously like 32-bit integer issues.
It may well be that the "df" you are using is simply unable
to report a value greater than 32-bits allows.
Or maybe something totally different.

Stan

--
Stan Bischof ("stan" at the below domain)
www.worldbadminton.com
Reply With Quote
  #5 (permalink)  
Old 01-23-2008, 11:42 PM
Joshua Baker-LePain
 
Posts: n/a
Re: Partition troubles on a GIANT storage server

On 2008-01-23, Ignoramus11153 <ignoramus11153@NOSPAM.11153.invalid> wrote:
>
> Linux sees that array as /dev/sdb. The capacity is 5 TB (as I said).
> fdisk sees it as follows:
>
> ### Disk /dev/sdb: 5249.9 GB, 5249921187840 bytes
> ### 255 heads, 63 sectors/track, 638266 cylinders
> ### Units = cylinders of 16065 * 512 = 8225280 bytes
> ### Disk identifier: 0xcf00cb1c
> ###
> ### Device Boot Start End Blocks Id System
> ### /dev/sdb1 1 267349 2147480811 5 Extended
> ### /dev/sdb5 1 267349 2147480779+ 83 Linux
>
> Which is the way I want. I formatted this disk with fdisk a while
> ago. There is one giant extended partition, and a almost the same size
> logical partition inside, holding Linux data.


fdisk does not support a device that big. You must use parted. I also
rather hope that you're using a GPT disklabel, as standard (msdos) ones also
don't work on a device that large.

> The device /dev/sdb5 is mounted on /data. However, df -k /data says:
>
> Filesystem 1K-blocks Used Available Use% Mounted on
> /dev/sdb5 2113784952 239323764 1767087152 12% /data
>
> The above is wrong (or at least is not the way I expect), as I expect
> 1K-blocks count to say 5 million instead of 2 million.


Yep, it's wrong. The safest thing to do is backup the data somwhere else,
recreate the partition (with parted), reformat, and *verify* before putting
data on the system that everything is working correctly.

As an aside, there's really no need to use an extended partition on a device
you'll only have one partition on anyway. Just create one primary partition
and format that.

--
Joshua Baker-LePain
Department of Biomedical Engineering
Duke University
Reply With Quote
  #6 (permalink)  
Old 01-23-2008, 11:50 PM
Keith Keller
 
Posts: n/a
Re: Partition troubles on a GIANT storage server

brothel slavery, having served their apprenticeship
as domestic slaves. We are informed that fully seven-tenths of the
domestic slave girls found in Chinese homes in America--and every
well-to-do Chinese family (except Christians) keeps at least one or
two slaves--end their lives in immorality. Some of them when they
become old enough are seized by their masters as concubines, others
are sent to the brothels. Reports of conditions at Hong Kong which we
have already quoted, speak of the special celebration of the entrance
of a virgin into prostitution, and the high prices paid by patrons for
this initiation, but leave it obscure as to the nationality of the men
who initiate girls into the life of a brothel slave. But Chinese in
San Francisco do not hesitate to make the charge that Chinamen recoil,
through moral sense or superstition, from deflowering a virgin, and
that this horrible privilege is purchased at a special price by the
white, not the yellow patrons of Chinese houses of ill-fame. Baker
alley has probably been the scene of more terrible brutality of this
sort than any other part of San Francisco. Before the rubbish was
cleared away, in the oasis of


Reply With Quote
  #7 (permalink)  
Old 01-24-2008, 12:11 AM
Whoever
 
Posts: n/a
Re: Partition troubles on a GIANT storage server



On Wed, 23 Jan 2008, Ignoramus11153 wrote:

> We have a storage server with a 3ware RAID drive.
>
> It has a bunch of disks that together form a 5TB storage array.
>
> Linux sees that array as /dev/sdb. The capacity is 5 TB (as I said).
> fdisk sees it as follows:
>
> ### Disk /dev/sdb: 5249.9 GB, 5249921187840 bytes
> ### 255 heads, 63 sectors/track, 638266 cylinders
> ### Units = cylinders of 16065 * 512 = 8225280 bytes
> ### Disk identifier: 0xcf00cb1c
> ###
> ### Device Boot Start End Blocks Id System
> ### /dev/sdb1 1 267349 2147480811 5 Extended
> ### /dev/sdb5 1 267349 2147480779+ 83 Linux
>
> Which is the way I want. I formatted this disk with fdisk a while
> ago. There is one giant extended partition, and a almost the same size
> logical partition inside, holding Linux data.
>
> The device /dev/sdb5 is mounted on /data. However, df -k /data says:
>
> Filesystem 1K-blocks Used Available Use% Mounted on
> /dev/sdb5 2113784952 239323764 1767087152 12% /data
>
> The above is wrong (or at least is not the way I expect), as I expect
> 1K-blocks count to say 5 million instead of 2 million.



I am not sure why you would expect this, when your partition is less than
half the available space. You will note that fdisk reports that there are
638266 cylinders on the disk, while your partition ends at cylinder
267349.

Reply With Quote
  #8 (permalink)  
Old 01-24-2008, 12:33 AM
Keith Keller
 
Posts: n/a
Re: Partition troubles on a GIANT storage server

["Followup-To:" header set to comp.os.linux.misc.]

On 2008-01-23, Joshua Baker-LePain <jlb17@begone.spam.duke.edu> wrote:
>
> As an aside, there's really no need to use an extended partition on a device
> you'll only have one partition on anyway. Just create one primary partition
> and format that.


Well, if you're really sure that you'll only ever have one partition,
technically you don't even need a partition. You can simply create the
filesystem on /dev/sdb and mount that. (Some tools will complain about
mounting an entire physical device, though.)

--keith

--
kkeller-usenet@wombat.san-francisco.ca.us
(try just my userid to email me)
AOLSFAQ=http://www.therockgarden.ca/aolsfaq.txt
see X- headers for PGP signature information

Reply With Quote
  #9 (permalink)  
Old 01-24-2008, 03:11 AM
Ignoramus11153
 
Posts: n/a
Re: Partition troubles on a GIANT storage server

On 2008-01-23, Joshua Baker-LePain <jlb17@begone.spam.duke.edu> wrote:
> On 2008-01-23, Ignoramus11153 <ignoramus11153@NOSPAM.11153.invalid> wrote:
>>
>> Linux sees that array as /dev/sdb. The capacity is 5 TB (as I said).
>> fdisk sees it as follows:
>>
>> ### Disk /dev/sdb: 5249.9 GB, 5249921187840 bytes
>> ### 255 heads, 63 sectors/track, 638266 cylinders
>> ### Units = cylinders of 16065 * 512 = 8225280 bytes
>> ### Disk identifier: 0xcf00cb1c
>> ###
>> ### Device Boot Start End Blocks Id System
>> ### /dev/sdb1 1 267349 2147480811 5 Extended
>> ### /dev/sdb5 1 267349 2147480779+ 83 Linux
>>
>> Which is the way I want. I formatted this disk with fdisk a while
>> ago. There is one giant extended partition, and a almost the same size
>> logical partition inside, holding Linux data.

>
> fdisk does not support a device that big. You must use parted. I also
> rather hope that you're using a GPT disklabel, as standard (msdos) ones also
> don't work on a device that large.


OK.

>> The device /dev/sdb5 is mounted on /data. However, df -k /data says:
>>
>> Filesystem 1K-blocks Used Available Use% Mounted on
>> /dev/sdb5 2113784952 239323764 1767087152 12% /data
>>
>> The above is wrong (or at least is not the way I expect), as I expect
>> 1K-blocks count to say 5 million instead of 2 million.

>
> Yep, it's wrong. The safest thing to do is backup the data somwhere else,
> recreate the partition (with parted), reformat, and *verify* before putting
> data on the system that everything is working correctly.


Yes. I scheduled data backup for 1am tonight, I will double verify it
in the morning and will redo partitioning.


> As an aside, there's really no need to use an extended partition on a device
> you'll only have one partition on anyway. Just create one primary partition
> and format that.
>


Fair enough. So, the plan is:

1) Backup the data at 1am tonight
2) In the morning, verify backup
3) umount /data
4) use gparted to repartition. Create one primary partition only, and
label it as linux
5) mkfs -t ext3 /dev/sdb1
6) remount
7) restore the backup.

i
Reply With Quote
  #10 (permalink)  
Old 01-24-2008, 05:19 AM
Chris Cox
 
Posts: n/a
Re: Partition troubles on a GIANT storage server

Ignoramus11153 wrote:
> Also fdisk says on top:
>
> WARNING: GPT (GUID Partition Table) detected on '/dev/sdb'! The util
> fdisk doesn't support GPT. Use GNU Parted.
>


Yes... this is true. In order to use traditional partitioning
and create a single partition larger than 2TB, you have to use
GPT instead of a normal default partition table.

IMHO, you're better off using LVM instead though. That way
you don't have to deal with this kind of mess.

Also, large partitions (or logical volumes) with filesystems
will always create a problem since it takes a LONG time to
fsck one if something bad should happen. Just an fyi. (Other
things are somewhat impractical as well)

If I were starting from scratch I'd place all of /dev/sdb
under LVM control and carve it up using logical volumes
rather than depending on a partition table.
(hindsight being 20/20)

Reply With Quote
Reply

  { mindfrost82.com } > Gadget Corner > Tech Newsgroups > Linux > Linux Hardware


Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are Off
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On



All times are GMT. The time now is 10:01 AM.


Powered by vBulletin, Copyright ©2000 - 2008, Jelsoft Enterprises Ltd.
Search Engine Friendly URLs by vBSEO 3.1.0 ©2007, Crawlability, Inc.
© 1999-2008 mindfrost82.com v11.0


Sponsors:
Mortgage | Loans | Online Loans | Free Web Development Code | Online Image Resizer



1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114