Welcome to the { mindfrost82.com } forums.

You are currently viewing our boards as a guest which gives you limited access to view most discussions and access our other features. By joining our free community you will have access to post topics, communicate privately with other members (PM), respond to polls, upload content and access many other special features. Registration is fast, simple and absolutely free so please, join our community today!

If you have any problems with the registration process or your account login, please contact contact us.

Go Back   { mindfrost82.com } > Gadget Corner > Tech Newsgroups > Hardware

Reply
 
LinkBack Thread Tools Search this Thread Display Modes
  #1 (permalink)  
Old 08-27-2008, 01:15 PM
Peter Olcott
 
Posts: n/a
Fastest sustained throughput possible from a drive array???

http://www.wwpi.com/cables-a-connect...idth-selection
It looks like this link indicates 1600 MB per second, yet it
does not specify that this is sustained throughput. Can
someone please confirm this?


Reply With Quote
  #2 (permalink)  
Old 08-27-2008, 01:25 PM
GT
 
Posts: n/a
Re: Fastest sustained throughput possible from a drive array???

"Peter Olcott" <NoSpam@SeeScreen.com> wrote in message
news:Kzbtk.23893$9u1.9876@newsfe09.iad...
>
> http://www.wwpi.com/cables-a-connect...idth-selection
> It looks like this link indicates 1600 MB per second, yet it does not
> specify that this is sustained throughput. Can someone please confirm
> this?


This is not the speed of the drives in the setup, its the speed of the bus.
There are no moving parts or seek times to consider, so through can be
sustained on the bus as long as the hardware at each end can cope.

Not sure where you will find hard disks (in any sort of array) that can
sustain those kinds of speeds though.


Reply With Quote
  #3 (permalink)  
Old 08-29-2008, 12:04 AM
Peter Olcott
 
Posts: n/a
Re: Fastest sustained throughput possible from a drive array???


"GT" <ContactGT_rem_ove_this_@hotmail.com> wrote in message
news:03261fad$0$11425$c3e8da3@news.astraweb.com...
> "Peter Olcott" <NoSpam@SeeScreen.com> wrote in message
> news:Kzbtk.23893$9u1.9876@newsfe09.iad...
>>
>> http://www.wwpi.com/cables-a-connect...idth-selection
>> It looks like this link indicates 1600 MB per second, yet
>> it does not specify that this is sustained throughput.
>> Can someone please confirm this?

>
> This is not the speed of the drives in the setup, its the
> speed of the bus. There are no moving parts or seek times
> to consider, so through can be sustained on the bus as
> long as the hardware at each end can cope.
>
> Not sure where you will find hard disks (in any sort of
> array) that can sustain those kinds of speeds though.
>


http://www.dulcesystems.com:80/html/pro_rx.html
This system will do 800 MB / second, that may be the limit
of current technology.


Reply With Quote
  #4 (permalink)  
Old 08-29-2008, 01:58 AM
Peter Olcott
 
Posts: n/a
Re: Fastest sustained throughput possible from a drive array???


"GT" <ContactGT_rem_ove_this_@hotmail.com> wrote in message
news:03261fad$0$11425$c3e8da3@news.astraweb.com...
> "Peter Olcott" <NoSpam@SeeScreen.com> wrote in message
> news:Kzbtk.23893$9u1.9876@newsfe09.iad...
>>
>> http://www.wwpi.com/cables-a-connect...idth-selection
>> It looks like this link indicates 1600 MB per second, yet
>> it does not specify that this is sustained throughput.
>> Can someone please confirm this?

>
> This is not the speed of the drives in the setup, its the
> speed of the bus. There are no moving parts or seek times
> to consider, so through can be sustained on the bus as
> long as the hardware at each end can cope.
>
> Not sure where you will find hard disks (in any sort of
> array) that can sustain those kinds of speeds though.
>


http://www.violin-memory.com/assets/techbrief_gen1.pdf
Here is another option in case anyone cares, 1400 mb per
second.


Reply With Quote
  #5 (permalink)  
Old 08-29-2008, 02:52 AM
Paul
 
Posts: n/a
Re: Fastest sustained throughput possible from a drive array???

Peter Olcott wrote:
> "GT" <ContactGT_rem_ove_this_@hotmail.com> wrote in message
> news:03261fad$0$11425$c3e8da3@news.astraweb.com...
>> "Peter Olcott" <NoSpam@SeeScreen.com> wrote in message
>> news:Kzbtk.23893$9u1.9876@newsfe09.iad...
>>> http://www.wwpi.com/cables-a-connect...idth-selection
>>> It looks like this link indicates 1600 MB per second, yet
>>> it does not specify that this is sustained throughput.
>>> Can someone please confirm this?

>> This is not the speed of the drives in the setup, its the
>> speed of the bus. There are no moving parts or seek times
>> to consider, so through can be sustained on the bus as
>> long as the hardware at each end can cope.
>>
>> Not sure where you will find hard disks (in any sort of
>> array) that can sustain those kinds of speeds though.
>>

>
> http://www.violin-memory.com/assets/techbrief_gen1.pdf
> Here is another option in case anyone cares, 1400 mb per
> second.
>
>


The big win on an appliance like that, is the seek time.

Seek is one of the irritating limits of something like
a 16 disk RAID array. Plenty of bandwidth, but relatively
long delays before the array is returning data. That SSD/Ramdisk
is one way to fix it, even if it "only" supports 504GB of
RAM.

Paul
Reply With Quote
  #6 (permalink)  
Old 08-29-2008, 11:10 AM
Peter Olcott
 
Posts: n/a
Re: Fastest sustained throughput possible from a drive array???


"Paul" <nospam@needed.com> wrote in message
news:g97khg$jc6$1@aioe.org...
> Peter Olcott wrote:
>> "GT" <ContactGT_rem_ove_this_@hotmail.com> wrote in
>> message
>> news:03261fad$0$11425$c3e8da3@news.astraweb.com...
>>> "Peter Olcott" <NoSpam@SeeScreen.com> wrote in message
>>> news:Kzbtk.23893$9u1.9876@newsfe09.iad...
>>>> http://www.wwpi.com/cables-a-connect...idth-selection
>>>> It looks like this link indicates 1600 MB per second,
>>>> yet it does not specify that this is sustained
>>>> throughput. Can someone please confirm this?
>>> This is not the speed of the drives in the setup, its
>>> the speed of the bus. There are no moving parts or seek
>>> times to consider, so through can be sustained on the
>>> bus as long as the hardware at each end can cope.
>>>
>>> Not sure where you will find hard disks (in any sort of
>>> array) that can sustain those kinds of speeds though.
>>>

>>
>> http://www.violin-memory.com/assets/techbrief_gen1.pdf
>> Here is another option in case anyone cares, 1400 mb per
>> second.

>
> The big win on an appliance like that, is the seek time.
>
> Seek is one of the irritating limits of something like
> a 16 disk RAID array. Plenty of bandwidth, but relatively
> long delays before the array is returning data. That
> SSD/Ramdisk
> is one way to fix it, even if it "only" supports 504GB of
> RAM.
>
> Paul


I don't seek why seek time can not be amortized across
multiple disks.


Reply With Quote
  #7 (permalink)  
Old 08-29-2008, 11:57 AM
Paul
 
Posts: n/a
Re: Fastest sustained throughput possible from a drive array???

Peter Olcott wrote:
> "Paul" <nospam@needed.com> wrote in message
> news:g97khg$jc6$1@aioe.org...
>> Peter Olcott wrote:
>>> "GT" <ContactGT_rem_ove_this_@hotmail.com> wrote in
>>> message
>>> news:03261fad$0$11425$c3e8da3@news.astraweb.com...
>>>> "Peter Olcott" <NoSpam@SeeScreen.com> wrote in message
>>>> news:Kzbtk.23893$9u1.9876@newsfe09.iad...
>>>>> http://www.wwpi.com/cables-a-connect...idth-selection
>>>>> It looks like this link indicates 1600 MB per second,
>>>>> yet it does not specify that this is sustained
>>>>> throughput. Can someone please confirm this?
>>>> This is not the speed of the drives in the setup, its
>>>> the speed of the bus. There are no moving parts or seek
>>>> times to consider, so through can be sustained on the
>>>> bus as long as the hardware at each end can cope.
>>>>
>>>> Not sure where you will find hard disks (in any sort of
>>>> array) that can sustain those kinds of speeds though.
>>>>
>>> http://www.violin-memory.com/assets/techbrief_gen1.pdf
>>> Here is another option in case anyone cares, 1400 mb per
>>> second.

>> The big win on an appliance like that, is the seek time.
>>
>> Seek is one of the irritating limits of something like
>> a 16 disk RAID array. Plenty of bandwidth, but relatively
>> long delays before the array is returning data. That
>> SSD/Ramdisk
>> is one way to fix it, even if it "only" supports 504GB of
>> RAM.
>>
>> Paul

>
> I don't seek why seek time can not be amortized across
> multiple disks.
>


If the seek time is 3 microseconds on that DRAM based SSD, and
11 milliseconds on a hard drive, it is pretty hard to make the
thousandfold difference go away. The SSD is just blindingly fast,
and perfect for things like databases. Too bad the purchase
price would be so high. They're priced for enterprise usage,
so the price is not even a reflection of the price of the
RAM used in them - 500GB of RAM would cost about $12500, and
the SSD would be priced at many times that number. It would be
a bargain at $50000, and depending on the patent situation, and
how many companies make them, it could be a lot more expensive.
Maybe closer to $100000. And that is why lowly hard drives
are so attractive :-)

Paul
Reply With Quote
  #8 (permalink)  
Old 08-29-2008, 01:25 PM
PeteOlcott
 
Posts: n/a
Re: Fastest sustained throughput possible from a drive array???

On Aug 29, 5:57*am, Paul <nos...@needed.com> wrote:
> Peter Olcott wrote:
> > "Paul" <nos...@needed.com> wrote in message
> >news:g97khg$jc6$1@aioe.org...
> >> Peter Olcott wrote:
> >>> "GT" <ContactGT_rem_ove_th...@hotmail.com> wrote in
> >>> message
> >>>news:03261fad$0$11425$c3e8da3@news.astraweb.com ...
> >>>> "Peter Olcott" <NoS...@SeeScreen.com> wrote in message
> >>>>news:Kzbtk.23893$9u1.9876@newsfe09.iad...
> >>>>>http://www.wwpi.com/cables-a-connect...rformance-unpr...
> >>>>> It looks like this link indicates 1600 MB per second,
> >>>>> yet it does not specify that this is sustained
> >>>>> throughput. Can someone please confirm this?
> >>>> This is not the speed of the drives in the setup, its
> >>>> the speed of the bus. There are no moving parts or seek
> >>>> times to consider, so through can be sustained on the
> >>>> bus as long as the hardware at each end can cope.

>
> >>>> Not sure where you will find hard disks (in any sort of
> >>>> array) that can sustain those kinds of speeds though.

>
> >>> * *http://www.violin-memory.com/assets/techbrief_gen1.pdf
> >>> Here is another option in case anyone cares, 1400 mb per
> >>> second.
> >> The big win on an appliance like that, is the seek time.

>
> >> Seek is one of the irritating limits of something like
> >> a 16 disk RAID array. Plenty of bandwidth, but relatively
> >> long delays before the array is returning data. That
> >> SSD/Ramdisk
> >> is one way to fix it, even if it "only" supports 504GB of
> >> RAM.

>
> >> * *Paul

>
> > I don't seek why seek time can not be amortized across
> > multiple disks.

>
> If the seek time is 3 microseconds on that DRAM based SSD, and
> 11 milliseconds on a hard drive, it is pretty hard to make the
> thousandfold difference go away. The SSD is just blindingly fast,
> and perfect for things like databases. Too bad the purchase
> price would be so high. They're priced for enterprise usage,
> so the price is not even a reflection of the price of the
> RAM used in them - 500GB of RAM would cost about $12500, and
> the SSD would be priced at many times that number. It would be
> a bargain at $50000, and depending on the patent situation, and
> how many companies make them, it could be a lot more expensive.
> Maybe closer to $100000. And that is why lowly hard drives
> are so attractive :-)
>
> * * Paul- Hide quoted text -
>
> - Show quoted text -


http://www.nextlevelhardware.com/storage/barracuda/
Using these numbers for the Seagate Barracuda 7200.11
(1) Access time 12.4 MS or 80 random Accesses per second
(2) Sustained read rate 89.6 MB per second

Assuming that all of the data is contiguous, (no file fragmentation),
why couldn't 24 drive RAID 1 system provide this sustained read rate:
23/24 * 89.6 * 24 = 2060 MB per second?

23/24 is because each drive only has to spend 1/24 of its time
seeking, and the remaining time can be spent reading.


Reply With Quote
  #9 (permalink)  
Old 08-29-2008, 10:44 PM
Paul
 
Posts: n/a
Re: Fastest sustained throughput possible from a drive array???

PeteOlcott wrote:
> On Aug 29, 5:57 am, Paul <nos...@needed.com> wrote:
>> Peter Olcott wrote:
>>> "Paul" <nos...@needed.com> wrote in message
>>> news:g97khg$jc6$1@aioe.org...
>>>> Peter Olcott wrote:
>>>>> "GT" <ContactGT_rem_ove_th...@hotmail.com> wrote in
>>>>> message
>>>>> news:03261fad$0$11425$c3e8da3@news.astraweb.com...
>>>>>> "Peter Olcott" <NoS...@SeeScreen.com> wrote in message
>>>>>> news:Kzbtk.23893$9u1.9876@newsfe09.iad...
>>>>>>> http://www.wwpi.com/cables-a-connect...rformance-unpr...
>>>>>>> It looks like this link indicates 1600 MB per second,
>>>>>>> yet it does not specify that this is sustained
>>>>>>> throughput. Can someone please confirm this?
>>>>>> This is not the speed of the drives in the setup, its
>>>>>> the speed of the bus. There are no moving parts or seek
>>>>>> times to consider, so through can be sustained on the
>>>>>> bus as long as the hardware at each end can cope.
>>>>>> Not sure where you will find hard disks (in any sort of
>>>>>> array) that can sustain those kinds of speeds though.
>>>>> http://www.violin-memory.com/assets/techbrief_gen1.pdf
>>>>> Here is another option in case anyone cares, 1400 mb per
>>>>> second.
>>>> The big win on an appliance like that, is the seek time.
>>>> Seek is one of the irritating limits of something like
>>>> a 16 disk RAID array. Plenty of bandwidth, but relatively
>>>> long delays before the array is returning data. That
>>>> SSD/Ramdisk
>>>> is one way to fix it, even if it "only" supports 504GB of
>>>> RAM.
>>>> Paul
>>> I don't seek why seek time can not be amortized across
>>> multiple disks.

>> If the seek time is 3 microseconds on that DRAM based SSD, and
>> 11 milliseconds on a hard drive, it is pretty hard to make the
>> thousandfold difference go away. The SSD is just blindingly fast,
>> and perfect for things like databases. Too bad the purchase
>> price would be so high. They're priced for enterprise usage,
>> so the price is not even a reflection of the price of the
>> RAM used in them - 500GB of RAM would cost about $12500, and
>> the SSD would be priced at many times that number. It would be
>> a bargain at $50000, and depending on the patent situation, and
>> how many companies make them, it could be a lot more expensive.
>> Maybe closer to $100000. And that is why lowly hard drives
>> are so attractive :-)
>>
>> Paul- Hide quoted text -
>>
>> - Show quoted text -

>
> http://www.nextlevelhardware.com/storage/barracuda/
> Using these numbers for the Seagate Barracuda 7200.11
> (1) Access time 12.4 MS or 80 random Accesses per second
> (2) Sustained read rate 89.6 MB per second
>
> Assuming that all of the data is contiguous, (no file fragmentation),
> why couldn't 24 drive RAID 1 system provide this sustained read rate:
> 23/24 * 89.6 * 24 = 2060 MB per second?
>
> 23/24 is because each drive only has to spend 1/24 of its time
> seeking, and the remaining time can be spent reading.
>
>


I'm not arguing that you cannot sustain some large transfer rate
using hard drives (with the right access pattern). But once random
access is added to the picture, and relatively small transfers are
involved, most of the performance time is dominated by head movement.
11 milliseconds moving the head, read 4KB of data, 11 milliseconds
moving the head, read another 4KB of data. Real world applications
do some amount of head movement.

Take my machine as an example. If I use the Search command in Windows,
it might take 2 minutes to run and search all the files. The computer
is not reading a lot of data during that time, but there is a ton of
head movement. If I had that SSD, my search would complete in a couple
seconds. (The 2 minute figure, might be after a reboot, when the
OS file cache is empty.)

On RAID1 with two disks, in theory, on a read, both disks can return
data, and the controller can accept the data from the drive that
finishes first. That helps to reduce the average seek time, by a bit.
Whether that optimization is used on motherboard "soft RAID"
implementations, is unclear to me. That would be one way to reduce
the effects of the seek time, but only on read operations.

Paul
Reply With Quote
  #10 (permalink)  
Old 08-29-2008, 11:23 PM
Peter Olcott
 
Posts: n/a
Re: Fastest sustained throughput possible from a drive array???


"Paul" <nospam@needed.com> wrote in message
news:g98kec$fac$1@aioe.org...
> Peter Olcott wrote:
>> "Paul" <nospam@needed.com> wrote in message
>> news:g97khg$jc6$1@aioe.org...
>>> Peter Olcott wrote:
>>>> "GT" <ContactGT_rem_ove_this_@hotmail.com> wrote in
>>>> message
>>>> news:03261fad$0$11425$c3e8da3@news.astraweb.com...
>>>>> "Peter Olcott" <NoSpam@SeeScreen.com> wrote in message
>>>>> news:Kzbtk.23893$9u1.9876@newsfe09.iad...
>>>>>> http://www.wwpi.com/cables-a-connect...idth-selection
>>>>>> It looks like this link indicates 1600 MB per second,
>>>>>> yet it does not specify that this is sustained
>>>>>> throughput. Can someone please confirm this?
>>>>> This is not the speed of the drives in the setup, its
>>>>> the speed of the bus. There are no moving parts or
>>>>> seek times to consider, so through can be sustained on
>>>>> the bus as long as the hardware at each end can cope.
>>>>>
>>>>> Not sure where you will find hard disks (in any sort
>>>>> of array) that can sustain those kinds of speeds
>>>>> though.
>>>>>
>>>>
>>>> http://www.violin-memory.com/assets/techbrief_gen1.pdf
>>>> Here is another option in case anyone cares, 1400 mb
>>>> per second.
>>> The big win on an appliance like that, is the seek time.
>>>
>>> Seek is one of the irritating limits of something like
>>> a 16 disk RAID array. Plenty of bandwidth, but
>>> relatively
>>> long delays before the array is returning data. That
>>> SSD/Ramdisk
>>> is one way to fix it, even if it "only" supports 504GB
>>> of
>>> RAM.
>>>
>>> Paul

>>
>> I don't seek why seek time can not be amortized across
>> multiple disks.

>
> If the seek time is 3 microseconds on that DRAM based SSD,
> and
> 11 milliseconds on a hard drive, it is pretty hard to make
> the
> thousandfold difference go away. The SSD is just
> blindingly fast,
> and perfect for things like databases. Too bad the
> purchase
> price would be so high. They're priced for enterprise
> usage,
> so the price is not even a reflection of the price of the
> RAM used in them - 500GB of RAM would cost about $12500,
> and
> the SSD would be priced at many times that number. It
> would be
> a bargain at $50000, and depending on the patent
> situation, and
> how many companies make them, it could be a lot more
> expensive.
> Maybe closer to $100000. And that is why lowly hard drives
> are so attractive :-)
>
> Paul


All that I would need is a pc that can handle 24 hard-drives
and run windows and I would make my own RAID-1 system that
would provide 2000 MB per second sustained read performance.
I would merely seek once per drive, to a place that is in
increments of 1/24 of the size of the file into a different
(1/24th of the file sized increment) offsets of a single
contiguous buffer, and read a block that is 1/24 of the file
size from each drive. For writing I would have to write
every block to every drive. I may be able to get by with 12
hard-drive controller cards.


Reply With Quote
Reply

  { mindfrost82.com } > Gadget Corner > Tech Newsgroups > Hardware


Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are Off
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On



All times are GMT. The time now is 05:28 PM.


Powered by vBulletin, Copyright ©2000 - 2008, Jelsoft Enterprises Ltd.
Search Engine Friendly URLs by vBSEO 3.1.0 ©2007, Crawlability, Inc.
© 1999-2008 mindfrost82.com v11.0


Sponsors:
Jokes | Mortgage Calculator | WesternUnion | Watch Free Movies Online | Mobile Phone deals



1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114