[ale] Data archiving software?

[Shane McKinley]

I use NovaStor NovaNET ($$$). It's fast as it uses multiple streams for
each machine over the network at once.

However, the Linux support is limited. I know it runs on OpenSUSE and
Redhat. Check their site for more info:

http://us.novastor.com/index.php

The only downfall that I see is that the catalog they use is basically a
flat file, and tends to get corrupted after simple errors or shutting
down the server when the services fails to exit properly. However, this
is a non-issue if you know when you backed up the last good catalog.

It does D2D2MANY:

                      TAPE
                     /
                    /
DISK ---> DISK ----
                    \
                     \
                      DISK

Which is currently how I use the software to get the data on a hard disk
for fast recovery, to offsite disk for disaster recovery, and then to
tape for long term storage.


-----Original Message-----
From: Jeff Lightner [mailto:jlightner at water.com] 
Sent: Monday, October 13, 2008 10:43 AM
To: ale at ale.org
Subject: Re: [ale] Data archiving software?

NetBackup ($$$) has built in archiving features that let you do things
like send it to tape then delete it - you can even make it go to tape
twice before you delete it - at one job we did that with Oracle log
files.   BackupExec is cheaper and also a Symantec (Veritas) product but
I don't know if it does Linux or archiving.

-----Original Message-----
From: ale-bounces at ale.org [mailto:ale-bounces at ale.org] On Behalf Of Jeff
Layton
Sent: Monday, October 13, 2008 10:29 AM
To: ale at ale.org
Subject: Re: [ale] Data archiving software?

Jerald Sheets wrote:
> What format is the current data in, and on what kind of media are you 
> storing it?

Ah... the easy questions... :)  Well I'll have to dive into more details
to answer this. I've got output from HPC apps in various forms (some
text, some binary in various forms) that vary in format. The data is
stored in a parallel file system such as Lustre, GPFS, GlusterFS, IBRIX,
etc.

The media can be varied. In general it's something that is reliable and
can be kept for years (on the order of 10) and is cheap :)  Cheap means
cheaper than keeping the data in the current parallel file system.

Thanks!

Jeff
>
> --j
>
> On Oct 13, 2008, at 10:12 AM, Jeff Layton wrote:
>> Good morning,
>>
>> I'm looking around for data archiving software as a general solution.

>> In particular what I want to do is archive data by moving it onto a 
>> different storage media and removing from the existing storage. I 
>> don't need any metadata from the archived data to be left behind 
>> except perhaps some kind of database that contains a list of the 
>> files.
_______________________________________________
Ale mailing list
Ale at ale.org
http://mail.ale.org/mailman/listinfo/ale
----------------------------------
CONFIDENTIALITY NOTICE: This e-mail may contain privileged or
confidential information and is for the sole use of the intended
recipient(s). If you are not the intended recipient, any disclosure,
copying, distribution, or use of the contents of this information is
prohibited and may be unlawful. If you have received this electronic
transmission in error, please reply immediately to the sender that you
have received the message in error, and delete it. Thank you.
----------------------------------

_______________________________________________
Ale mailing list
Ale at ale.org
http://mail.ale.org/mailman/listinfo/ale