l i n u x - u s e r s - g r o u p - o f - d a v i s
Next Meeting:
July 7: Social gathering
Next Installfest:
Latest News:
Jun. 14: June LUGOD meeting cancelled
Page last updated:
2008 Dec 12 01:52

The following is an archive of a post made to our 'vox-tech mailing list' by one of its subscribers.

Report this post as spam:

(Enter your email address)
Re: [vox-tech] Copying/ Moving Large number of files
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [vox-tech] Copying/ Moving Large number of files

Troy Arnold wrote:
> On Thu, Dec 11, 2008 at 04:48:34PM -0500, ALLO (Alfredo Lopez De Leon)
> wrote:
>> Hi,
>> I need to move a large number of directories whose size ranges from 1GB
>> to 6 GB (multiple files ~400mb each) between two NFS partitions.  Which
>> is the safest way to do it?  Will "mv dir1 /bla/bla/bla/dir1" will
>> suffice?  The data is extremely valuable and I will hate to lose it
>> during the process, should I do "copy" {cp -r dir1 /bla/bla/bla/dir1}
>> instead and then remove the originals?
> mv would be fine because the file isn't unlinked from the source until it
> has successfully been written to the destination.

I strongly disagree, having had problems with mv and large numbers of files.
It isn't that data gets lost... it is simply that sorting out the mess
of directories and files in two different places if there is a problem
is a headache.

> Still, I'd use rsync.  It has the advantage that it can resume if for some
> reason the transfer gets interrupted. 
> rsync -av dir1 /bla/bla/bla

rsync -avr ?

> Note the lack of trailing slash on 'dir1'.  If you include a trailing
> slash, rsync will copy the *contents* of that directory and not the
> directory itself.
> If you're extra paranoid you can use md5sum to compare the files in the
> source and destination.

I agree with the rest of your comments. :)

> p.s. if the data is that valuable, then maybe you should keep it in both
> places :)

Well, in multiple places.

Jeff Newmiller                        The     .....       .....  Go Live...
DCN:<jdnewmil@dcn.davis.ca.us>        Basics: ##.#.       ##.#.  Live Go...
                                       Live:   OO#.. Dead: OO#..  Playing
Research Engineer (Solar/Batteries            O.O#.       #.O#.  with
/Software/Embedded Controllers)               .OO#.       .OO#.  rocks...1k
vox-tech mailing list

LUGOD Group on LinkedIn
Sign up for LUGOD event announcements
Your email address:
LUGOD Group on Facebook
'Like' LUGOD on Facebook:

Hosting provided by:
Sunset Systems
Sunset Systems offers preconfigured Linux systems, remote system administration and custom software development.

LUGOD: Linux Users' Group of Davis
PO Box 2082, Davis, CA 95617
Contact Us

LUGOD is a 501(c)7 non-profit organization
based in Davis, California
and serving the Sacramento area.
"Linux" is a trademark of Linus Torvalds.

Sponsored in part by:
Sunset Systems
Who graciously hosts our website & mailing lists!