D&C GLug - Home Page

[ Date Index ] [ Thread Index ] [ <= Previous by date / thread ] [ Next by date / thread => ]

Re: [LUG] rsync and file transfers

 

Rob Beard wrote:
On 18/11/10 23:09, David Vanstone wrote:
Hey there

I have a problem I can't really work out how to solve. I'll try to
explain as best as possible.

Basically I have a server (in one house) and a client computer (in a
separate house)

What I want to be able to do is - Plug USB Hard drive into server
computer, make it send any news files since the last time it was plugged
in from a certain folder on the server to the USB HDD.

Then take the USB HDD to the client PC plug it in and all the new files
off the USB Drive, copy them to a folder on the client PC then delete
all files off the USB Hard drive.

I'd like it to do this automatically so its literally just plug the
drive in and away it goes. We are talking 1 terrabyte+ so need the USB
HDD to empty after each transfer and hold some sort of log file that the
server will query, so that it doesnt transfer all the files again, only
new ones from that differ from the last transfer. rsync would work great
on this if i didnt need to keep the USB HDD empty, unless any of you
know a way of doing it?

Any ideas would be a great help!

Many Thanks,
Dave


To set it off automatically I would guess something in UDEV which when the drive is attached it triggers a script (I've done this with an automatic backup to USB hard drives a while back).

As far as rsync goes it has an option to either copy files based on time stamps or on checksums. I've done this in the past where only changes between files were copied over saving on how much it copied. At least copying only what has changed you're not going to be copying 1TB+ of every time, although doing it with 100GB of VMWare disk images from an internal drive to a USB external drive still took a while.

Rob

Yup on it with udev, pretty cool app, thanks for your help so far, but google is still getting a hammering at the moment! :P haha

Dave

--
The Mailing List for the Devon & Cornwall LUG
http://mailman.dclug.org.uk/listinfo/list
FAQ: http://www.dcglug.org.uk/listfaq