This is an old revision of the document!
Please read the section Common files organization before going through this section.
Please read this carefully.
When moving data to the shared folders, please follow these common sense rules:
scratch
folder to be always there. We still have no policy for that but we will have meetings in which we decide about it.Here's some solutions to move data to the cluster. 1-3 are generic data transfer tools. 4-5 are GRID oriented data transfer tools (mostly for Particle Physicists)
These marked with are my favourite — Florido Paganelli 2013/08/27 20:20
Example:
Moving ubuntu-12.04.2-desktop-amd64.iso
from my local machine to n12.iridium
scp ubuntu-12.04.2-desktop-i386.iso n12.iridium:/nfs/shared/pp/
Syntax:
rsync -avz -e 'ssh -l <username>' --progress source destination
Examples:
Moving ubuntu-12.04.2-desktop-amd64.iso
from my local machine to n12.iridium
rsync -avz -e 'ssh -l pflorido' --progress ubuntu-12.04.2-desktop-amd64.iso pptest-iridium.lunarc.lu.se:/nfs/software/pp/
Note on the trailing slashes /:
source without trailing slash on source will create localdir remotely:
rsync -avz -e 'ssh -l pflorido' --progress localdir pptest-iridium.iridium:/nfs/software/pp/
source with trailing slash on source will NOT create localdir remotely but will copy the contents of localdir remotely
rsync -avz -e 'ssh -l pflorido' --progress localdir/ pptest-iridium.iridium:/nfs/software/pp/
Trailing slash on destination doesn't have any effect.
More about it: https://filezilla-project.org/download.php?type=client
See also http://www.hep.lu.se/grid/localgroupdisk.html for more information on how to use Lund local GRID storage.
Example:
To copy files to/from the storage, use the srm:
protocol and arccp
tool:
arccp srm://srm.swegrid.se/atlas/disk/atlaslocalgroupdisk/lund/data11_7TeV/NTUP_SUSY/f354_m765_p486/data11_7TeV.00178109.physics_JetTauEtmiss.merge.NTUP_SUSY.f354_m765_p486_tid292683_00/NTUP_SUSY.292683._000131.root.1 file:///tmp/NTUP_SUSY.292683._000131.root.1
Example: