This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision Next revision Both sides next revision | ||
aurora_cluster:moving_data [2017/07/31 18:05] florido [Moving small files for users of Mathematical Physics and all Lunarc users] |
aurora_cluster:moving_data [2017/07/31 18:12] florido [Downloading/Uploading data to/from the GRID from Aurora] |
||
---|---|---|---|
Line 46: | Line 46: | ||
The picture below shows the various steps. {{ :aurora_cluster:datamovementflowchartbiggfx.png?600 |}} | The picture below shows the various steps. {{ :aurora_cluster:datamovementflowchartbiggfx.png?600 |}} | ||
- | ==== Uploading/Downloading data to/from an external source from Aurora ==== | + | ==== A. Uploading/Downloading data to/from an external source from Aurora ==== |
- Use your favourite download software. Some suggestions are available at [[iridium_cluster:data|Moving data to and from Iridium]]. If the tool is not available please ask Florido to install it on ''fs2-hep''. | - Use your favourite download software. Some suggestions are available at [[iridium_cluster:data|Moving data to and from Iridium]]. If the tool is not available please ask Florido to install it on ''fs2-hep''. | ||
- Use your home folder or one of the ''/projects/hep'' folders as a destination folder. Any other path is not writable by your user. The ''/tmp'' folder will be deleted regularly so you should not use that. ''/projects/hep/fs2'' is accessible by everyone, while ''/projects/hep/fs3'' and ''/projects/hep/fs4'' is dedicated storage for the ATLAS project. | - Use your home folder or one of the ''/projects/hep'' folders as a destination folder. Any other path is not writable by your user. The ''/tmp'' folder will be deleted regularly so you should not use that. ''/projects/hep/fs2'' is accessible by everyone, while ''/projects/hep/fs3'' and ''/projects/hep/fs4'' is dedicated storage for the ATLAS project. | ||
- | ==== Downloading/Uploading data to/from the GRID from Aurora ==== | + | ==== B. Downloading/Uploading data to/from the GRID from Aurora ==== |
For resources that can be stored on the GRID, you should definitely stage them on the Lund GRID storage instead, a few ways described at the link below, so that you can access them from all over the world in the fastest way possible. | For resources that can be stored on the GRID, you should definitely stage them on the Lund GRID storage instead, a few ways described at the link below, so that you can access them from all over the world in the fastest way possible. | ||
Please read the dedicated page [[aurora_cluster:moving_data:grid|Moving data between GRID and Aurora]] | Please read the dedicated page [[aurora_cluster:moving_data:grid|Moving data between GRID and Aurora]] |