This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision Next revision Both sides next revision | ||
aurora_cluster:storage [2020/06/15 14:24] florido [Dedicated storage] |
aurora_cluster:storage [2020/06/15 14:42] florido [Storage on Aurora] |
||
---|---|---|---|
Line 6: | Line 6: | ||
The home folders are maintained and backed up by Lunarc, and they are in a special storage machine dedicated to users. | The home folders are maintained and backed up by Lunarc, and they are in a special storage machine dedicated to users. | ||
+ | 2020-06: I am currently working on some kind of system to keep track of usage and do some minimalistic data management. More information will come. | ||
===== Basic rules ===== | ===== Basic rules ===== | ||
Line 52: | Line 53: | ||
Please refer to the documentation at [[iridium_cluster:basic_information]] for it. | Please refer to the documentation at [[iridium_cluster:basic_information]] for it. | ||
- | ==== Dedicated storage ==== | + | ==== Dedicated division storage ==== |
- | Since 2016 we bought several dedicated storages. The use and permissions of which is described below. | + | Since 2016 we bought several dedicated storages. The ownership, use and permissions of which is described below. |
- | + | ||
- | The abbreviations in the table are as usual: **np** = **nuclear** physics ; **pp** = **particle** physics ; **tp** = **theoretical particle** physics | + | |
+ | ^ Particle Physics ^^^^^^^ | ||
^ Server ^ Size (Max) ^ Storage paths ^ Intended usage ^ Notes ^ Project ^ Remarks ^ | ^ Server ^ Size (Max) ^ Storage paths ^ Intended usage ^ Notes ^ Project ^ Remarks ^ | ||
| fs3 | 35TB | ''/projects/hep/fs3/shared'' | data that is meant to stay for long time | Very fast disk suitable for calculations | ATLAS | Ask Caterina and Will **before** using this space. | | | fs3 | 35TB | ''/projects/hep/fs3/shared'' | data that is meant to stay for long time | Very fast disk suitable for calculations | ATLAS | Ask Caterina and Will **before** using this space. | | ||
Line 67: | Line 67: | ||
| fs7 | 107TB | ''/projects/hep/fs7/shared'' | data that is meant to stay for long time | Slow disk suitable for low read/write frequency | LDMX | Ask Ruth **before** using this space. | | | fs7 | 107TB | ''/projects/hep/fs7/shared'' | data that is meant to stay for long time | Slow disk suitable for low read/write frequency | LDMX | Ask Ruth **before** using this space. | | ||
| ::: | ::: | ''/projects/hep/fs7/scratch'' | temporary data | ::: | ::: | ::: | | | ::: | ::: | ''/projects/hep/fs7/scratch'' | temporary data | ::: | ::: | ::: | | ||
+ | | fs9 | 350TB | ''/projects/hep/fs9/shared'' | data that is meant to stay for long time | Slow disk suitable for low read/write frequency | | whole division | | ||
+ | | ::: | ::: | ''/projects/hep/fs9/scratch'' | temporary data | ::: | ::: | ::: | | ||
+ | | ::: | ::: | ''/projects/hep/fs9/users'' | data moved from ''/lunarc/nobackup/users'' | ::: | ::: | ::: | | ||
- | === GRID storage === | + | ^ Nuclear Physics ^^^^^^^ |
+ | ^ Server ^ Size (Max) ^ Storage paths ^ Intended usage ^ Notes ^ Project ^ Remarks ^ | ||
+ | | fs8 | 350TB | ''/projects/hep/fs8/shared'' | data that is meant to stay for long time | Slow disk suitable for low read/write frequency | | whole division | | ||
+ | | ::: | ::: | ''/projects/hep/fs8/scratch'' | temporary data | ::: | ::: | ::: | | ||
+ | | ::: | ::: | ''/projects/hep/fs8/users'' | data moved from ''/lunarc/nobackup/users'' | ::: | ::: | ::: | | ||
+ | |||
+ | ^ Theoretical Particle Physics ^^^^^^^ | ||
+ | ^ Server ^ Size (Max) ^ Storage paths ^ Intended usage ^ Notes ^ Project ^ Remarks ^ | ||
+ | | fs10 | 350TB | ''/projects/hep/fs10/shared'' | data that is meant to stay for long time | Slow disk suitable for low read/write frequency | | whole division | | ||
+ | | ::: | ::: | ''/projects/hep/fs10/scratch'' | temporary data | ::: | ::: | ::: | | ||
+ | | ::: | ::: | ''/projects/hep/fs10/users'' | data moved from ''/lunarc/nobackup/users'' | ::: | ::: | ::: | | ||
+ | |||
+ | ==== GRID storage ==== | ||
Lunarc hosts a GRID storage for ATLAS. Currently we are migrating from a 20TB storage to a 100TB. | Lunarc hosts a GRID storage for ATLAS. Currently we are migrating from a 20TB storage to a 100TB. | ||
- | The local storage name is | + | The local storage GRID name is '' SE-SNIC-T2_LUND_LOCALGROUPDISK '' |
- | + | ||
| | ||
- | One can interact through it using the Rucio client. | + | One can interact through it using the Rucio client. It cannot be mounted directly on the cluster. Data can only be moved to and fro. Access is restricted to **ATLAS** members. |
Details on how to access this storage are at this page: http://www.hep.lu.se/grid/localgroupdisk.html | Details on how to access this storage are at this page: http://www.hep.lu.se/grid/localgroupdisk.html |