This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision | ||
iridium_cluster:basic_information [2014/05/28 12:26] florido |
iridium_cluster:basic_information [2017/11/21 16:41] (current) florido [Common files organization] |
||
---|---|---|---|
Line 7: | Line 7: | ||
The cluster is currently composed of the following: | The cluster is currently composed of the following: | ||
- | * Two **nodes for direct access/testing**: they allow users to run interactive jobs. More about them can be read in [[iridium_cluster:testnodes]] | + | * Two **nodes for interactive access/testing**: they allow users to run interactive jobs. More about them can be read in [[iridium_cluster:testnodes]] |
* A **storage server**: used to maintain user home folders, software and data. See [[#Common files organization]] below for details. | * A **storage server**: used to maintain user home folders, software and data. See [[#Common files organization]] below for details. | ||
* A **batch processing** inrterface: allows researchers to run many jobs and schedules them in a fair way using the [[http://www.nordugrid.org/arc|ARC software]]. It manages the cluster nodes. | * A **batch processing** inrterface: allows researchers to run many jobs and schedules them in a fair way using the [[http://www.nordugrid.org/arc|ARC software]]. It manages the cluster nodes. | ||
Line 31: | Line 31: | ||
^ **software** | ''/nfs/software'' | Application software | files smaller than 100MB each | This folder hosts software that is not accessible via cvmfs (see later). This usually includes user/project specific libraries and frameworks. | ''/np'' for Nuclear Physics users | | ^ **software** | ''/nfs/software'' | Application software | files smaller than 100MB each | This folder hosts software that is not accessible via cvmfs (see later). This usually includes user/project specific libraries and frameworks. | ''/np'' for Nuclear Physics users | | ||
^ ::: | ::: | ::: | ::: | ::: | ''/pp'' for Particle Physics users | | ^ ::: | ::: | ::: | ::: | ::: | ''/pp'' for Particle Physics users | | ||
+ | ^ ::: | ::: | ::: | ::: | ::: | ''/tp'' for Theoretical Physics users | | ||
^ **shared** | ''/nfs/shared/'' | Data that will stay for long term | Any file, especially big ones | This folder should be used for long-term stored data. For example, data needed for the whole duration of a phd project or shared among people belonging to the same research group. | ''/np'' for Nuclear Physics users | | ^ **shared** | ''/nfs/shared/'' | Data that will stay for long term | Any file, especially big ones | This folder should be used for long-term stored data. For example, data needed for the whole duration of a phd project or shared among people belonging to the same research group. | ''/np'' for Nuclear Physics users | | ||
^ ::: | ::: | ::: | ::: | ::: | ''/pp'' for Particle Physics users | | ^ ::: | ::: | ::: | ::: | ::: | ''/pp'' for Particle Physics users | | ||
+ | ^ ::: | ::: | ::: | ::: | ::: | ''/tp'' for Theoretical Physics users | | ||
^ **scratch** | ''/nfs/scratch/'' | Data that will stay for short term | Any file, especially big ones | This folder should be used for short-term stored data. For example, data needed for a week long calculation or temporary calculation. This folder should be considered unreliable as its contents will be purged from time to time. The cleanup interval is yet to be decided | ''/np'' for Nuclear Physics users | | ^ **scratch** | ''/nfs/scratch/'' | Data that will stay for short term | Any file, especially big ones | This folder should be used for short-term stored data. For example, data needed for a week long calculation or temporary calculation. This folder should be considered unreliable as its contents will be purged from time to time. The cleanup interval is yet to be decided | ''/np'' for Nuclear Physics users | | ||
^ ::: | ::: | ::: | ::: | ::: | ''/pp'' for Particle Physics users | | ^ ::: | ::: | ::: | ::: | ::: | ''/pp'' for Particle Physics users | | ||
+ | ^ ::: | ::: | ::: | ::: | ::: | ''/tp'' for Theoretical Physics users | | ||
^ **cvmfs** | ''/cvmfs'' | Special folder containing CERN maintained software | user cannot write | This special folder is dedicated to software provided by CERN. This folder is read-only. Usually the content of this folder are managed via specific scripts that a user can run. If you need to add some software that you cannot find, contact the administrators. | ''/geant4.cern.ch'' for Nuclear Physics users | | ^ **cvmfs** | ''/cvmfs'' | Special folder containing CERN maintained software | user cannot write | This special folder is dedicated to software provided by CERN. This folder is read-only. Usually the content of this folder are managed via specific scripts that a user can run. If you need to add some software that you cannot find, contact the administrators. | ''/geant4.cern.ch'' for Nuclear Physics users | | ||
^ ::: | ::: | ::: | ::: | ::: | ''/atlas.cern.ch'' for Particle Physics users | | ^ ::: | ::: | ::: | ::: | ::: | ''/atlas.cern.ch'' for Particle Physics users | | ||
+ | ^ **nodestmp** | ''/nodestmp'' | Contains the /slurmtmp folder of each node, where slurm writes job data. | Any size. The disk is limited to 270GB | Files used by your code that you want to be directly on the node. It is recommended to copy the files there as this will speedup the calculation. | | | ||
+ | ^ **nobackup_aurora** | ''/nfs/nobackup_aurora'' | Contains the ''/projects/hep/fs2-hep/'' folder of the storage connected to the [[:aurora_cluster|Aurora cluster]], to easily move data to and fro the two clusters. This machine can be used to transfer data to the cluster at a fast rate, [[:aurora_cluster:moving_data|check these instructions]] | Any size. Maximum available space for each Division is 18.3TB | Any file | ''/shared'' | | ||
+ | ^ ::: | ::: | ::: | ::: | ::: | ''/scratch'' | | ||
+ | ^ ::: | ::: | ::: | ::: | ::: | ''/software'' | | ||
==== User groups ==== | ==== User groups ==== | ||
Line 46: | Line 53: | ||
^ ppusers | Researchers belonging to **Particle Physics** | primary | | ^ ppusers | Researchers belonging to **Particle Physics** | primary | | ||
^ ppguests | Visitors belonging to **Particle Physics** | primary | | ^ ppguests | Visitors belonging to **Particle Physics** | primary | | ||
- | ^ clusterusers | All users accessing the cluster | secondary only for npusers and ppusers | | + | ^ tpusers | Researchers belonging to **Theoretical Physics** | primary | |
+ | ^ clusterusers | All users accessing the cluster | secondary for npusers, ppusers and tpusers | | ||
Group hierarchy tells how your files are created. Whenever you create a file, its default ownership will be: | Group hierarchy tells how your files are created. Whenever you create a file, its default ownership will be: |