User Tools

Site Tools


iridium_cluster:basic_information

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
iridium_cluster:basic_information [2014/03/21 21:23]
florido
iridium_cluster:basic_information [2017/11/21 17:41] (current)
florido [Common files organization]
Line 7: Line 7:
 The cluster is currently composed of the following: The cluster is currently composed of the following:
  
-  * Two **nodes for testing**: they allow users to run interactive jobs. More about them can be read in [[iridium_cluster:​testnodes]]+  * Two **nodes for interactive access/testing**: they allow users to run interactive jobs. More about them can be read in [[iridium_cluster:​testnodes]]
   * A **storage server**: used to maintain user home folders, software and data. See [[#Common files organization]] below for details.   * A **storage server**: used to maintain user home folders, software and data. See [[#Common files organization]] below for details.
   * A **batch processing** inrterface: allows researchers to run many jobs and schedules them in a fair way using the [[http://​www.nordugrid.org/​arc|ARC software]]. It manages the cluster nodes.   * A **batch processing** inrterface: allows researchers to run many jobs and schedules them in a fair way using the [[http://​www.nordugrid.org/​arc|ARC software]]. It manages the cluster nodes.
Line 31: Line 31:
 ^ **software** | ''/​nfs/​software''​ | Application software ​ | files smaller than 100MB each | This folder hosts software that is not accessible via cvmfs (see later). This usually includes user/​project specific libraries and frameworks. | ''/​np''​ for Nuclear Physics users | ^ **software** | ''/​nfs/​software''​ | Application software ​ | files smaller than 100MB each | This folder hosts software that is not accessible via cvmfs (see later). This usually includes user/​project specific libraries and frameworks. | ''/​np''​ for Nuclear Physics users |
 ^ ::: | ::: | ::: | ::: | ::: | ''/​pp''​ for Particle Physics users | ^ ::: | ::: | ::: | ::: | ::: | ''/​pp''​ for Particle Physics users |
 +^ ::: | ::: | ::: | ::: | ::: | ''/​tp''​ for Theoretical Physics users |
 ^ **shared** | ''/​nfs/​shared/''​ | Data that will stay for long term | Any file, especially big ones | This folder should be used for long-term stored data. For example, data needed for the whole duration of a phd project or shared among people belonging to the same research group. | ''/​np''​ for Nuclear Physics users | ^ **shared** | ''/​nfs/​shared/''​ | Data that will stay for long term | Any file, especially big ones | This folder should be used for long-term stored data. For example, data needed for the whole duration of a phd project or shared among people belonging to the same research group. | ''/​np''​ for Nuclear Physics users |
 ^ ::: | ::: | ::: | ::: | ::: | ''/​pp''​ for Particle Physics users | ^ ::: | ::: | ::: | ::: | ::: | ''/​pp''​ for Particle Physics users |
 +^ ::: | ::: | ::: | ::: | ::: | ''/​tp''​ for Theoretical Physics users |
 ^ **scratch** | ''/​nfs/​scratch/''​ | Data that will stay for short term | Any file, especially big ones | This folder should be used for short-term stored data. For example, data needed for a week long calculation or temporary calculation. This folder should be considered unreliable as its contents will be purged from time to time. The cleanup interval is yet to be decided | ''/​np''​ for Nuclear Physics users | ^ **scratch** | ''/​nfs/​scratch/''​ | Data that will stay for short term | Any file, especially big ones | This folder should be used for short-term stored data. For example, data needed for a week long calculation or temporary calculation. This folder should be considered unreliable as its contents will be purged from time to time. The cleanup interval is yet to be decided | ''/​np''​ for Nuclear Physics users |
 ^ ::: | ::: | ::: | ::: | ::: | ''/​pp''​ for Particle Physics users | ^ ::: | ::: | ::: | ::: | ::: | ''/​pp''​ for Particle Physics users |
 +^ ::: | ::: | ::: | ::: | ::: | ''/​tp''​ for Theoretical Physics users |
 ^ **cvmfs** | ''/​cvmfs''​ | Special folder containing CERN maintained software | user cannot write | This special folder is dedicated to software provided by CERN. This folder is read-only. Usually the content of this folder are managed via specific scripts that a user can run. If you need to add some software that you cannot find, contact the administrators. | ''/​geant4.cern.ch''​ for Nuclear Physics users | ^ **cvmfs** | ''/​cvmfs''​ | Special folder containing CERN maintained software | user cannot write | This special folder is dedicated to software provided by CERN. This folder is read-only. Usually the content of this folder are managed via specific scripts that a user can run. If you need to add some software that you cannot find, contact the administrators. | ''/​geant4.cern.ch''​ for Nuclear Physics users |
 ^ ::: | ::: | ::: | ::: | ::: | ''/​atlas.cern.ch''​ for Particle Physics users | ^ ::: | ::: | ::: | ::: | ::: | ''/​atlas.cern.ch''​ for Particle Physics users |
 +^ **nodestmp** | ''/​nodestmp''​ | Contains the /slurmtmp folder of each node, where slurm writes job data. | Any size. The disk is limited to 270GB | Files used by your code that you want to be directly on the node. It is recommended to copy the files there as this will speedup the calculation. |  |
 +^ **nobackup_aurora** | ''/​nfs/​nobackup_aurora''​ | Contains the ''/​projects/​hep/​fs2-hep/''​ folder of the storage connected to the [[:​aurora_cluster|Aurora cluster]], to easily move data to and fro the two clusters. This machine can be used to transfer data to the cluster at a fast rate, [[:​aurora_cluster:​moving_data|check these instructions]] | Any size. Maximum available space for each Division is 18.3TB | Any file | ''/​shared''​ |
 +^ ::: | ::: | ::: | ::: | ::: | ''/​scratch'' ​ |
 +^ ::: | ::: | ::: | ::: | ::: | ''/​software''​ |
  
 ==== User groups ==== ==== User groups ====
Line 46: Line 53:
 ^ ppusers | Researchers belonging to **Particle Physics** | primary | ^ ppusers | Researchers belonging to **Particle Physics** | primary |
 ^ ppguests | Visitors belonging to **Particle Physics** | primary | ^ ppguests | Visitors belonging to **Particle Physics** | primary |
-^ clusterusers | All users accessing the cluster | secondary ​only for npusers ​and ppusers |+^ tpusers | Researchers belonging to **Theoretical Physics** | primary | 
 +^ clusterusers | All users accessing the cluster | secondary for npusersppusers ​and tpusers ​|
  
 Group hierarchy tells how your files are created. Whenever you create a file, its default ownership will be: Group hierarchy tells how your files are created. Whenever you create a file, its default ownership will be:
iridium_cluster/basic_information.1395433420.txt.gz · Last modified: 2014/03/21 21:23 by florido