User Tools

Site Tools


aurora_cluster:storage

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
Next revision Both sides next revision
aurora_cluster:storage [2017/04/12 10:39]
florido [Dedicated storage for Particle Physics]
aurora_cluster:storage [2017/05/02 17:55]
florido [Dedicated storage for Particle Physics]
Line 10: Line 10:
 Please follow these rules to keep the storage tidy. Please follow these rules to keep the storage tidy.
  
-  - Whenever you need to move data to one of the shared folders below,\\ **create a folder with your username** and put the data in there.\\ In this way you keep your data away from unwanted people and you can set all the permissions you want on it. +  - Whenever you need to move data to one of the shared folders below,\\ **create a folder with a name than can be understood by everyone** and put the data in there
-    - Example: <​code:​bash>#​ create folder +  - If the data has been generated by you or if it is for your exclusive use, **create a folder with your username** to accomodate the data. \\ In this way you keep your data away from unwanted people and you can set all the permissions you want on it.
-[pflorido@aurora1 hep]$ mkdir /​projects/​hep/​nobackup/​shared/​pp/​pflorido +
-# copy data +
-[pflorido@aurora1 hep]$ cp mydata ​ /​projects/​hep/​nobackup/​shared/​pp/​pflorido/​mydata +
-# list file permissions +
-[pflorido@aurora1 ~]$ ls -ltrah /​projects/​hep/​nobackup/​shared/​pp/​pflorido/​mydata +
--rw-r--r--. 1 pflorido hep 0 12 apr 12.32 /​projects/​hep/​nobackup/​shared/​pp/​pflorido/​mydata +
-# change to read/write only user and group (no rights to everyone) +
-[pflorido@aurora1 ~]$ chmod 660 /​projects/​hep/​nobackup/​shared/​pp/​pflorido/​mydata +
-# check applied permissions +
-[pflorido@aurora1 ~]$ ls -ltrah /​projects/​hep/​nobackup/​shared/​pp/​pflorido/​mydata +
--rw-rw----. 1 pflorido hep 0 12 apr 12.32 /​projects/​hep/​nobackup/​shared/​pp/​pflorido/​mydata</​code> ​+
     * Data found outside a folder named after a user it is a good candidate to be deleted. Of course there can be exceptions when needed.     * Data found outside a folder named after a user it is a good candidate to be deleted. Of course there can be exceptions when needed.
   - Remove data that you don't use, for example from the ''​scratch''​ folders. Be kind to your colleagues! storage has a cost.   - Remove data that you don't use, for example from the ''​scratch''​ folders. Be kind to your colleagues! storage has a cost.
 +  - Follow the instructions at [[aurora_cluster:​moving_data|Moving Data to and from the Aurora cluster]] when you start moving data around.
 ===== Nuclear, Particle and Theorerical Physics ===== ===== Nuclear, Particle and Theorerical Physics =====
  
Line 59: Line 49:
 ==== Dedicated storage for Particle Physics ==== ==== Dedicated storage for Particle Physics ====
  
-Particle Physics can share data to the Iridium Cluster and has two additional storage servers listed below for their exclusive use.+Particle Physics can share data to the [[:​iridium_cluster|Iridium Cluster]] and has two additional storage servers listed below for their exclusive use.
  
 Users not belonging to the division of Particle Physics might be warned to remove their data from those storages, unless otherwise agreed with the Particle Physics division. Users not belonging to the division of Particle Physics might be warned to remove their data from those storages, unless otherwise agreed with the Particle Physics division.
  
-==== Storage on Iridium ​====+=== Storage on Iridium ===
  
 The Iridium storage is still accessible at The Iridium storage is still accessible at
Line 71: Line 61:
 Please refer to the documentation at [[iridium_cluster:​basic_information]] for it. Please refer to the documentation at [[iridium_cluster:​basic_information]] for it.
  
-==== Additional dedicated storage ​====+=== Additional dedicated storage ===
  
 There are two storage servers installed for the exclusive use of particle physics. There are two storage servers installed for the exclusive use of particle physics.
Line 79: Line 69:
  
 ^ Storage path ^ Intended usage ^ Size ^ ^ Storage path ^ Intended usage ^ Size ^
-| ''/​project/​hep/​fs3/​shared''​ | data that is meant to stay for long time | 35TB | +| ''/​projects/​hep/​fs3/​shared''​ | data that is meant to stay for long time | 35TB | 
-| ''/​project/​hep/​fs4/​scratch''​ | temporary data | 35TB |+| ''/​projects/​hep/​fs4/​scratch''​ | temporary data | 35TB | 
 + 
 +=== Grid storage === 
 + 
 +Lunarc hosts a grid storage for ATLAS. Currently we are migrating from a 20TB storage to a 100TB. 
 + 
 +The local storage name is 
 +   
 +   
 +One can interact through it using the Rucio client.  
 + 
 +Details on how to access this storage are at this page: http://​www.hep.lu.se/​grid/​localgroupdisk.html 
 + 
 +More on how to do transfers at [[aurora_cluster:​moving_data | Moving data to and from the cluster]] 
  
 ===== Mathematical Physics ===== ===== Mathematical Physics =====
  
 At the moment, only the user folders are available. We are negotiating a 10TB common storage with Lunarc. More information is soon to come. At the moment, only the user folders are available. We are negotiating a 10TB common storage with Lunarc. More information is soon to come.
aurora_cluster/storage.txt · Last modified: 2020/11/19 09:52 by florido

Accessibility Statement