Skip to content
GitLab
  • Explore
  • Sign in
  • EDA Guides
  • eda-servers-guide
  • Wiki
  • storage

storage · Changes

Page history
Update storage authored May 06, 2021 by Daniele Jahier Pagliari's avatar Daniele Jahier Pagliari
Show whitespace changes
Inline Side-by-side
storage.md
View page @ 90952f0e
......@@ -19,18 +19,18 @@ The minimum between the user and group quotas is what determines the available s
**IMPORTANT:** sysadmins are *not* allowed to modify user quotas for any reason. All requests for a temporary increase of the quota (for legitimate work reasons) should be forwarded directly to Prof. Enrico Macii, who will decide whether to authorize them or not, and inform the sysadmins accordingly.
Below you can find further details on the quotas enforced on each server and on how to transfer data between servers.
Below you can find further details on the quotas enforced in each server and on how to transfer data between servers.
## Storage on Philae
Currently, `philae.polito.it` is where most of the storage resources are. Therefore, the main location for storing your personal data is:
Currently, `philae.polito.it` is where most of the storage resources are. Therefore, the main location for storing your personal work data is:
```
philae.polito.it:/home/<user>
```
The quota settings on philae are as follows:
The (hard) quota settings on philae are as follows:
| Role | Quota |
| ------ | ------ |
......@@ -41,6 +41,38 @@ The quota settings on philae are as follows:
As specified [here](/servers), thesis students do not have access to `icaro.polito.it`. Therefore, the information below is only of interest for other group members.
TO DO...
The storage space on icaro is much more limited with respect to philae. Therefore, this server should **not** be used for permanent storage of data.
The appropriate workflow for icaro is composed of the following steps:
1. Transfer data from your local machine or from philae
2. Run your jobs
3. Save the final results to your local machine or to philae and **remove** all other data.
### Accessing Philae Files from Icaro
To make the aforementioned workflow easier, all users' home directories on `philae.polito.it:/home/<user>` are also visible from icaro as:
```
icaro.polito.it:/philae/<user>
```
This allows you to easily read/write files from/to your main storage location (on philae), as long as you don't exceed the 500GB quota mentioned above.
### Local Storage on Icaro
For temporary local storage, each user has access to two directories:
```
icaro.polito.it:/home/<user>
icaro.polito.it:/space/<user>
```
The quota settings for icaro are as follows.
##### /home/
In `/home/<user>`, each user has a (hard) quota of 10GB. This directory should be used only for configuration files (e.g. RC files) and data that should remain permanently on that server (e.g., [Python Virtual Environments](/virtualenv)).
##### /space/
In `/space/<user>` each user has a (soft) quota of 100GB and a (hard) quota of 5T with a grace period of 7 days. This means that users will be able to occupy a large disk space (more than half of the total 8TB available), but only for short periods of time (less than 7 days). After that, the user will not be able to write to disk anymore until he frees all space exceeding 100GB.
This is intended to allow users to have a large temporary storage (e.g., to store
Clone repository
Home

Server Information
Account
Connecting to the Servers
  • Maintaining a Permanent Shell
  • File Transfers
Storage Management and Quotas
Monitoring Resources
  • Monitoring CPU and RAM
  • Monitoring GPU
  • Monitoring Storage
Gitlab
Software and Libraries
  • Additional Software on Philae (Modules)
  • Remote Code Deployment (Example with PyCharm)
  • Python Virtual Environments
  • EDA Technology Libraries
Miscellaneous
  • Setting CUDA Drivers on Icaro

Sidebar