| ... | ... | @@ -4,20 +4,15 @@ |
|
|
|
|
|
|
|
# Quota purpose
|
|
|
|
|
|
|
|
Storage space is finite and expensive and the mass storage is shared by several
|
|
|
|
Storage space is finite and expensive and the mass storage is shared by several
|
|
|
|
teams and users. For this reason, space allocated to each research team, platform and user is limited by a quota.
|
|
|
|
Quotas are also needed for safety reasons, mostly to prevent a user from filling the whole
|
|
|
|
Quotas are also needed for safety reasons, mostly to prevent a user from filling the whole
|
|
|
|
disk space (for example with an infinite loop in a script) and so blocking the whole system.
|
|
|
|
|
|
|
|
**IMPORTANT**: Once the quota of a folder is reached, users stop being able to write in it.
|
|
|
|
If this happen while saving files, it may lead to data corruption and loss of data.
|
|
|
|
Some tools will give a warning or an error message but others will not.
|
|
|
|
**It is the user's responsibility to make sure there is enough space to write in the folder.**
|
|
|
|
Quotas can be adapted to the needs of the different teams and users as long as
|
|
|
|
the request is reasonable and that there is enough free space on the mass storage.
|
|
|
|
|
|
|
|
**NB: quotas have no influence on the billing process** which is based
|
|
|
|
on the actual disk usage and not on the quota set on each team's folder (see [billing page](mass-storage/mass-storage-billing) for more information).
|
|
|
|
**IMPORTANT**: Once the quota of a folder is reached, users stop being able to write in it.
|
|
|
|
If this happen while saving files, it may lead to data corruption and loss of data.
|
|
|
|
Some tools will give a warning or an error message but others will not.
|
|
|
|
**It is the user's responsibility to make sure there is enough space to write in a folder.**
|
|
|
|
|
|
|
|
|
|
|
|
|
| ... | ... | @@ -28,30 +23,33 @@ on the actual disk usage and not on the quota set on each team's folder (see [bi |
|
|
|
|
|
|
|
1. **User's personal `home` folder**
|
|
|
|
|
|
|
|
The space is limited to **100 GB**. All files present in the user's home folder and all its sub-folders are included in this quota, with the exception of files in the links in the `_SHARE_` folder (`Research`, `Platforms`, `Administration` or `Resources`).
|
|
|
|
The space is limited to **100 GB**. All files present in the user's home folder and all its sub-folders are included in this quota, with the exception of files in the links in the `_SHARE_` folder (`Research`, `Platforms`, `Administration` or `Resources`).
|
|
|
|
|
|
|
|
Once this limit is reached, the user will not be able to create/save any files in their `home`.
|
|
|
|
Once this limit is reached, the user will not be able to create/save any files in their `home`.
|
|
|
|
|
|
|
|
2. **Research units**
|
|
|
|
|
|
|
|
By default, quotas of the Research Units are defined at the level of each team
|
|
|
|
(see [URT tree structure](mass-storage/mass-storage-URT)).
|
|
|
|
However, if several teams belonging to a same laboratory or unit share the same folders
|
|
|
|
on the mass storage, the quota can be set at the laboratory or unit level.
|
|
|
|
Research's folder quotas can be adapted to the needs of the different teams and users as long as
|
|
|
|
the request is reasonable and that there is enough free space on the mass storage.
|
|
|
|
|
|
|
|
By default, quotas of the Research Units are defined at the level of each team
|
|
|
|
(see [URT tree structure](mass-storage/mass-storage-URT)).
|
|
|
|
However, if several teams belonging to a same laboratory or unit share the same folders
|
|
|
|
on the mass storage, the quota can be set at the laboratory or unit level.
|
|
|
|
It is important to stress that in this case, if a member
|
|
|
|
of one of the teams completely fills up the allocated space, the whole laboratory/unit will **not* be able
|
|
|
|
of one of the teams completely fills up the allocated space, the whole laboratory/unit will **not* be able
|
|
|
|
to write on the mass storage anymore until data are deleted or the quota increased.
|
|
|
|
|
|
|
|
**NB**: Files transferred by the platforms to research teams via the
|
|
|
|
[platform-shared folders](mass-storage/mass-storage-structure-organisation#platform-shared-folders)
|
|
|
|
are also included in the team's quota.
|
|
|
|
**NB**: Files transferred by the platforms to research teams via the
|
|
|
|
[platform-shared folders](mass-storage/mass-storage-structure-organisation#platform-shared-folders)
|
|
|
|
are also included in the team's quota.
|
|
|
|
|
|
|
|
Once a team reaches its quota, it is not possible anymore to write anything in any of the projects, `SHARE` and `PLATFORMS` folders attached to that team.
|
|
|
|
Once a team reaches its quota, it is not possible to write anything in any of the projects, `SHARE` and `PLATFORMS` folders attached to that team. Therefore if you know you are going to generate lots of data, please follow the instructions in the "What to do if a folder is about to reach its quota?" section below.
|
|
|
|
|
|
|
|
3. **Platforms**
|
|
|
|
|
|
|
|
Quotas are set at the level of the teams (see [PTF tree structure](mass-storage/mass-storage-PTF))
|
|
|
|
unless there is no team and in this case, the quota is set on the Platforms main folder.
|
|
|
|
Quotas are set at the level of the teams (see [PTF tree structure](mass-storage/mass-storage-PTF))
|
|
|
|
unless there is no team and in this case, the quota is set on the Platforms main folder.
|
|
|
|
|
|
|
|
|
|
|
|
Files transferred by the platforms to research teams via the [platform-shared folders](mass-storage/mass-storage-structure-organisation#platform-shared-folders) are not included in the platform's quota but in the associated research laboratory's quota.
|
| ... | ... | @@ -59,37 +57,37 @@ Files transferred by the platforms to research teams via the [platform-shared fo |
|
|
|
|
|
|
|
## Important recommendations
|
|
|
|
|
|
|
|
- **Always check the space left** in a directory **before any transfer/writing of a large volume of data**.
|
|
|
|
- **Always check the space left** in a directory **before any transfer/writing of a large volume of data**.
|
|
|
|
If not done, it may lead to the loss or corruption of data .
|
|
|
|
- Before starting a new project, you should estimate the space that the new data/analyses will require in order to check if it will be possible to store them on the mass storage and if needed adjust your quota in advance.
|
|
|
|
- Before starting a new project, you should estimate the space that the new data/analyses will require in order to check if it will be possible to store them on the mass storage and if needed adjust your quota in advance.
|
|
|
|
The bioinformatics team can help you to do this estimation.
|
|
|
|
- Do not hesitate to contact the [Bioinformatics team](contacts) if you have any question
|
|
|
|
- Do not hesitate to contact the [Bioinformatics team](contacts) if you have any question
|
|
|
|
about quota implementation or the arborescence of your unit/lab/team folder on the mass storage.
|
|
|
|
|
|
|
|
# Practical considerations
|
|
|
|
|
|
|
|
## How to find out how much space is available in a folder?
|
|
|
|
We are currently developing a tool that will allow each user to check the quota allocated to
|
|
|
|
a given laboratory/platform/home folder, and the percentage of this quota currently used.
|
|
|
|
In the meantime, for their home folder, users can check the disk usage and therefore calculate how much space remains before reaching 100GB.
|
|
|
|
## How to find out how much space is available in a folder?
|
|
|
|
We are currently developing a tool that will allow each user to check the quota allocated to
|
|
|
|
a given laboratory/platform/home folder, and the percentage of this quota currently used.
|
|
|
|
In the meantime, for their home folder, users can check the disk usage and therefore calculate how much space remains before reaching 100GB.
|
|
|
|
For laboratories and platforms quotas, users can contact the [Bioinformatics team](contacts).
|
|
|
|
|
|
|
|
## What to do if a folder is about to reach its quota?
|
|
|
|
1. Check that your increase in disk space usage is not coming from a script generating useless/unwanted files
|
|
|
|
2. Go through your data to delete all files and folders that are not needed anymore and compress data files when possible.
|
|
|
|
Several recommendations to reduce disk space usage can also be found in the [“Data maintenance”](mass-storage/mass-storage-management-practices) section.
|
|
|
|
## What to do if a folder is about to reach its quota?
|
|
|
|
1. Check that your increase in disk space usage is not coming from a script generating useless/unwanted files
|
|
|
|
2. Go through your data to delete all files and folders that are not needed anymore and compress data files when possible.
|
|
|
|
Several recommendations to reduce disk space usage can also be found in the [“Data maintenance”](mass-storage/mass-storage-management-practices) section.
|
|
|
|
If needed, the UDI GIGA-MED IT specialists or the bioinformatics team can help to find ways to further reduce disk space usage.
|
|
|
|
3. If after tidying up your data, you still need more space, you can ask for an extension as described below.
|
|
|
|
|
|
|
|
|
|
|
|
## Modalities to require an extension
|
|
|
|
|
|
|
|
If required for a specific project, the PI can contact the UDI GIGA-MED IT specialists
|
|
|
|
or the bioinformatics team (see [contacts](contacts) )
|
|
|
|
to ask for an extension of the storage space quota.
|
|
|
|
This request for more storage space will have to be reasonable and justified.
|
|
|
|
If required for a specific project, the PI can contact the UDI GIGA-MED IT specialists
|
|
|
|
or the bioinformatics team (see [contacts](contacts) )
|
|
|
|
to ask for an extension of the storage space quota.
|
|
|
|
This request for more storage space will have to be reasonable and justified.
|
|
|
|
Moreover, the acquisition of this extension will depend on the space left on the mass storage.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
# [Contacts](contacts) |
|
|
\ No newline at end of file |
|
|
|
# [Contacts](contacts) |
