The NERSC CMB Data Analysis Repositories

Repository Resources

Repositories are annual allocations of high performance computing resources, comprising

CPU cycles measured in massively parallel processing (MPP) hours, and
HPSS data archiving measured in storage resource units (SRU) which includes both data transfer and storage.

There are three repositories for CMB data analysis

mp107 is for sub-orbital experiments. It is currently shared by about 50 users from 10 experiments, and its initial 2009 allocation is of 100,000 Franklin-based MPP-hours and 55,000 SRUs.

planck is for the Planck satellite mission. It is currently shared by about 50 users, and its initial 2009 allocation is of 500,000 Franklin-based MPP-hours and 200,000 SRUs.

cmbpol is for the proposed CMBpol satellite mission. It is currently shared by about 10 users, and its initial 2009 allocation is of 80,000 Franklin-based MPP-hours and 50,000 SRUs.

Each user in a repository is given access to a fraction (typically 5%) of the total allocation. If you exhaust your allowance please contact me about increasing your limit.

If you are a member of multiple repositories please be careful to charge each of your jobs to the appropriate one.

To check the current status of the allocation you can use the getnim command on any of the NERSC machines (with "repo" set to either mp107 or planck as appropriate):

for the total remaining allocation in hours: getnim -R repo
for the remaining allocation available to a particular user: getnim -R repo -U username
for the amount of time used so far by each user: getnim -R repo -L

Individual & Project Disk Spaces

Individual users have disk quotas (of both space and inodes) on each of the NERSC machines. If you exhaust your quota - and you have archived everything you can - contact me about requesting an increased quota.

In addition each repository has a project directory on the NERSC global filesystem (NGF) which is mounted on all of the NERSC machines. Unlike the individual scratch directories this space is not automatically purged - please take care to archive and/or delete files that are not in active use. Subdirectories have been set up for each experiment using the NERSC facilities that are accessible only to members of the corresponding filegroup.

Filegroups

Every experiment has a UNIX filegroup defined for it to allow proprietory and/or sensitive files to be shared between members of that group.

to check the group(s) that you belong use: groups

If you are not in a filegroup that you should be in please contact me.

You can

change the group of any file/directory using: chgrp filegroup file/directory-name
set the file/directory group permissions to make it readable using: chmod g+rX file/directory-name

You can also set a different filegroup for particular session, which will ensure that all the files/directories created during that session will have the required group properties.

to change your group use: newgrp filegroup

Modules

Popular analysis software is avaiable through a CMB module on all the NERSC machines. Certain experiments also have their own modules for dedicated software; to find out more contact me.