The Andersen Lab makes use of Quest, the supercomputer at Northwestern. Take some time to read over the overview of what Quest is, what it does, how to use it, and how to sign up:
Signing into Quest¶
After you gain access to the cluster you can login using:
I recommend setting an alias in your
.bash_profile to make logging in quicker:
alias quest="ssh <netid>@quest.it.northwestern.edu"
The above line makes it so you simply type
quest and the login process is initiated.
If you are not familiar with what a bash profile is, take a look at this.
When you login it is important to be conscientious of the fact that you are on a login node. You should not be running any sort of heavy duty operation on these nodes. Instead, any analysis you perform should be submitted as a job or run using an interactive job (see below).
Logging in places you in your home directory. You can install software in your home directory for use when you run jobs, or for small files/analysis.
Your home directory has a quota of 80 Gb. More information on quotas, storage, etc..
More information is provided below to help install and use software.
Quest is broadly organized into projects. Projects have associated with them storage, nodes, and users.
The Andersen lab has access to two projects.
b1042 - The 'Genomics' Project has 155 Tb of space and 100 nodes associated with it. This space is shared with other labs and is designed for temporary use only (covered in greater detail in the Nextflow Section). The space is available at
/projects/b1042/AndersenLab/. By default, files are deleted after 30 days.
b1059 - The Andersen Lab Project. b1059 does not have any nodes associated with it, but it does have 10 Tb of storage. b1059 storage is located at:
The overall directory structure of
/projects/b1059/ is as follows:
- data - fastqs, bams, and other data.
- software - Centrally used software can be stored here.
- projects - Individual projects that have a definitive endpoint.
- workflows - Workflows used in ongoing projects. For example, Wild Isolate, RIL, and NIL sequencing.
- analysis - Output from workflows run on ongoing projects.
Installing and using software¶
Quest comes with a command called
module that allows you to load software for use. The following commands can be used to see/load software.
module avail- List available software.
module load software/version- Load a software package (e.g.
module load R/3.3.1).
Linuxbrew is a fork of Homebrew - which is a package manager for MacOSX. Linuxbrew should be installed in your home directory using the following command:
A lot of the software you use can be installed using a
The Andersen Lab has access to the 'Genomics' project
Starting interactive jobs¶
The command below will start up an interactive job.
msub -I -A b1042