Configuring AWS Client¶
The aws commandline utility is installed as a part of the andersen-lab-env
You must provide the appropriate s3 credentials in order to backup BAMs. Erik knows where these are.
Backing up BAMS to Amazon S3¶
BAMS are uploaded to S3. This allows us to back them up there and access them through CeNDR.
Currently, the only BAMs that we upload to s3 are wild isolate BAMs. Once you've added new sequence data you can sync the new BAMs by running the following:
# First, cd to the location of isotype bams cd /projects/b1059/data/alignments/WI/isotype # Then run the following command aws s3 sync . s3://elegansvariation.org/bam
In addition to backing up BAMs on S3, we also backup FASTQs locally. There are four hard drives:
- PortusTotus - FASTQ Backup 1
- Hawkeye - FASTQ Backup 2
- Armadillo - open
- Rhino - open
Each one is labeled with what is backed up on it. After you have added new sequenced data you should sync FROM the data/fastq folder on b1059 TO the the PortusTotus (FASTQ Backup 1) and Hawkeye (FASTQ Backup 2) hard drives.