1 Warming Up

In this module, we will:

  • cover basic materials needed
  • familiarize ourselves with remote computing
  • prepare for later modules

1.1 Building Blocks







1.2 Example Files Exercise:

  1. Download the zipped archive from the slack channel
  2. Locate, move (if desired), and unzip it
  3. Remember how to access these files







1.3 Local vs Remote Exercise:

  1. Become familiar with the appearance of the local shell
  2. Briefly explore your local files (optional)
  3. Log in to the aws instance with ssh <username>@bfx-workshop01.med.umich.edu
  4. Become familiar with appearance of the remote shell
  5. Use ls to view references
  6. Use ls to view input fastq files
  7. Use mkdir to create a folder for our analysis




# Familiarize with local shell appearance
# Briefly explore your local files
ls -l
# Log in to the aws instance via ssh
ssh <username>@bfx-workshop01.med.umich.edu
# Familiarize yourself with differences between local and remote shell
# View our references
ls ~/RSD_Shell/refs
# View our input fastq files
ls ~/RSD_Shell/reads
# Create a folder for our analysis
mkdir ~/RSD_Shell/analysis




Click here for demonstration comparing local Windows command prompt vs remote (AWS)

















LS0tCnRpdGxlOiAiRGF5IDEgLSBNb2R1bGUgMDE6IFdhcm1pbmcgdXAiCmF1dGhvcjogIlVNIEJpb2luZm9ybWF0aWNzIENvcmUiCm91dHB1dDoKICAgICAgICBodG1sX2RvY3VtZW50OgogICAgICAgICAgICBpbmNsdWRlczoKICAgICAgICAgICAgICAgIGluX2hlYWRlcjogaGVhZGVyLmh0bWwKICAgICAgICAgICAgdGhlbWU6IHBhcGVyCiAgICAgICAgICAgIHRvYzogdHJ1ZQogICAgICAgICAgICB0b2NfZGVwdGg6IDQKICAgICAgICAgICAgdG9jX2Zsb2F0OiB0cnVlCiAgICAgICAgICAgIG51bWJlcl9zZWN0aW9uczogdHJ1ZQogICAgICAgICAgICBmaWdfY2FwdGlvbjogdHJ1ZQogICAgICAgICAgICBtYXJrZG93bjogR0ZNCiAgICAgICAgICAgIGNvZGVfZG93bmxvYWQ6IHRydWUKLS0tCjxzdHlsZSB0eXBlPSJ0ZXh0L2NzcyI+CmJvZHl7IC8qIE5vcm1hbCAgKi8KICAgICAgZm9udC1zaXplOiAxNHB0OwogIH0KcHJlIHsKICBmb250LXNpemU6IDEycHQKfQo8L3N0eWxlPgoKIyBXYXJtaW5nIFVwCgpJbiB0aGlzIG1vZHVsZSwgd2Ugd2lsbDoKCiogY292ZXIgYmFzaWMgbWF0ZXJpYWxzIG5lZWRlZAoqIGZhbWlsaWFyaXplIG91cnNlbHZlcyB3aXRoIHJlbW90ZSBjb21wdXRpbmcKKiBwcmVwYXJlIGZvciBsYXRlciBtb2R1bGVzCgojIyBCdWlsZGluZyBCbG9ja3MKCjxicj4KPGJyPgo8YnI+CjxpbWcgc3JjPSJpbWFnZXMvYnVpbGRpbmctYmxvY2tzLnBuZyIgd2lkdGg9IjgwMCIgLz4KPGJyPgo8YnI+Cjxicj4KCgojIyBFeGFtcGxlIEZpbGVzIEV4ZXJjaXNlOgoKMS4gRG93bmxvYWQgdGhlIHppcHBlZCBhcmNoaXZlIGZyb20gdGhlIHNsYWNrIGNoYW5uZWwKMi4gTG9jYXRlLCBtb3ZlIChpZiBkZXNpcmVkKSwgYW5kIHVuemlwIGl0CjMuIFJlbWVtYmVyIGhvdyB0byBhY2Nlc3MgdGhlc2UgZmlsZXMKCjxicj4KPGJyPgo8YnI+Cjxicj4KPGJyPgo8YnI+CgojIyBMb2NhbCB2cyBSZW1vdGUgRXhlcmNpc2U6CgoxLiBCZWNvbWUgZmFtaWxpYXIgd2l0aCB0aGUgYXBwZWFyYW5jZSBvZiB0aGUgbG9jYWwgc2hlbGwKMi4gQnJpZWZseSBleHBsb3JlIHlvdXIgbG9jYWwgZmlsZXMgKG9wdGlvbmFsKQozLiBMb2cgaW4gdG8gdGhlIGF3cyBpbnN0YW5jZSB3aXRoIGBzc2ggPHVzZXJuYW1lPkBiZngtd29ya3Nob3AwMS5tZWQudW1pY2guZWR1YAo0LiBCZWNvbWUgZmFtaWxpYXIgd2l0aCBhcHBlYXJhbmNlIG9mIHRoZSByZW1vdGUgc2hlbGwKNS4gVXNlIGBsc2AgdG8gdmlldyByZWZlcmVuY2VzCjYuIFVzZSBgbHNgIHRvIHZpZXcgaW5wdXQgZmFzdHEgZmlsZXMKNy4gVXNlIGBta2RpcmAgdG8gY3JlYXRlIGEgZm9sZGVyIGZvciBvdXIgYW5hbHlzaXMKCjxicj4KPGJyPgo8YnI+CgpgYGAKIyBGYW1pbGlhcml6ZSB3aXRoIGxvY2FsIHNoZWxsIGFwcGVhcmFuY2UKIyBCcmllZmx5IGV4cGxvcmUgeW91ciBsb2NhbCBmaWxlcwpscyAtbAojIExvZyBpbiB0byB0aGUgYXdzIGluc3RhbmNlIHZpYSBzc2gKc3NoIDx1c2VybmFtZT5AYmZ4LXdvcmtzaG9wMDEubWVkLnVtaWNoLmVkdQojIEZhbWlsaWFyaXplIHlvdXJzZWxmIHdpdGggZGlmZmVyZW5jZXMgYmV0d2VlbiBsb2NhbCBhbmQgcmVtb3RlIHNoZWxsCiMgVmlldyBvdXIgcmVmZXJlbmNlcwpscyB+L1JTRF9TaGVsbC9yZWZzCiMgVmlldyBvdXIgaW5wdXQgZmFzdHEgZmlsZXMKbHMgfi9SU0RfU2hlbGwvcmVhZHMKIyBDcmVhdGUgYSBmb2xkZXIgZm9yIG91ciBhbmFseXNpcwpta2RpciB+L1JTRF9TaGVsbC9hbmFseXNpcwpgYGAKCgo8YnI+Cjxicj4KPGJyPgoKPGRldGFpbHM+CjxzdW1tYXJ5PkNsaWNrIGhlcmUgZm9yIGRlbW9uc3RyYXRpb24gY29tcGFyaW5nIGxvY2FsIFdpbmRvd3MgY29tbWFuZCBwcm9tcHQgdnMgcmVtb3RlIChBV1MpPC9zdW1tYXJ5PgoKPGltZyBzcmM9ImltYWdlcy9sb2NhbF92X3JlbW90ZS5naWYiIHdpZHRoPSI4MDAiIC8+Cgo8L2RldGFpbHM+Cgo8YnI+Cjxicj4KPGJyPgo8YnI+Cjxicj4KPGJyPgo8aW1nIHNyYz0iaW1hZ2VzL2J1aWxkaW5nLWJsb2Nrcy1jaGVja21hcmsucG5nIiB3aWR0aD0iODAwIiAvPgo8YnI+Cjxicj4KPGJyPgo8YnI+Cjxicj4KPGJyPgo8YnI+Cjxicj4KPGJyPgo8YnI+Cg==