Transfer MultiQC Report With scp Exercise
(Breakout)
15 Minutes
We just tried two new variations of our MultiQC command, one pointed
at the directory of our trimmed FastQC results, and another at the whole
project directory. For convenience, we’ve included these reports in the
zipped folder you downloaded at the beginning of the class. However,
it’s also useful to know how to transfer data to/from a remote instance.
We’ll explore how to use scp in this exercise.
Instructions:
- One group member should share their screen in the breakout room. If
nobody volunteers, a helper may randomly select someone.
- The group members should discuss the exercise and work together to
find a solution.
- After a solution is found, allow time for all members to complete
the exercise.
- Make sure that you are viewing your local terminal. The
scp command should be run from your own machine.
- Use
scp to transfer the trimmed read fastqc report and
the comprehensive (all) report from the AWS machine to your personal
computer.
- Confirm that you’ve received the reports
Hint: The command format is:
scp source destination
You will need to provide your ssh login information to complete the
transfer
Solution - Transfer MultiQC Report With scp
Exercise
Helper Hint: On the AWS instance, the multiQC reports have identical
filenames. It is helpful to specify the destination filename for each
transfer below, so that the reports can be easily differentiated (and
don’t overwrite one another).
Helper Hint: Users must know that they should run scp
from their local computer, not from the AWS
instance.
# Transfer the report of trimmed read results
scp <username>@bfx-workshop01.med.umich.edu:~/RSD_Shell/analysis/out_multiqc_cutadapt/multiqc_report.html ~/rsd-workshop/multiqc_report_trimmed.html
# Transfer the full report
scp <username>@bfx-workshop01.med.umich.edu:~/RSD_Shell/analysis/out_multiqc_all/multiqc_report.html ~/rsd-workshop/multiqc_report_all.html
LS0tCnRpdGxlOiAiRGF5IDIgLSBCcmVha291dCAwMyIKYXV0aG9yOiAiVU0gQmlvaW5mb3JtYXRpY3MgQ29yZSIKb3V0cHV0OgogICAgICAgIGh0bWxfZG9jdW1lbnQ6CiAgICAgICAgICAgIGluY2x1ZGVzOgogICAgICAgICAgICAgICAgaW5faGVhZGVyOiBoZWFkZXIuaHRtbAogICAgICAgICAgICB0aGVtZTogcGFwZXIKICAgICAgICAgICAgZmlnX2NhcHRpb246IHRydWUKICAgICAgICAgICAgbWFya2Rvd246IEdGTQogICAgICAgICAgICBjb2RlX2Rvd25sb2FkOiB0cnVlCi0tLQo8c3R5bGUgdHlwZT0idGV4dC9jc3MiPgpib2R5eyAvKiBOb3JtYWwgICovCiAgICAgIGZvbnQtc2l6ZTogMTRwdDsKICB9CnByZSB7CiAgZm9udC1zaXplOiAxMnB0Cn0KPC9zdHlsZT4KCjxicj4KCiMjIFRyYW5zZmVyIE11bHRpUUMgUmVwb3J0IFdpdGggYHNjcGAgRXhlcmNpc2UgKEJyZWFrb3V0KQoKPGJyPgoKKioxNSBNaW51dGVzKioKCjxicj4KCldlIGp1c3QgdHJpZWQgdHdvIG5ldyB2YXJpYXRpb25zIG9mIG91ciBNdWx0aVFDIGNvbW1hbmQsIG9uZSBwb2ludGVkIGF0IHRoZSBkaXJlY3Rvcnkgb2Ygb3VyIHRyaW1tZWQgRmFzdFFDIHJlc3VsdHMsIGFuZCBhbm90aGVyIGF0IHRoZSB3aG9sZSBwcm9qZWN0IGRpcmVjdG9yeS4gRm9yIGNvbnZlbmllbmNlLCB3ZSd2ZSBpbmNsdWRlZCB0aGVzZSByZXBvcnRzIGluIHRoZSB6aXBwZWQgZm9sZGVyIHlvdSBkb3dubG9hZGVkIGF0IHRoZSBiZWdpbm5pbmcgb2YgdGhlIGNsYXNzLiBIb3dldmVyLCBpdCdzIGFsc28gdXNlZnVsIHRvIGtub3cgaG93IHRvIHRyYW5zZmVyIGRhdGEgdG8vZnJvbSBhIHJlbW90ZSBpbnN0YW5jZS4gV2UnbGwgZXhwbG9yZSBob3cgdG8gdXNlIGBzY3BgIGluIHRoaXMgZXhlcmNpc2UuCgo8YnI+CgojIyMgSW5zdHJ1Y3Rpb25zOgoKPGJyPgoKLSBPbmUgZ3JvdXAgbWVtYmVyIHNob3VsZCBzaGFyZSB0aGVpciBzY3JlZW4gaW4gdGhlIGJyZWFrb3V0IHJvb20uIElmIG5vYm9keSB2b2x1bnRlZXJzLCBhIGhlbHBlciBtYXkgcmFuZG9tbHkgc2VsZWN0IHNvbWVvbmUuCi0gVGhlIGdyb3VwIG1lbWJlcnMgc2hvdWxkIGRpc2N1c3MgdGhlIGV4ZXJjaXNlIGFuZCB3b3JrIHRvZ2V0aGVyIHRvIGZpbmQgYSBzb2x1dGlvbi4KLSBBZnRlciBhIHNvbHV0aW9uIGlzIGZvdW5kLCBhbGxvdyB0aW1lIGZvciBhbGwgbWVtYmVycyB0byBjb21wbGV0ZSB0aGUgZXhlcmNpc2UuCgo8YnI+CgotIE1ha2Ugc3VyZSB0aGF0IHlvdSBhcmUgdmlld2luZyB5b3VyIGxvY2FsIHRlcm1pbmFsLiBUaGUgYHNjcGAgY29tbWFuZCBzaG91bGQgYmUgcnVuIGZyb20geW91ciBvd24gbWFjaGluZS4KLSBVc2UgYHNjcGAgdG8gdHJhbnNmZXIgdGhlIHRyaW1tZWQgcmVhZCBmYXN0cWMgcmVwb3J0IGFuZCB0aGUgY29tcHJlaGVuc2l2ZSAoYWxsKSByZXBvcnQgZnJvbSB0aGUgQVdTIG1hY2hpbmUgdG8geW91ciBwZXJzb25hbCBjb21wdXRlci4KLSBDb25maXJtIHRoYXQgeW91J3ZlIHJlY2VpdmVkIHRoZSByZXBvcnRzCgo8YnI+Cgo+IEhpbnQ6IFRoZSBjb21tYW5kIGZvcm1hdCBpczoKPgo+IH5+fgo+IHNjcCBzb3VyY2UgZGVzdGluYXRpb24KPiB+fn4KPgo+IFlvdSB3aWxsIG5lZWQgdG8gcHJvdmlkZSB5b3VyIHNzaCBsb2dpbiBpbmZvcm1hdGlvbiB0byBjb21wbGV0ZSB0aGUgdHJhbnNmZXIKCjxicj4KCiMjIyBTb2x1dGlvbiAtIFRyYW5zZmVyIE11bHRpUUMgUmVwb3J0IFdpdGggYHNjcGAgRXhlcmNpc2UKCj4gSGVscGVyIEhpbnQ6IE9uIHRoZSBBV1MgaW5zdGFuY2UsIHRoZSBtdWx0aVFDIHJlcG9ydHMgaGF2ZSBpZGVudGljYWwgZmlsZW5hbWVzLiBJdCBpcyBoZWxwZnVsIHRvIHNwZWNpZnkgdGhlIGRlc3RpbmF0aW9uIGZpbGVuYW1lIGZvciBlYWNoIHRyYW5zZmVyIGJlbG93LCBzbyB0aGF0IHRoZSByZXBvcnRzIGNhbiBiZSBlYXNpbHkgZGlmZmVyZW50aWF0ZWQgKGFuZCBkb24ndCBvdmVyd3JpdGUgb25lIGFub3RoZXIpLgoKPGJyPgoKPiBIZWxwZXIgSGludDogVXNlcnMgbXVzdCBrbm93IHRoYXQgdGhleSBzaG91bGQgcnVuIGBzY3BgIGZyb20gdGhlaXIgKipsb2NhbCoqIGNvbXB1dGVyLCBub3QgZnJvbSB0aGUgQVdTIGluc3RhbmNlLgoKPGJyPgoKYGBgCiMgVHJhbnNmZXIgdGhlIHJlcG9ydCBvZiB0cmltbWVkIHJlYWQgcmVzdWx0cwpzY3AgPHVzZXJuYW1lPkBiZngtd29ya3Nob3AwMS5tZWQudW1pY2guZWR1On4vUlNEX1NoZWxsL2FuYWx5c2lzL291dF9tdWx0aXFjX2N1dGFkYXB0L211bHRpcWNfcmVwb3J0Lmh0bWwgfi9yc2Qtd29ya3Nob3AvbXVsdGlxY19yZXBvcnRfdHJpbW1lZC5odG1sCiMgVHJhbnNmZXIgdGhlIGZ1bGwgcmVwb3J0CnNjcCA8dXNlcm5hbWU+QGJmeC13b3Jrc2hvcDAxLm1lZC51bWljaC5lZHU6fi9SU0RfU2hlbGwvYW5hbHlzaXMvb3V0X211bHRpcWNfYWxsL211bHRpcWNfcmVwb3J0Lmh0bWwgfi9yc2Qtd29ya3Nob3AvbXVsdGlxY19yZXBvcnRfYWxsLmh0bWwKYGBgCgo8YnI+Cg==