Transfer MultiQC Report With scp
Exercise (Breakout)
15 Minutes
We just tried two new variations of our MultiQC command, one pointed at the directory of our trimmed FastQC results, and another at the whole project directory. For convenience, we’ve included these reports in the zipped folder you downloaded at the beginning of the class. However, it’s also useful to know how to transfer data to/from a remote instance. We’ll explore how to use scp
in this exercise.
Instructions:
- One group member should share their screen in the breakout room. If nobody volunteers, a helper may randomly select someone.
- The group members should discuss the exercise and work together to find a solution.
- After a solution is found, allow time for all members to complete the exercise.
- Make sure that you are viewing your local terminal. The
scp
command should be run from your own machine.
- Use
scp
to transfer the trimmed read fastqc report and the comprehensive (all) report from the AWS machine to your personal computer.
- Confirm that you’ve received the reports
Hint: The command format is:
scp source destination
You will need to provide your ssh login information to complete the transfer
Solution - Transfer MultiQC Report With scp
Exercise
Helper Hint: On the AWS instance, the multiQC reports have identical filenames. It is helpful to specify the destination filename for each transfer below, so that the reports can be easily differentiated (and don’t overwrite one another).
Helper Hint: Users must know that they should run scp
from their local computer, not from the AWS instance.
# Transfer the report of trimmed read results
scp <username>@bfx-workshop01.med.umich.edu:~/RSD_Shell/analysis/out_multiqc_cutadapt/multiqc_report.html ~/rsd-workshop/multiqc_report_trimmed.html
# Transfer the full report
scp <username>@bfx-workshop01.med.umich.edu:~/RSD_Shell/analysis/out_multiqc_all/multiqc_report.html ~/rsd-workshop/multiqc_report_all.html
LS0tCnRpdGxlOiAiQnJlYWtvdXQgMDMgU29sdXRpb24iCmF1dGhvcjogIlVNIEJpb2luZm9ybWF0aWNzIENvcmUiCm91dHB1dDoKICAgICAgICBodG1sX2RvY3VtZW50OgogICAgICAgICAgICBpbmNsdWRlczoKICAgICAgICAgICAgICAgIGluX2hlYWRlcjogaGVhZGVyLmh0bWwKICAgICAgICAgICAgdGhlbWU6IHBhcGVyCiAgICAgICAgICAgIGZpZ19jYXB0aW9uOiB0cnVlCiAgICAgICAgICAgIG1hcmtkb3duOiBHRk0KICAgICAgICAgICAgY29kZV9kb3dubG9hZDogdHJ1ZQotLS0KPHN0eWxlIHR5cGU9InRleHQvY3NzIj4KYm9keXsgLyogTm9ybWFsICAqLwogICAgICBmb250LXNpemU6IDE0cHQ7CiAgfQpwcmUgewogIGZvbnQtc2l6ZTogMTJwdAp9Cjwvc3R5bGU+Cgo8YnI+CgojIyBUcmFuc2ZlciBNdWx0aVFDIFJlcG9ydCBXaXRoIGBzY3BgIEV4ZXJjaXNlIChCcmVha291dCkKCjxicj4KCioqMTUgTWludXRlcyoqCgo8YnI+CgpXZSBqdXN0IHRyaWVkIHR3byBuZXcgdmFyaWF0aW9ucyBvZiBvdXIgTXVsdGlRQyBjb21tYW5kLCBvbmUgcG9pbnRlZCBhdCB0aGUgZGlyZWN0b3J5IG9mIG91ciB0cmltbWVkIEZhc3RRQyByZXN1bHRzLCBhbmQgYW5vdGhlciBhdCB0aGUgd2hvbGUgcHJvamVjdCBkaXJlY3RvcnkuIEZvciBjb252ZW5pZW5jZSwgd2UndmUgaW5jbHVkZWQgdGhlc2UgcmVwb3J0cyBpbiB0aGUgemlwcGVkIGZvbGRlciB5b3UgZG93bmxvYWRlZCBhdCB0aGUgYmVnaW5uaW5nIG9mIHRoZSBjbGFzcy4gSG93ZXZlciwgaXQncyBhbHNvIHVzZWZ1bCB0byBrbm93IGhvdyB0byB0cmFuc2ZlciBkYXRhIHRvL2Zyb20gYSByZW1vdGUgaW5zdGFuY2UuIFdlJ2xsIGV4cGxvcmUgaG93IHRvIHVzZSBgc2NwYCBpbiB0aGlzIGV4ZXJjaXNlLgoKPGJyPgoKIyMjIEluc3RydWN0aW9uczoKCjxicj4KCi0gT25lIGdyb3VwIG1lbWJlciBzaG91bGQgc2hhcmUgdGhlaXIgc2NyZWVuIGluIHRoZSBicmVha291dCByb29tLiBJZiBub2JvZHkgdm9sdW50ZWVycywgYSBoZWxwZXIgbWF5IHJhbmRvbWx5IHNlbGVjdCBzb21lb25lLgotIFRoZSBncm91cCBtZW1iZXJzIHNob3VsZCBkaXNjdXNzIHRoZSBleGVyY2lzZSBhbmQgd29yayB0b2dldGhlciB0byBmaW5kIGEgc29sdXRpb24uCi0gQWZ0ZXIgYSBzb2x1dGlvbiBpcyBmb3VuZCwgYWxsb3cgdGltZSBmb3IgYWxsIG1lbWJlcnMgdG8gY29tcGxldGUgdGhlIGV4ZXJjaXNlLgoKPGJyPgoKLSBNYWtlIHN1cmUgdGhhdCB5b3UgYXJlIHZpZXdpbmcgeW91ciBsb2NhbCB0ZXJtaW5hbC4gVGhlIGBzY3BgIGNvbW1hbmQgc2hvdWxkIGJlIHJ1biBmcm9tIHlvdXIgb3duIG1hY2hpbmUuCi0gVXNlIGBzY3BgIHRvIHRyYW5zZmVyIHRoZSB0cmltbWVkIHJlYWQgZmFzdHFjIHJlcG9ydCBhbmQgdGhlIGNvbXByZWhlbnNpdmUgKGFsbCkgcmVwb3J0IGZyb20gdGhlIEFXUyBtYWNoaW5lIHRvIHlvdXIgcGVyc29uYWwgY29tcHV0ZXIuCi0gQ29uZmlybSB0aGF0IHlvdSd2ZSByZWNlaXZlZCB0aGUgcmVwb3J0cwoKPGJyPgoKPiBIaW50OiBUaGUgY29tbWFuZCBmb3JtYXQgaXM6Cj4KPiB+fn4KPiBzY3Agc291cmNlIGRlc3RpbmF0aW9uCj4gfn5+Cj4KPiBZb3Ugd2lsbCBuZWVkIHRvIHByb3ZpZGUgeW91ciBzc2ggbG9naW4gaW5mb3JtYXRpb24gdG8gY29tcGxldGUgdGhlIHRyYW5zZmVyCgo8YnI+CgojIyMgU29sdXRpb24gLSBUcmFuc2ZlciBNdWx0aVFDIFJlcG9ydCBXaXRoIGBzY3BgIEV4ZXJjaXNlCgo+IEhlbHBlciBIaW50OiBPbiB0aGUgQVdTIGluc3RhbmNlLCB0aGUgbXVsdGlRQyByZXBvcnRzIGhhdmUgaWRlbnRpY2FsIGZpbGVuYW1lcy4gSXQgaXMgaGVscGZ1bCB0byBzcGVjaWZ5IHRoZSBkZXN0aW5hdGlvbiBmaWxlbmFtZSBmb3IgZWFjaCB0cmFuc2ZlciBiZWxvdywgc28gdGhhdCB0aGUgcmVwb3J0cyBjYW4gYmUgZWFzaWx5IGRpZmZlcmVudGlhdGVkIChhbmQgZG9uJ3Qgb3ZlcndyaXRlIG9uZSBhbm90aGVyKS4KCjxicj4KCj4gSGVscGVyIEhpbnQ6IFVzZXJzIG11c3Qga25vdyB0aGF0IHRoZXkgc2hvdWxkIHJ1biBgc2NwYCBmcm9tIHRoZWlyICoqbG9jYWwqKiBjb21wdXRlciwgbm90IGZyb20gdGhlIEFXUyBpbnN0YW5jZS4KCjxicj4KCmBgYAojIFRyYW5zZmVyIHRoZSByZXBvcnQgb2YgdHJpbW1lZCByZWFkIHJlc3VsdHMKc2NwIDx1c2VybmFtZT5AYmZ4LXdvcmtzaG9wMDEubWVkLnVtaWNoLmVkdTp+L1JTRF9TaGVsbC9hbmFseXNpcy9vdXRfbXVsdGlxY19jdXRhZGFwdC9tdWx0aXFjX3JlcG9ydC5odG1sIH4vcnNkLXdvcmtzaG9wL211bHRpcWNfcmVwb3J0X3RyaW1tZWQuaHRtbAojIFRyYW5zZmVyIHRoZSBmdWxsIHJlcG9ydApzY3AgPHVzZXJuYW1lPkBiZngtd29ya3Nob3AwMS5tZWQudW1pY2guZWR1On4vUlNEX1NoZWxsL2FuYWx5c2lzL291dF9tdWx0aXFjX2FsbC9tdWx0aXFjX3JlcG9ydC5odG1sIH4vcnNkLXdvcmtzaG9wL211bHRpcWNfcmVwb3J0X2FsbC5odG1sCmBgYAoKPGJyPgo=