Transfer MultiQC Report With scp Exercise (Breakout)


15 Minutes


We just tried two new variations of our MultiQC command, one pointed at the directory of our trimmed FastQC results, and another at the whole project directory. For convenience, we’ve included these reports in the zipped folder you downloaded at the beginning of the class. However, it’s also useful to know how to transfer data to/from a remote instance. We’ll explore how to use scp in this exercise.


Instructions:


  • One group member should share their screen in the breakout room. If nobody volunteers, a helper may randomly select someone.
  • The group members should discuss the exercise and work together to find a solution.
  • After a solution is found, allow time for all members to complete the exercise.


  • Make sure that you are viewing your local terminal. The scp command should be run from your own machine.
  • Use scp to transfer the trimmed read fastqc report and the comprehensive (all) report from the AWS machine to your personal computer.
  • Confirm that you’ve received the reports


Hint: The command format is:

scp source destination

You will need to provide your ssh login information to complete the transfer


Solution - Transfer MultiQC Report With scp Exercise

Helper Hint: On the AWS instance, the multiQC reports have identical filenames. It is helpful to specify the destination filename for each transfer below, so that the reports can be easily differentiated (and don’t overwrite one another).


Helper Hint: Users must know that they should run scp from their local computer, not from the AWS instance.


# Transfer the report of trimmed read results
scp <username>@bfx-workshop01.med.umich.edu:~/RSD_Shell/analysis/out_multiqc_cutadapt/multiqc_report.html ~/rsd-workshop/multiqc_report_trimmed.html
# Transfer the full report
scp <username>@bfx-workshop01.med.umich.edu:~/RSD_Shell/analysis/out_multiqc_all/multiqc_report.html ~/rsd-workshop/multiqc_report_all.html


LS0tCnRpdGxlOiAiQnJlYWtvdXQgMDMgU29sdXRpb24iCmF1dGhvcjogIlVNIEJpb2luZm9ybWF0aWNzIENvcmUiCm91dHB1dDoKICAgICAgICBodG1sX2RvY3VtZW50OgogICAgICAgICAgICBpbmNsdWRlczoKICAgICAgICAgICAgICAgIGluX2hlYWRlcjogaGVhZGVyLmh0bWwKICAgICAgICAgICAgdGhlbWU6IHBhcGVyCiAgICAgICAgICAgIGZpZ19jYXB0aW9uOiB0cnVlCiAgICAgICAgICAgIG1hcmtkb3duOiBHRk0KICAgICAgICAgICAgY29kZV9kb3dubG9hZDogdHJ1ZQotLS0KPHN0eWxlIHR5cGU9InRleHQvY3NzIj4KYm9keXsgLyogTm9ybWFsICAqLwogICAgICBmb250LXNpemU6IDE0cHQ7CiAgfQpwcmUgewogIGZvbnQtc2l6ZTogMTJwdAp9Cjwvc3R5bGU+Cgo8YnI+CgojIyBUcmFuc2ZlciBNdWx0aVFDIFJlcG9ydCBXaXRoIGBzY3BgIEV4ZXJjaXNlIChCcmVha291dCkKCjxicj4KCioqMTUgTWludXRlcyoqCgo8YnI+CgpXZSBqdXN0IHRyaWVkIHR3byBuZXcgdmFyaWF0aW9ucyBvZiBvdXIgTXVsdGlRQyBjb21tYW5kLCBvbmUgcG9pbnRlZCBhdCB0aGUgZGlyZWN0b3J5IG9mIG91ciB0cmltbWVkIEZhc3RRQyByZXN1bHRzLCBhbmQgYW5vdGhlciBhdCB0aGUgd2hvbGUgcHJvamVjdCBkaXJlY3RvcnkuIEZvciBjb252ZW5pZW5jZSwgd2UndmUgaW5jbHVkZWQgdGhlc2UgcmVwb3J0cyBpbiB0aGUgemlwcGVkIGZvbGRlciB5b3UgZG93bmxvYWRlZCBhdCB0aGUgYmVnaW5uaW5nIG9mIHRoZSBjbGFzcy4gSG93ZXZlciwgaXQncyBhbHNvIHVzZWZ1bCB0byBrbm93IGhvdyB0byB0cmFuc2ZlciBkYXRhIHRvL2Zyb20gYSByZW1vdGUgaW5zdGFuY2UuIFdlJ2xsIGV4cGxvcmUgaG93IHRvIHVzZSBgc2NwYCBpbiB0aGlzIGV4ZXJjaXNlLgoKPGJyPgoKIyMjIEluc3RydWN0aW9uczoKCjxicj4KCi0gT25lIGdyb3VwIG1lbWJlciBzaG91bGQgc2hhcmUgdGhlaXIgc2NyZWVuIGluIHRoZSBicmVha291dCByb29tLiBJZiBub2JvZHkgdm9sdW50ZWVycywgYSBoZWxwZXIgbWF5IHJhbmRvbWx5IHNlbGVjdCBzb21lb25lLgotIFRoZSBncm91cCBtZW1iZXJzIHNob3VsZCBkaXNjdXNzIHRoZSBleGVyY2lzZSBhbmQgd29yayB0b2dldGhlciB0byBmaW5kIGEgc29sdXRpb24uCi0gQWZ0ZXIgYSBzb2x1dGlvbiBpcyBmb3VuZCwgYWxsb3cgdGltZSBmb3IgYWxsIG1lbWJlcnMgdG8gY29tcGxldGUgdGhlIGV4ZXJjaXNlLgoKPGJyPgoKLSBNYWtlIHN1cmUgdGhhdCB5b3UgYXJlIHZpZXdpbmcgeW91ciBsb2NhbCB0ZXJtaW5hbC4gVGhlIGBzY3BgIGNvbW1hbmQgc2hvdWxkIGJlIHJ1biBmcm9tIHlvdXIgb3duIG1hY2hpbmUuCi0gVXNlIGBzY3BgIHRvIHRyYW5zZmVyIHRoZSB0cmltbWVkIHJlYWQgZmFzdHFjIHJlcG9ydCBhbmQgdGhlIGNvbXByZWhlbnNpdmUgKGFsbCkgcmVwb3J0IGZyb20gdGhlIEFXUyBtYWNoaW5lIHRvIHlvdXIgcGVyc29uYWwgY29tcHV0ZXIuCi0gQ29uZmlybSB0aGF0IHlvdSd2ZSByZWNlaXZlZCB0aGUgcmVwb3J0cwoKPGJyPgoKPiBIaW50OiBUaGUgY29tbWFuZCBmb3JtYXQgaXM6Cj4KPiB+fn4KPiBzY3Agc291cmNlIGRlc3RpbmF0aW9uCj4gfn5+Cj4KPiBZb3Ugd2lsbCBuZWVkIHRvIHByb3ZpZGUgeW91ciBzc2ggbG9naW4gaW5mb3JtYXRpb24gdG8gY29tcGxldGUgdGhlIHRyYW5zZmVyCgo8YnI+CgojIyMgU29sdXRpb24gLSBUcmFuc2ZlciBNdWx0aVFDIFJlcG9ydCBXaXRoIGBzY3BgIEV4ZXJjaXNlCgo+IEhlbHBlciBIaW50OiBPbiB0aGUgQVdTIGluc3RhbmNlLCB0aGUgbXVsdGlRQyByZXBvcnRzIGhhdmUgaWRlbnRpY2FsIGZpbGVuYW1lcy4gSXQgaXMgaGVscGZ1bCB0byBzcGVjaWZ5IHRoZSBkZXN0aW5hdGlvbiBmaWxlbmFtZSBmb3IgZWFjaCB0cmFuc2ZlciBiZWxvdywgc28gdGhhdCB0aGUgcmVwb3J0cyBjYW4gYmUgZWFzaWx5IGRpZmZlcmVudGlhdGVkIChhbmQgZG9uJ3Qgb3ZlcndyaXRlIG9uZSBhbm90aGVyKS4KCjxicj4KCj4gSGVscGVyIEhpbnQ6IFVzZXJzIG11c3Qga25vdyB0aGF0IHRoZXkgc2hvdWxkIHJ1biBgc2NwYCBmcm9tIHRoZWlyICoqbG9jYWwqKiBjb21wdXRlciwgbm90IGZyb20gdGhlIEFXUyBpbnN0YW5jZS4KCjxicj4KCmBgYAojIFRyYW5zZmVyIHRoZSByZXBvcnQgb2YgdHJpbW1lZCByZWFkIHJlc3VsdHMKc2NwIDx1c2VybmFtZT5AYmZ4LXdvcmtzaG9wMDEubWVkLnVtaWNoLmVkdTp+L1JTRF9TaGVsbC9hbmFseXNpcy9vdXRfbXVsdGlxY19jdXRhZGFwdC9tdWx0aXFjX3JlcG9ydC5odG1sIH4vcnNkLXdvcmtzaG9wL211bHRpcWNfcmVwb3J0X3RyaW1tZWQuaHRtbAojIFRyYW5zZmVyIHRoZSBmdWxsIHJlcG9ydApzY3AgPHVzZXJuYW1lPkBiZngtd29ya3Nob3AwMS5tZWQudW1pY2guZWR1On4vUlNEX1NoZWxsL2FuYWx5c2lzL291dF9tdWx0aXFjX2FsbC9tdWx0aXFjX3JlcG9ydC5odG1sIH4vcnNkLXdvcmtzaG9wL211bHRpcWNfcmVwb3J0X2FsbC5odG1sCmBgYAoKPGJyPgo=