Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
en:services:application_services:high_performance_computing:transfer_data [2020/01/29 16:18]
mboden [Outside of the GÖNET (from the Internet)]
en:services:application_services:high_performance_computing:transfer_data [2020/05/04 13:52] (current)
mboden
Line 10: Line 10:
  
 For the filesystem /scratch2 we don't have a dedicated transfernode. For this filesystem you need to use the frontend ''​gwdu103.gwdg.de''​ (instead of ''​transfer-scc.gwdg.de''​). For the filesystem /scratch2 we don't have a dedicated transfernode. For this filesystem you need to use the frontend ''​gwdu103.gwdg.de''​ (instead of ''​transfer-scc.gwdg.de''​).
 +
 +=== Transfering Large Quantaties of Data ===
 +
 +If you need to transfer large quantities of data to our system, it may be advisable to copy directly to /scratch to increase the transfer rate, since the write-performance of our home file systems can sometimes be the limiting factor. Transfering to /scratch directly will not have this limitation.
 +
 =====  Within the GÖNET ​ ===== =====  Within the GÖNET ​ =====
 +
 +==== Using FileZilla ====
 +
 +[[https://​filezilla-project.org/​|FileZilla]] is a feature rich, easy to use, cross-platform file transfer utility. If you are not keen on using the command line to transfer your data, this is the right tool for you. Here is short introduction.
 +{{ :​en:​services:​application_services:​high_performance_computing:​filezilla-connect.png?​direct&​800 |}}
 +Put the required information into the bar. Host either transfer.gwdg.de,​ transfer-scc.gwdg.de or just gwdu103.gwdg.de if you need access to scratch2. Dont forget to specify port 22.
 +{{ :​en:​services:​application_services:​high_performance_computing:​fingerprint.png?​direct&​500 |}}
 +If you connect for the first time, you may be asked to confirm the fingerprint.\\
 +You can now transfer data between your local machine and your home on our cluster by drag-and-dropping it from the left pane (or anywhere from your PC) to the right pane. You can also copy from our cluster to your machine.
 +{{ :​en:​services:​application_services:​high_performance_computing:​scratch.png?​direct&​800 |}}
 +To transfer data to /scratch, make sure you are connected to transfer-scc.gwdg.de or if you need access to /scratch2, gwdu103.gwdg.de. You can type your scratch directory into the location bar in the right pane.
 +
 +==== Using rsync or scp ====
  
 If your computer is located //inside the GÖNET//, you can use ''​transfer-scc.gwdg.de''​ to copy data from and to: If your computer is located //inside the GÖNET//, you can use ''​transfer-scc.gwdg.de''​ to copy data from and to:
Line 48: Line 66:
  
 For security reasons this node is not located inside the SCC network and therefor only has your Home directory but not /scratch accessible. For security reasons this node is not located inside the SCC network and therefor only has your Home directory but not /scratch accessible.
 +
 +====  Getting Access to Scratch from Outside the GÖNET ​ via VPN (recommended) ====
 +
 +The easiest way to get access to /scratch is to use our [[en:​services:​network_services:​vpn:​start|VPN]]. After activating the VPN connection as described in the documentation and you will be inside the GÖNET and therefore be able to use transfer-scc.gwdg.de as described above.
  
 ====  Getting Access to Scratch from Outside the GÖNET ​ (ssh proxy method)==== ====  Getting Access to Scratch from Outside the GÖNET ​ (ssh proxy method)====