Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
Last revision Both sides next revision
en:services:application_services:high_performance_computing:transfer_data [2020/01/29 16:18]
mboden [Outside of the GÖNET (from the Internet)]
en:services:application_services:high_performance_computing:transfer_data [2020/05/04 13:52]
mboden
Line 10: Line 10:
  
 For the filesystem /scratch2 we don't have a dedicated transfernode. For this filesystem you need to use the frontend ''​gwdu103.gwdg.de''​ (instead of ''​transfer-scc.gwdg.de''​). For the filesystem /scratch2 we don't have a dedicated transfernode. For this filesystem you need to use the frontend ''​gwdu103.gwdg.de''​ (instead of ''​transfer-scc.gwdg.de''​).
 +
 +=== Transfering Large Quantaties of Data ===
 +
 +If you need to transfer large quantities of data to our system, it may be advisable to copy directly to /scratch to increase the transfer rate, since the write-performance of our home file systems can sometimes be the limiting factor. Transfering to /scratch directly will not have this limitation.
 +
 =====  Within the GÖNET ​ ===== =====  Within the GÖNET ​ =====
 +
 +==== Using FileZilla ====
 +
 +[[https://​filezilla-project.org/​|FileZilla]] is a feature rich, easy to use, cross-platform file transfer utility. If you are not keen on using the command line to transfer your data, this is the right tool for you. Here is short introduction.
 +{{ :​en:​services:​application_services:​high_performance_computing:​filezilla-connect.png?​direct&​800 |}}
 +Put the required information into the bar. Host either transfer.gwdg.de,​ transfer-scc.gwdg.de or just gwdu103.gwdg.de if you need access to scratch2. Dont forget to specify port 22.
 +{{ :​en:​services:​application_services:​high_performance_computing:​fingerprint.png?​direct&​500 |}}
 +If you connect for the first time, you may be asked to confirm the fingerprint.\\
 +You can now transfer data between your local machine and your home on our cluster by drag-and-dropping it from the left pane (or anywhere from your PC) to the right pane. You can also copy from our cluster to your machine.
 +{{ :​en:​services:​application_services:​high_performance_computing:​scratch.png?​direct&​800 |}}
 +To transfer data to /scratch, make sure you are connected to transfer-scc.gwdg.de or if you need access to /scratch2, gwdu103.gwdg.de. You can type your scratch directory into the location bar in the right pane.
 +
 +==== Using rsync or scp ====
  
 If your computer is located //inside the GÖNET//, you can use ''​transfer-scc.gwdg.de''​ to copy data from and to: If your computer is located //inside the GÖNET//, you can use ''​transfer-scc.gwdg.de''​ to copy data from and to:
Line 48: Line 66:
  
 For security reasons this node is not located inside the SCC network and therefor only has your Home directory but not /scratch accessible. For security reasons this node is not located inside the SCC network and therefor only has your Home directory but not /scratch accessible.
 +
 +====  Getting Access to Scratch from Outside the GÖNET ​ via VPN (recommended) ====
 +
 +The easiest way to get access to /scratch is to use our [[en:​services:​network_services:​vpn:​start|VPN]]. After activating the VPN connection as described in the documentation and you will be inside the GÖNET and therefore be able to use transfer-scc.gwdg.de as described above.
  
 ====  Getting Access to Scratch from Outside the GÖNET ​ (ssh proxy method)==== ====  Getting Access to Scratch from Outside the GÖNET ​ (ssh proxy method)====