Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
Last revision Both sides next revision
en:services:application_services:high_performance_computing:transfer_data [2019/01/10 11:00]
tehlers [Getting Access to Scratch from Outside the GÖNET]
en:services:application_services:high_performance_computing:transfer_data [2019/01/10 11:20]
tehlers [Getting Access to Scratch from Outside the GÖNET (ssh proxy method)]
Line 3: Line 3:
 One often wants to copy data to or from the Scientific Compute Cluster. In this article we show options to copy from inside or outside of GÖNET, the network of the University of Göttingen and Max Planck institutes in Göttingen. One often wants to copy data to or from the Scientific Compute Cluster. In this article we show options to copy from inside or outside of GÖNET, the network of the University of Göttingen and Max Planck institutes in Göttingen.
  
-The Transfernodes ​are ''​transfer-scc.gwdg.de''​ (reachable inside the GÖNET) and ''​transfer.gwdg.de''​ (world accessible). ​+The transfernodes ​are ''​transfer-scc.gwdg.de''​ (reachable inside the GÖNET) and ''​transfer.gwdg.de''​ (world accessible). ​
  
 ''​transfer-scc.gwdg.de''​ has homes and /scratch. ''​transfer-scc.gwdg.de''​ has homes and /scratch.
Line 9: Line 9:
 ''​transfer.gwdg.de''​ has only homes. /scratch is reachable with ssh port-forward to transfer-scc;​ see below. ''​transfer.gwdg.de''​ has only homes. /scratch is reachable with ssh port-forward to transfer-scc;​ see below.
  
-For the filesystem /scratch2 we don't have a dedicated ​Transfernode. For this filesystem you need to use the frontend gwdu103.gwdg.de (instead of ''​transfer-scc.gwdg.de''​).+For the filesystem /scratch2 we don't have a dedicated ​transfernode. For this filesystem you need to use the frontend ​''​gwdu103.gwdg.de'' ​(instead of ''​transfer-scc.gwdg.de''​).
 =====  Within the GÖNET ​ ===== =====  Within the GÖNET ​ =====
  
Line 48: Line 48:
  
 For security reasons this node is not located inside the SCC network and therefor only has your Home directory but not /scratch accessible. For security reasons this node is not located inside the SCC network and therefor only has your Home directory but not /scratch accessible.
 +
 +====  Getting Access to Scratch from Outside the GÖNET ​ (ssh proxy method)====
 +
 +If you want to copy data to scratch, you need to "​hop"​ over transfer.gwdg.de to ''​transfer-scc.gwdg.de''​. This is not necessary for the transfer from and to your home directory (see above)! The easiest way is to create a section in your ssh config ''​~/​.ssh/​config''​ on your local system (don't forget to substitute your GWDG-UserID):​
 +
 +<​code>​
 +Host transfer-scc.gwdg.de
 +        User {USERID}
 +        Hostname transfer-scc.gwdg.de
 +        ProxyCommand ssh -W %h:%p {USERID}@transfer.gwdg.de
 +</​code>​
 +\\
 +This configures ssh to reach ''​transfer-scc.gwdg.de''​ not directly, but via ''​transfer.gwdg.de''​. An ''​ssh transfer-scc.gwdg.de''​ or ''​scp''​ or ''​rsync''​ will now tunnel through ''​transfer.gwdg.de''​.
  
 ====  Getting Access to Scratch from Outside the GÖNET ​ (port tunnel method)==== ====  Getting Access to Scratch from Outside the GÖNET ​ (port tunnel method)====