Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
en:services:application_services:jupyter:hpc [2020/07/03 11:23]
akhuziy [Running your own Singularity Container]
en:services:application_services:jupyter:hpc [2021/05/11 09:46] (current)
akhuziy [Resources]
Line 2: Line 2:
 GWDG also offers [[https://​jupyter-hpc.gwdg.de|Jupyter-Hub on HPC]] as a [[en:​services:​application_services:​jupyter:​beta|beta service]] for users of Python. GWDG also offers [[https://​jupyter-hpc.gwdg.de|Jupyter-Hub on HPC]] as a [[en:​services:​application_services:​jupyter:​beta|beta service]] for users of Python.
  
-**Note** that for using Jupyter-Hub on the Scientific Compute Cluster (SCC) you need a GWDG account which is activated for the use of the compute cluster. ​If your GWDG account ​is not yet activated you can do it by sending an informal email to <​hpc@gwdg.de>​.+**Note** that for using Jupyter-Hub on the Scientific Compute Cluster (SCC) you need a GWDG account which is activated for the use of the compute cluster. ​Information on how to activate ​your account can be found [[en:​services:​application_services:​high_performance_computing:​account_activation|here]].
  
 ===== How to use Jupyter-Hub on the SCC ===== ===== How to use Jupyter-Hub on the SCC =====
Line 34: Line 34:
 Jupyter notebooks in [[https://​jupyter-hpc.gwdg.de|Jupyter-Hub on HPC]] service are launched in the [[en:​services:​application_services:​high_performance_computing:​interactive_queue|interactive queue]] of the [[en:​services:​application_services:​high_performance_computing:​|High Performance Computing Cluster]]. ​ Jupyter notebooks in [[https://​jupyter-hpc.gwdg.de|Jupyter-Hub on HPC]] service are launched in the [[en:​services:​application_services:​high_performance_computing:​interactive_queue|interactive queue]] of the [[en:​services:​application_services:​high_performance_computing:​|High Performance Computing Cluster]]. ​
  
-It means that ~20 CPUs and ~64GB memory of the nodes in the interactive queue are available to use in Jupyter notebook and shared between all users who simultaneously use the same node. Currently there are 4 nodes in the interactive queue and more nodes will be added in case of high demand.  ​+It means that ~24 CPUs and ~128GB memory of the nodes in the interactive queue are available to use in Jupyter notebook and shared between all users who simultaneously use the same node. Currently there are 4 nodes in the interactive queue and more nodes will be added in case of high demand.  ​
  
-Also you can use /scratch shared storage, which allows to store large files (terabytes),​ as well as your HOME directory.+Also you can use /​scratch ​(/​scratch2) ​shared storage, which allows to store large files (terabytes),​ as well as your HOME directory.
  
 <WRAP center round important 90%> <WRAP center round important 90%>
Line 62: Line 62:
  
 ==== Installing additional Python modules ==== ==== Installing additional Python modules ====
-Additional Python modules can be installed via the terminal and the Python package manager "​pip"​. To do this, a terminal must be opened via the menu "​New"​ -> "​Terminal"​. Afterwards ​+Additional Python modules can be installed via the terminal and the Python package manager "​pip"​. To do this, a terminal must be opened via the menu "​New"​ -> "​Terminal"​. ​ 
 + 
 +By default the Internet is not accessible within the Notebook, in order to install or download from Internet, you need to use Proxy by exporting following environment variables:​ 
 +<code bash>​export https_proxy="​https://​www-cache.gwdg.de:​3128/"​ 
 +export http_proxy="​http://​www-cache.gwdg.de:​3128/"</​code>​ 
 +Afterwards ​
 <code bash>​python3 -m pip install --user <​module></​code> ​ <code bash>​python3 -m pip install --user <​module></​code> ​
 installs a new module in the home directory. installs a new module in the home directory.