Both sides previous revisionPrevious revisionNext revision | Previous revision |
other:newppl:starting [2024/07/19 15:24] – [Updating the directory/map information] Improved jypeter | other:newppl:starting [2025/08/07 13:51] (current) – [Miscellaneous information] Added link to GATE desk jypeter |
---|
* [[https://www.science-accueil.org/en/|Science Accueil]] | * [[https://www.science-accueil.org/en/|Science Accueil]] |
* [[https://www.science-accueil.org/en/request-services/|Service request page]] | * [[https://www.science-accueil.org/en/request-services/|Service request page]] |
| * [[https://gate.paris-saclay.fr/en/|GATE desk]] |
* {{:other:newppl:uvsq-guide-du-personnel-nov2019.pdf|Guide du Personnel UVSQ}} | * {{:other:newppl:uvsq-guide-du-personnel-nov2019.pdf|Guide du Personnel UVSQ}} |
| |
* **[[https://intranet.lsce.ipsl.fr/informatique/en/calcul/batch.php|The LSCE cluster]]** (aka the //batch system//)\\ Use this cluster for **//heavy duty// programs**, rather than killing the multi-users interactive servers | * **[[https://intranet.lsce.ipsl.fr/informatique/en/calcul/batch.php|The LSCE cluster]]** (aka the //batch system//)\\ Use this cluster for **//heavy duty// programs**, rather than killing the multi-users interactive servers |
* //Heavy duty// programs are programs that will prevent other users from working on the same server because these programs use a lot of CPU and/or memory for more than a few minutes. Ask your advisor, if you are not sure | * //Heavy duty// programs are programs that will prevent other users from working on the same server because these programs use a lot of CPU and/or memory for more than a few minutes. Ask your advisor, if you are not sure |
| |
| * The **''JupyterHub'' notebook servers**: |
| * Read the [[other:python:starting#using_jupyterhub_servers|Using JupyterHub servers]] section of the //Working with Python// page |
| |
| |
* **The [[https://documentations.ipsl.fr/spirit/|IPSL Computing and Data Center]]**, aka //Mésocentre ESPRI// (''Spirit'' / ''SpiritX'' / ''HAL'') | * **The [[https://documentations.ipsl.fr/spirit/|IPSL Computing and Data Center]]**, aka //Mésocentre ESPRI// (''Spirit'' / ''SpiritX'' / ''HAL'') |
* Note: the ''Spirit''/''X'' clusters have replaced the ''ciclad''/''climserv'' cluster (in 2022) | * Note: the ''Spirit''/''X'' clusters have replaced the ''ciclad''/''climserv'' cluster (in 2022) |
* You will need a specific account (different from your //LSCE// account) to access these servers and use data files that are already available/mirrored there (e.g. **''CMIPn'' data**).\\ **Do not duplicate** at LSCE data already available on IPSL servers and that you can process there! | * You will need a specific account (different from your //LSCE// account) to access these servers and use data files that are already available/mirrored there (e.g. **''CMIPn'' data**).\\ **Do not duplicate** at LSCE data already available on IPSL servers and that you can process there! |
* [[https://mesocentre.ipsl.fr/account-opening/|Requesting an IPSL account]] | * [[https://documentations.ipsl.fr/spirit/getting_started/account.html|Requesting an IPSL account]] |
* [[https://documentations.ipsl.fr/spirit/|IPSL ESPRI Mesocenter documentation]] | * [[https://documentations.ipsl.fr/spirit/|IPSL ESPRI Mesocenter documentation]] |
* [[https://documentations.ipsl.fr/spirit/spirit_clusters/head_nodes.html|spirit clusters]] | * [[https://documentations.ipsl.fr/spirit/spirit_clusters/head_nodes.html|spirit clusters]] |
===== Which programs should you use? ===== | ===== Which programs should you use? ===== |
| |
Your advisor will let you know which (version of which) programs you should use. Some programs are available by default, and you have to use the ''module'' command to access other programs. | Your advisor will let you know which (version of which) programs you should use. Some programs are available by default, and you have to use the ''[[other:newppl:starting#using_module_to_access_optional_programs|module]]'' command to access other programs (or access a specific version of a program). |
| |
==== Which program am I using? ==== | ==== Which program am I using? ==== |
==== Using module to access optional programs ==== | ==== Using module to access optional programs ==== |
| |
Most useful ''[[https://modules.readthedocs.io/|module]]'' options: | === Documentation === |
| |
| * [[https://documentations.ipsl.fr/spirit/common/module_command.html|IPSL Meso documentation]] |
| * [[https://modules.readthedocs.io/|Full and official module documentation]] |
| |
| === Most useful module options === |
* ''module list'': list the currently loaded modules | * ''module list'': list the currently loaded modules |
* ''module avail [mod_name]'': list the available modules (or only the ones with a name starting with ''mod_name'') | * ''module avail [mod_name]'': list the available modules (or only the ones with a name starting with ''mod_name'') |
| * '' module avail -l 2>&1 | grep subname'': list the modules that have ''subname'' in their name, and their installation date |
| * <wrap hi>This only works in a //bash// shell!</wrap> In a //tcsh// shell, start by invoking a //bash// shell with ''bash -l'' |
* ''module load module_a ... module_n'': load modules (automatically including dependencies) | * ''module load module_a ... module_n'': load modules (automatically including dependencies) |
* ''module load module_a'': load default version of //module_a// | * ''module load module_a'': load default version of //module_a// |
* ''module purge'': remove all modules | * ''module purge'': remove all modules |
| |
Detailed example: | === Detailed example === |
<code> > which ncview | <code> > which ncview |
ncview: Command not found. | ncview: Command not found. |
| |
> which ncdump | > which ncdump |
/usr/local/install/netcdf-4.3.2/bin/ncdump</code> | /usr/local/install/netcdf-4.3.2/bin/ncdump |
| |
| > bash -l |
| $ module avail -l 2>&1 | grep gcc |
| binutils/2.43.1-gcc14-acc 2025/01/27 21:09:36 |
| gcc/14.2.0-openacc 2025/01/24 8:11:14 |
| gcc/8.3.0 2021/04/21 8:27:35 |
| netcdf/4.9.2-gcc14-acc 2025/01/27 22:02:57 |
| netcdf/4.9.2-gcc8 2024/06/05 20:49:36 |
| R/4.0.3-gcc8 2022/02/03 12:53:55</code> |
| |
===== Useful documentation for beginners ===== | ===== Useful documentation for beginners ===== |
* Useful Linux commands for working with (potentially big) text files ({{:other:newppl:houchesa4_updated.pdf}}) | * Useful Linux commands for working with (potentially big) text files ({{:other:newppl:houchesa4_updated.pdf}}) |
* Using [[other:ssh|ssh]] and [[other:ssh#copying_files_with_scp|scp]] | * Using [[other:ssh|ssh]] and [[other:ssh#copying_files_with_scp|scp]] |
| |
| * See also the //old// [[http://www.idris.fr/formations/utilisation-unix/unix-u-cours.html|IDRIS (advanced) Linux training]] (French tutorial) |
| |
==== Text editors ==== | ==== Text editors ==== |
* Use ''[[#using_module_to_access_optional_programs|module]] load cdo'' on the LSCE and IPSL servers | * Use ''[[#using_module_to_access_optional_programs|module]] load cdo'' on the LSCE and IPSL servers |
* [[http://nco.sourceforge.net/#RTFM|netCDF Operator]] (//NCO// operators) | * [[http://nco.sourceforge.net/#RTFM|netCDF Operator]] (//NCO// operators) |
* Use ''[[#using_module_to_access_optional_programs|module]] load cdo'' on the LSCE and IPSL servers | * Use ''[[#using_module_to_access_optional_programs|module]] load nco'' on the LSCE and IPSL servers |
| |
| |
Check the [[other:python:jyp_steps#using_netcdf_files_with_python|dedicated section]] of the //Python// page | Check the [[other:python:jyp_steps#using_netcdf_files_with_python|dedicated section]] of the //Python// page |
| |
==== Programming languages ==== | ==== Programming languages, parallelism, ... ==== |
| |
* [[other:index#python_notes|JYP's Python notes]] | * [[other:index#python_notes|JYP's Python notes]] |
| * [[http://www.idris.fr/eng/formations/supports_de_cours-eng.html|IDRIS classes and tutorials]] |
| |
===== Getting help (from the LSCE system administrators) ===== | ===== Getting help (from the LSCE system administrators) ===== |