This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision | ||
other:newppl:starting [2024/04/24 12:37] jypeter [Using module to access optional programs] Improved |
other:newppl:starting [2025/02/04 13:39] (current) jypeter New section title, link to IDRIS |
||
---|---|---|---|
Line 34: | Line 34: | ||
<WRAP center round important 60%> | <WRAP center round important 60%> | ||
- | It's very important that you update your phone/office information when you arrive at LSCE, so that other people can find you using the tools above! | + | It's very important that you update **your** phone/office information when you arrive at LSCE, so that other people can find you using the tools above! |
</WRAP> | </WRAP> | ||
- | === Finding your phone number === | + | === Finding YOUR phone number === |
- | Use the following sequence of keys on the //Mitel// phone in your office: | + | Use the following sequence of keys on the phone in your office: |
- | - Select **MENU** (use the downward arrow) | + | - Select **MENU** (then use the downward arrow) |
- Select **PARAMETRES** (use the downward arrow) | - Select **PARAMETRES** (use the downward arrow) | ||
- Select **GENERAL** (use the downward arrow) | - Select **GENERAL** (use the downward arrow) | ||
Line 47: | Line 47: | ||
* You can be called from outside with ''01 69 08 NN NN'' | * You can be called from outside with ''01 69 08 NN NN'' | ||
- | === Updating your entry in the directory === | + | === Updating YOUR entry in the phone directory === |
- | - Find your name in the [[https://intranet.lsce.ipsl.fr/en/Phocea/Membres/Annuaire/index.php|phone directory]] | + | - Find your name in the [[https://intranet.lsce.ipsl.fr/en/Phocea/Membres/Annuaire/index.php|intranet phone directory]] |
- Click on **Modifier mes coordonnées** (in blue on the right side) | - Click on **Modifier mes coordonnées** (in blue on the right side) | ||
- Click on **Informations dans l'annuaire** and update the different fields | - Click on **Informations dans l'annuaire** and update the different fields | ||
- Click on **Envoyez votre demande** | - Click on **Envoyez votre demande** | ||
+ | - Wait (for someone to validate your request) | ||
===== The LSCE mailing lists ===== | ===== The LSCE mailing lists ===== | ||
Line 227: | Line 228: | ||
* **[[https://intranet.lsce.ipsl.fr/informatique/en/calcul/batch.php|The LSCE cluster]]** (aka the //batch system//)\\ Use this cluster for **//heavy duty// programs**, rather than killing the multi-users interactive servers | * **[[https://intranet.lsce.ipsl.fr/informatique/en/calcul/batch.php|The LSCE cluster]]** (aka the //batch system//)\\ Use this cluster for **//heavy duty// programs**, rather than killing the multi-users interactive servers | ||
* //Heavy duty// programs are programs that will prevent other users from working on the same server because these programs use a lot of CPU and/or memory for more than a few minutes. Ask your advisor, if you are not sure | * //Heavy duty// programs are programs that will prevent other users from working on the same server because these programs use a lot of CPU and/or memory for more than a few minutes. Ask your advisor, if you are not sure | ||
+ | |||
+ | * The **''JupyterHub'' notebook servers**: | ||
+ | * Read the [[other:python:starting#using_jupyterhub_servers|Using JupyterHub servers]] section of the //Working with Python// page | ||
+ | |||
* **The [[https://documentations.ipsl.fr/spirit/|IPSL Computing and Data Center]]**, aka //Mésocentre ESPRI// (''Spirit'' / ''SpiritX'' / ''HAL'') | * **The [[https://documentations.ipsl.fr/spirit/|IPSL Computing and Data Center]]**, aka //Mésocentre ESPRI// (''Spirit'' / ''SpiritX'' / ''HAL'') | ||
* Note: the ''Spirit''/''X'' clusters have replaced the ''ciclad''/''climserv'' cluster (in 2022) | * Note: the ''Spirit''/''X'' clusters have replaced the ''ciclad''/''climserv'' cluster (in 2022) | ||
* You will need a specific account (different from your //LSCE// account) to access these servers and use data files that are already available/mirrored there (e.g. **''CMIPn'' data**).\\ **Do not duplicate** at LSCE data already available on IPSL servers and that you can process there! | * You will need a specific account (different from your //LSCE// account) to access these servers and use data files that are already available/mirrored there (e.g. **''CMIPn'' data**).\\ **Do not duplicate** at LSCE data already available on IPSL servers and that you can process there! | ||
- | * [[https://mesocentre.ipsl.fr/account-opening/|Requesting an IPSL account]] | + | * [[https://documentations.ipsl.fr/spirit/getting_started/account.html|Requesting an IPSL account]] |
* [[https://documentations.ipsl.fr/spirit/|IPSL ESPRI Mesocenter documentation]] | * [[https://documentations.ipsl.fr/spirit/|IPSL ESPRI Mesocenter documentation]] | ||
* [[https://documentations.ipsl.fr/spirit/spirit_clusters/head_nodes.html|spirit clusters]] | * [[https://documentations.ipsl.fr/spirit/spirit_clusters/head_nodes.html|spirit clusters]] | ||
Line 488: | Line 493: | ||
* Useful Linux commands for working with (potentially big) text files ({{:other:newppl:houchesa4_updated.pdf}}) | * Useful Linux commands for working with (potentially big) text files ({{:other:newppl:houchesa4_updated.pdf}}) | ||
* Using [[other:ssh|ssh]] and [[other:ssh#copying_files_with_scp|scp]] | * Using [[other:ssh|ssh]] and [[other:ssh#copying_files_with_scp|scp]] | ||
+ | |||
+ | * See also the //old// [[http://www.idris.fr/formations/utilisation-unix/unix-u-cours.html|IDRIS (advanced) Linux training]] (French tutorial) | ||
==== Text editors ==== | ==== Text editors ==== | ||
Line 535: | Line 542: | ||
* What are binary ({{:other:newppl:binaire_jyp.pdf}}) and NetCDF ({{:other:newppl:netcdf_jyp.pdf}}) files? | * What are binary ({{:other:newppl:binaire_jyp.pdf}}) and NetCDF ({{:other:newppl:netcdf_jyp.pdf}}) files? | ||
+ | * A reminder about [[other:python:misc_by_jyp#numerical_values|numerical precision]] | ||
* [[http://www.unidata.ucar.edu/software/netcdf/|Network Common Data Form (NetCDF)]] official page | * [[http://www.unidata.ucar.edu/software/netcdf/|Network Common Data Form (NetCDF)]] official page | ||
* [[http://www.unidata.ucar.edu/software/netcdf/docs/faq.html#How-many-netCDF-formats-are-there-and-what-are-the-differences-among-them|The different netCDF formats]] (and do not forget to use ''ncdump -k data.nc'' if you need to know the format) | * [[http://www.unidata.ucar.edu/software/netcdf/docs/faq.html#How-many-netCDF-formats-are-there-and-what-are-the-differences-among-them|The different netCDF formats]] (and do not forget to use ''ncdump -k data.nc'' if you need to know the format) | ||
Line 544: | Line 552: | ||
* Displaying the content of a NetCDF file in a text format\\ Check the ''ncdump'' [[https://docs.unidata.ucar.edu/nug/current/netcdf_utilities_guide.html#ncdump_guide|options]]. People usually want to quickly check the metadata, and use other programs to work with the actual data | * Displaying the content of a NetCDF file in a text format\\ Check the ''ncdump'' [[https://docs.unidata.ucar.edu/nug/current/netcdf_utilities_guide.html#ncdump_guide|options]]. People usually want to quickly check the metadata, and use other programs to work with the actual data | ||
- | * ''ncdump some_climate_data_file.nc'': dump the full content to text | + | * ''ncdump -h some_climate_data_file.nc'': only display the metadata (//h_eader// of the file) |
- | * ''ncdump -h some_climate_data_file.nc'': only display the metadata | + | * ''ncdump some_climate_data_file.nc | less'': dump the **full** content to text, and use ''less'' to display it page by page |
+ | * Maybe it is time to learn how to {{:other:newppl:houchesa4_updated.pdf|work efficiently with big text files}} | ||
* You can use [[other:win7apps#panoply|Panoply]] and [[http://meteora.ucsd.edu/~pierce/ncview_home_page.html|ncview]] for quickly visualizing NetCDF files | * You can use [[other:win7apps#panoply|Panoply]] and [[http://meteora.ucsd.edu/~pierce/ncview_home_page.html|ncview]] for quickly visualizing NetCDF files | ||
* Manipulating NetCDF files: | * Manipulating NetCDF files: | ||
* [[https://code.zmaw.de/projects/cdo/wiki/Cdo#Documentation|Climate Data Operators]] (''cdo'') | * [[https://code.zmaw.de/projects/cdo/wiki/Cdo#Documentation|Climate Data Operators]] (''cdo'') | ||
+ | * Use ''[[#using_module_to_access_optional_programs|module]] load cdo'' on the LSCE and IPSL servers | ||
* [[http://nco.sourceforge.net/#RTFM|netCDF Operator]] (//NCO// operators) | * [[http://nco.sourceforge.net/#RTFM|netCDF Operator]] (//NCO// operators) | ||
+ | * Use ''[[#using_module_to_access_optional_programs|module]] load cdo'' on the LSCE and IPSL servers | ||
=== NetCDF related Conventions === | === NetCDF related Conventions === | ||
+ | |||
+ | * [[http://cfconventions.org/|NetCDF CF (Climate and Forecast) Metadata Conventions]] | ||
* [[https://arxiv.org/abs/1911.08638|Gridspec: A standard for the description of grids used in Earth System models]] | * [[https://arxiv.org/abs/1911.08638|Gridspec: A standard for the description of grids used in Earth System models]] | ||
* A nice document for discovering the different type of (ir)regular grids used in climate models! | * A nice document for discovering the different type of (ir)regular grids used in climate models! | ||
- | * [[http://cfconventions.org/|NetCDF CF (Climate and Forecast) Metadata Conventions]] | ||
* [[https://ugrid-conventions.github.io/ugrid-conventions/|UGRID Conventions]] for storing unstructured (or flexible mesh) model data | * [[https://ugrid-conventions.github.io/ugrid-conventions/|UGRID Conventions]] for storing unstructured (or flexible mesh) model data | ||
+ | |||
* [[http://sgrid.github.io/sgrid/|SGRID Conventions]] for storing staggered data on structured grids that are consistent with the UGRID conventions | * [[http://sgrid.github.io/sgrid/|SGRID Conventions]] for storing staggered data on structured grids that are consistent with the UGRID conventions | ||
Line 566: | Line 579: | ||
Check the [[other:python:jyp_steps#using_netcdf_files_with_python|dedicated section]] of the //Python// page | Check the [[other:python:jyp_steps#using_netcdf_files_with_python|dedicated section]] of the //Python// page | ||
- | ==== Programming languages ==== | + | ==== Programming languages, parallelism, ... ==== |
* [[other:index#python_notes|JYP's Python notes]] | * [[other:index#python_notes|JYP's Python notes]] | ||
+ | * [[http://www.idris.fr/eng/formations/supports_de_cours-eng.html|IDRIS classes and tutorials]] | ||
===== Getting help (from the LSCE system administrators) ===== | ===== Getting help (from the LSCE system administrators) ===== | ||
Line 611: | Line 625: | ||
{{ :other:newppl:xnview_capture.jpg?200 |Click to get a larger version}} | {{ :other:newppl:xnview_capture.jpg?200 |Click to get a larger version}} | ||
- | ===== Getting help, when using the IPSL Mesocenter ===== | + | ===== Getting help, when using the IPSL Mesocenter (ESPRI) ===== |
- | Check the [[https://mesocentre.ipsl.fr/contacts//|Contacts]] page | + | Check the [[https://documentations.ipsl.fr/spirit/getting_started/support.html|ESPRI User Support]] page |
===== What next? ===== | ===== What next? ===== | ||