other:newppl:starting
Differences
This shows you the differences between two versions of the page.
| Both sides previous revision Previous revision Next revision | Previous revision Next revision Both sides next revision | ||
|
other:newppl:starting [2022/11/23 16:54] jypeter [Text editors] Added xkcd credit for emacs cartoon |
other:newppl:starting [2023/03/08 16:33] jypeter [Available servers] Updated ciclad=>spirit |
||
|---|---|---|---|
| Line 204: | Line 204: | ||
| * **[[https://intranet.lsce.ipsl.fr/informatique/en/calcul/batch.php|The LSCE cluster]]** (aka the //batch system//)\\ Use this cluster for really heavy duty programs, rather than killing the multi-users interactive servers | * **[[https://intranet.lsce.ipsl.fr/informatique/en/calcul/batch.php|The LSCE cluster]]** (aka the //batch system//)\\ Use this cluster for really heavy duty programs, rather than killing the multi-users interactive servers | ||
| - | * **The [[http://mesocentre.ipsl.fr/|IPSL/ESPRI Mesocenter servers/clusters]]** (''ciclad'' / ''climserv'' / etc...)\\ You will need an account (different from your //LSCE// account) to access these servers and use data files that are already available/mirrored there (e.g. **''CMIPn'' data**). **Do not duplicate** at LSCE data that is already available on IPSL servers and that you can process there! | + | * **The [[https://documentations.ipsl.fr/spirit/|IPSL Computing and Data Center]]**, aka //Mésocentre ESPRI// (''Spirit'' / ''SpiritX'' / ''HAL'') |
| - | * [[http://mesocentre.ipsl.fr/account-opening/|Requesting a new account]] | + | * Note: the ''Spirit''/''X'' clusters have replaced the ''ciclad''/''climserv'' cluster (in 2022) |
| - | * [[https://documentations.ipsl.fr/MESO_User/|IPSL ESPRI Mesocenter documentation]] (//English//) | + | * You will need a specific account (different from your //LSCE// account) to access these servers and use data files that are already available/mirrored there (e.g. **''CMIPn'' data**).\\ **Do not duplicate** at LSCE data already available on IPSL servers and that you can process there! |
| - | * [[https://mesocentre.ipsl.fr/quick-start/|Utilisation du Mésocentre IPSL]] (//French//, the //English// documentation link above has more information) | + | * [[https://mesocentre.ipsl.fr/account-opening/|Requesting an IPSL account]] |
| + | * [[https://documentations.ipsl.fr/spirit/|IPSL ESPRI Mesocenter documentation]] | ||
| + | * [[https://documentations.ipsl.fr/spirit/spirit_clusters/head_nodes.html|spirit clusters]] | ||
| + | * [[https://documentations.ipsl.fr/spirit/getting_started/support.html|Getting help]] | ||
| * **The ''asterix//NN//'' servers**\\ Some wise LSCE elders may mention these servers, but they don't exist any more! | * **The ''asterix//NN//'' servers**\\ Some wise LSCE elders may mention these servers, but they don't exist any more! | ||
| Line 445: | Line 448: | ||
| <note important>A //jupyter notebook// is **not** a text editor! | <note important>A //jupyter notebook// is **not** a text editor! | ||
| - | You need a correct text editor to efficiently work with scripts and programs</note> | + | **You need a correct text editor to efficiently work with scripts and programs** |
| - | There are **lots** of text editors used on Linux computers/servers (vi, vim, gvim, emacs, nano, ...), that you can use: | + | {{ :other:newppl:real_programmers.png?direct&600 |}} [[https://www.explainxkcd.com/wiki/index.php/378:_Real_Programmers|xkcd & Real Programmers]]</note> |
| - | * in basic text terminals (if you know the basic commands and shortcuts) | + | |
| - | * or in graphics mode (you may need to have an [[other:x_conf|X server configured]]) | + | There are **lots of text editors available** on Linux computers/servers (''emacs'', ''nano'', ''vi'', ''vim'', ''gvim'', ''gedit'', ...). You can use them: |
| + | * In basic **text terminals** | ||
| + | * useful if you are in a hurry, and/or working on a remote server with a bad network connection or have no local [[other:x_conf|X server]] running | ||
| + | * you should know the basic commands and shortcuts! Some text editors (e.g ''nano'') fortunately display some help at the bottom of the screen | ||
| + | |||
| + | * With a **full Graphical User Interface** (aka //GUI//) allowing you to use the mouse+menus/buttons/etc... | ||
| + | * you will need to have a //local// [[other:x_conf|X server]] running, if you want to use the text editor GUI on a //remote// server | ||
| === emacs === | === emacs === | ||
| Line 455: | Line 464: | ||
| <note important>Read the **dedicated [[other:emacs_doc|Using emacs]] page**, and become a power user!</note> | <note important>Read the **dedicated [[other:emacs_doc|Using emacs]] page**, and become a power user!</note> | ||
| - | {{ :other:newppl:real_programmers.png?direct&600 |}} [[https://www.explainxkcd.com/wiki/index.php/378:_Real_Programmers|xkcd & Real Programmers]] | ||
| Line 465: | Line 473: | ||
| === Notepad++ === | === Notepad++ === | ||
| - | [[other:win10apps#notepad|Notepad++]] seems like a nice and powerful text editor for **Windows**, if you don't have the time and resource to install WSL+emacs | + | [[other:win10apps#notepad|Notepad++]] is a nice and powerful text editor for **Windows**, but it is also very easy to [[other:emacs_doc#windows_installation|install emacs on Windows]] |
| - | ==== NetCDF and file formats ==== | + | ==== NetCDF and related Conventions ==== |
| + | |||
| + | === Super-short introduction to NetCDF === | ||
| * What are binary ({{:other:newppl:binaire_jyp.pdf}}) and NetCDF ({{:other:newppl:netcdf_jyp.pdf}}) files? | * What are binary ({{:other:newppl:binaire_jyp.pdf}}) and NetCDF ({{:other:newppl:netcdf_jyp.pdf}}) files? | ||
| Line 473: | Line 483: | ||
| * The NetCDF file format is **self-documented**, and the metadata of climate data files often follows the [[http://cfconventions.org/|CF (Climate and Forecast) Metadata Conventions]] | * The NetCDF file format is **self-documented**, and the metadata of climate data files often follows the [[http://cfconventions.org/|CF (Climate and Forecast) Metadata Conventions]] | ||
| * The files in the [[https://esgf-node.ipsl.upmc.fr/projects/esgf-ipsl/|CMIPn (n ≥ 5) database]] are written with the [[https://cmor.llnl.gov/|CMOR 3 library]] in order to make sure that they follow exactly the requested standards | * The files in the [[https://esgf-node.ipsl.upmc.fr/projects/esgf-ipsl/|CMIPn (n ≥ 5) database]] are written with the [[https://cmor.llnl.gov/|CMOR 3 library]] in order to make sure that they follow exactly the requested standards | ||
| - | * You can use [[other:win7apps#panoply|Panoply]] and [[http://meteora.ucsd.edu/~pierce/ncview_home_page.html|ncview]] for visualizing quickly the NetCDF files | + | |
| - | * [[https://code.zmaw.de/projects/cdo/wiki/Cdo#Documentation|Climate Data Operators]] for manipulating NetCDF files (and some other formats) | + | |
| - | * [[http://nco.sourceforge.net/#RTFM|netCDF Operator (NCO)]] for manipulating NetCDF files | + | === Some ways of working with NetCDF without programming === |
| - | * [[http://cfconventions.org/|NetCDF CF (Climate and Forecast) Metadata Conventions]]: this will help you understand the information you get when you do a ''ncdump -h some_climate_data_file.nc'' | + | |
| - | * Using Python to work with NetCDF data: | + | * Displaying the content of a NetCDF file in a text format\\ Check the ''ncdump'' [[https://docs.unidata.ucar.edu/nug/current/netcdf_utilities_guide.html#ncdump_guide|options]]. People usually want to quickly check the metadata, and use other programs to work with the actual data |
| - | * Using the [[http://uv-cdat.llnl.gov/documentation/cdms/cdms.html|cdms2]] module if you work with the [[other:python:starting#uv-cdat|UV-CDAT distribution]] | + | * ''ncdump some_climate_data_file.nc'': dump the full content to text |
| - | * Using the [[http://unidata.github.io/netcdf4-python/|netCDF4]] module | + | * ''ncdump -h some_climate_data_file.nc'': only display the metadata |
| + | * You can use [[other:win7apps#panoply|Panoply]] and [[http://meteora.ucsd.edu/~pierce/ncview_home_page.html|ncview]] for quickly visualizing NetCDF files | ||
| + | * Manipulating NetCDF files: | ||
| + | * [[https://code.zmaw.de/projects/cdo/wiki/Cdo#Documentation|Climate Data Operators]] (''cdo'') | ||
| + | * [[http://nco.sourceforge.net/#RTFM|netCDF Operator]] (//NCO// operators) | ||
| + | |||
| + | |||
| + | === NetCDF related Conventions === | ||
| + | |||
| + | * [[https://arxiv.org/abs/1911.08638|Gridspec: A standard for the description of grids used in Earth System models]] | ||
| + | * A nice document for discovering the different type of (ir)regular grids used in climate models! | ||
| + | |||
| + | * [[http://cfconventions.org/|NetCDF CF (Climate and Forecast) Metadata Conventions]] | ||
| + | * [[https://ugrid-conventions.github.io/ugrid-conventions/|UGRID Conventions]] for storing unstructured (or flexible mesh) model data | ||
| + | * [[http://sgrid.github.io/sgrid/|SGRID Conventions]] for storing staggered data on structured grids that are consistent with the UGRID conventions | ||
| + | |||
| + | === Using NetCDF with Python === | ||
| + | |||
| + | |||
| + | Check the [[other:python:jyp_steps#using_netcdf_files_with_python|dedicated section]] of the //Python// page | ||
| ==== Programming languages ==== | ==== Programming languages ==== | ||
other/newppl/starting.txt · Last modified: 2024/07/02 10:22 by jypeter
