This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision Next revision Both sides next revision | ||
other:newppl:starting [2020/08/24 14:43] jypeter Link to a new section on the ssh page |
other:newppl:starting [2022/07/08 09:03] jypeter [Accessing remote disks] Improved the doc |
||
---|---|---|---|
Line 1: | Line 1: | ||
- | ====== Getting started in CLIM & ESTIMR ====== | + | ====== Getting started at LSCE (by JYP) ====== |
- | <note tip>Welcome to the CLIM & ESTIMR teams!\\ \\ You are probably reading this page because you are a new intern student, visitor, etc...\\ This page will help you survive your first steps at LSCE, at least survive the computers...\\ \\ Reading this page will save your life (and a lot of time)!</note> | + | <note tip>Welcome to LSCE!\\ \\ You are probably reading this page because you are a new PhD or intern student, visitor, etc...\\ This page will help you survive your first steps at LSCE, at least survive using the computers (LSCE computers are your future best friends)...\\ \\ Reading this page will save your life (and a lot of time)!\\ \\ This page used to be for the newcomers in the //CLIM// and //ESTIMR// teams, but we can share information LOL</note> |
===== Miscellaneous information ===== | ===== Miscellaneous information ===== | ||
- | A few useful links that have nothing to do with science and software resources! | + | A few useful links. Some have nothing to do with science and LSCE hardware/software resources! |
+ | |||
+ | * [[#accessing_the_lsce_intranet|LSCE intranet]] | ||
* [[other:newppl:pub_transport|LSCE-related public transport]] | * [[other:newppl:pub_transport|LSCE-related public transport]] | ||
Line 12: | Line 14: | ||
* [[https://intranet.lsce.ipsl.fr/Phocea/Page/index.php?id=97|Survival kit and other information for CDD and interns]] (LSCE intranet) | * [[https://intranet.lsce.ipsl.fr/Phocea/Page/index.php?id=97|Survival kit and other information for CDD and interns]] (LSCE intranet) | ||
* [[http://internationaloffice.ceasaclay.com/?lang=en|CEA Saclay International Office]] //Our multilingual staff is readily available to assist you through immigration procedures and to help you settle in France// | * [[http://internationaloffice.ceasaclay.com/?lang=en|CEA Saclay International Office]] //Our multilingual staff is readily available to assist you through immigration procedures and to help you settle in France// | ||
- | * [[https://www.universite-paris-saclay.fr/en/e-international-welcome-office|e-International Welcome Office]] //Paris-Saclay university help to prepare for your arrival in France and help you settle down in the best conditions// | + | * [[https://www.universite-paris-saclay.fr/en/campus-life/international-welcome-desk|International welcome desk]] //Université Paris-Saclay provides you with a variety of services and documentation to welcome international students and researchers under the best conditions// |
* [[https://logement.campus-paris-saclay.fr/| Trouver un logement dans une résidence universitaire]] (in French... //Finding a room in a student dorm//) | * [[https://logement.campus-paris-saclay.fr/| Trouver un logement dans une résidence universitaire]] (in French... //Finding a room in a student dorm//) | ||
* [[https://www.science-accueil.org/en/|Science Accueil]] | * [[https://www.science-accueil.org/en/|Science Accueil]] | ||
+ | * [[https://www.science-accueil.org/en/request-services/|Service request page]] | ||
* {{:other:newppl:uvsq-guide-du-personnel-nov2019.pdf|Guide du Personnel UVSQ}} | * {{:other:newppl:uvsq-guide-du-personnel-nov2019.pdf|Guide du Personnel UVSQ}} | ||
Line 62: | Line 65: | ||
Mails sent to these lists will reach lots of people. Think well **before** sending a mail to these lists! | Mails sent to these lists will reach lots of people. Think well **before** sending a mail to these lists! | ||
- | ==== The 'clim' and 'estimr' lists ==== | + | ==== The teams mailing lists ==== |
- | Ask your team leader or Jean-Yves to add you to your team's mailing list | + | Ask your team leader to add you to your team's mailing list. Example below: the //CLIM// and //ESTIMR// lists |
^ List ^ Team ^ Archive ^ | ^ List ^ Team ^ Archive ^ | ||
Line 98: | Line 101: | ||
* Reading the mails with the [[https://agenda.lsce.ipsl.fr/|webmail]] or [[https://intranet.lsce.ipsl.fr/informatique/en/mail/thunderbird.php|Thunderbird]] | * Reading the mails with the [[https://agenda.lsce.ipsl.fr/|webmail]] or [[https://intranet.lsce.ipsl.fr/informatique/en/mail/thunderbird.php|Thunderbird]] | ||
- | * As soon as you have a LSCE e-mail address, make sure it is added to the //clim// or //estimr// **mailing list** | + | * As soon as you have a LSCE e-mail address, make sure it is added to [[#the_teams_mailing_lists|you team's list]] |
* [[https://intranet.lsce.ipsl.fr/informatique/en/orme/imprimantes.php|Printers]] | * [[https://intranet.lsce.ipsl.fr/informatique/en/orme/imprimantes.php|Printers]] | ||
Line 124: | Line 127: | ||
===== Setting up your desktop computer ===== | ===== Setting up your desktop computer ===== | ||
- | Everybody working for CLIM & ESTIMR gets a computer that can be connected to the LSCE network. Please take the time to read the instructions below, that may help make your life easier | + | You should receive a desktop/laptop connected to the LSCE network when you arrive. Please take the time to read the instructions below, that may help make your life easier |
==== Windows computer ==== | ==== Windows computer ==== | ||
Line 164: | Line 167: | ||
===== Accessing the LSCE Linux servers ===== | ===== Accessing the LSCE Linux servers ===== | ||
- | You have to [[other:ssh|Use ssh to connect to the servers]] | + | You have to [[other:ssh|use ssh to connect to the servers]], and [[other:ssh#copying_files_with_scp|use scp to copy files between servers]] |
- | If you are really in a hurry, go directly to the [[other:ssh#connecting_to_the_lsce_servers_ipsl_servers_tgcc|Connecting to the LSCE servers, IPSL servers, TGCC, ...]] section, but it is important that you **read the full //ssh documentation// page at least once**! | + | If you are really in a hurry, go directly to the [[other:ssh#connecting_to_the_lsce_servers_ipsl_servers_tgcc|Connecting to the LSCE servers, IPSL servers, TGCC, ...]] section, but it is important that you **read the full [[other:ssh|ssh documentation]] page at least once**! |
Line 180: | Line 183: | ||
==== Available servers ==== | ==== Available servers ==== | ||
- | * **The LSCE interactive servers**: ''obelix//NN//''. Use ''ssh obelix'' to access these servers, and the //load balancing// system will send you to the server that has currently the smallest load.\\ Never forget that you are sharing these servers with other users! Do not use too much CPU and/or memory for a long time. Heavy computation should be done on the obelix cluster | + | * **The LSCE interactive servers**: ''obelix//NN//''\\ Use ''ssh obelix'' to access these servers, and the //load balancing// system will send you to the server that has currently the smallest load.\\ Never forget that you are sharing these servers with other users! Do not use too much CPU and/or memory for a long time. Heavy computation should be done on the //LSCE cluster// |
* <code>$ ssh obelix | * <code>$ ssh obelix | ||
Last login: Mon Jun 3 08:49:53 2019 from somewhere | Last login: Mon Jun 3 08:49:53 2019 from somewhere | ||
Line 189: | Line 192: | ||
obelix5</code> | obelix5</code> | ||
- | * **[[https://intranet.lsce.ipsl.fr/informatique/en/calcul/batch.php|The LSCE cluster]]** (aka the //batch system//). Use this for really heavy duty programs | + | * **[[https://intranet.lsce.ipsl.fr/informatique/en/calcul/batch.php|The LSCE cluster]]** (aka the //batch system//)\\ Use this cluster for really heavy duty programs, rather than killing the multi-users interactive servers |
- | * **[[http://mesocentre.ipsl.fr/|The ciclad and climserv servers]]**. In some cases, you may need an account to use the [[http://mesocentre.ipsl.fr/|IPSL/ESPRI clusters]], especially if you need to use data files that are already available/mirrored there (e.g. **''CMIPn'' data**), rather than copying the data to LSCE | + | |
+ | * **The [[http://mesocentre.ipsl.fr/|IPSL/ESPRI Mesocenter servers/clusters]]** (''ciclad'' / ''climserv'' / etc...)\\ You will need an account (different from your //LSCE// account) to access these servers and use data files that are already available/mirrored there (e.g. **''CMIPn'' data**). **Do not duplicate** at LSCE data that is already available on IPSL servers and that you can process there! | ||
* [[http://mesocentre.ipsl.fr/account-opening/|Requesting a new account]] | * [[http://mesocentre.ipsl.fr/account-opening/|Requesting a new account]] | ||
- | * **The ''asterix//N//'' servers**: some wise LSCE elders may mention these servers, but they don't exist any more! | + | * [[https://documentations.ipsl.fr/MESO_User/|IPSL ESPRI Mesocenter documentation]] (//English//) |
+ | * [[https://mesocentre.ipsl.fr/quick-start/|Utilisation du Mésocentre IPSL]] (//French//, the //English// documentation link above has more information) | ||
+ | |||
+ | * **The ''asterix//NN//'' servers**\\ Some wise LSCE elders may mention these servers, but they don't exist any more! | ||
==== Which shell are you using? ==== | ==== Which shell are you using? ==== | ||
Line 266: | Line 273: | ||
==== Accessing remote disks ==== | ==== Accessing remote disks ==== | ||
- | It is possible to access directly all the disks on the LSCE servers from your //local// Linux or Windows computer\\ (//local// = a computer on the LSCE ethernet/wired network) | + | It is possible to **directly** access some disks on the LSCE servers from: |
- | * Example path on the LSCE Linux server: ''/home/scratch01/your_lsce_login'' | + | * a Linux or Windows computer connected directly to the LSCE ethernet/wired network |
- | * Accessing the path above from a //local// computer: | + | * or a remote computer using the [[https://intranet.lsce.ipsl.fr/informatique/fr/vpn-forticlient.php#vpnlsce|LSCE VPN]] |
- | * Linux computer: ''/home/scratch01/your_lsce_login'' | + | |
- | * Windows computer: ''\\dfshost\dfs\scratch01\your_lsce_login''\\ {{ :other:newppl:dfs_on_win.png?nolink |}} | + | For security reasons, only backed up disks and ''scratch01'' can be accessed from Windows with //dfs// |
+ | |||
+ | e.g. if you have a ''/home/scratch01/your_lsce_login'' path on a Linux server, you can access it the following way from your desktop/laptop: | ||
+ | |||
+ | * Linux computer: ''cd /home/scratch01/your_lsce_login'' | ||
+ | * Windows computer explorer: ''\\dfshost\dfs\scratch01\your_lsce_login''\\ {{ :other:newppl:dfs_on_win.png?nolink |}} | ||
==== The home directory ==== | ==== The home directory ==== | ||
Line 417: | Line 429: | ||
- A tutorial | - A tutorial | ||
* Useful Linux commands for working with (potentially big) text files ({{:other:newppl:houchesa4_updated.pdf}}) | * Useful Linux commands for working with (potentially big) text files ({{:other:newppl:houchesa4_updated.pdf}}) | ||
- | * Using ssh on [[http://ciclad-web.ipsl.jussieu.fr/data/documents/ssh-utilisateurs-unix.pdf|Linux]] and [[http://ciclad-web.ipsl.jussieu.fr/data/documents/ssh_putty_v2_2011-1.pdf|Windows]] | + | * Using [[other:ssh|ssh]] and [[other:ssh#copying_files_with_scp|scp]] |
- | * An annotated reference card of the emacs text editor ({{:other:newppl:emacs_jyp.pdf}}) | + | * Text editors: there are **lots** of text editors used on Linux computers/servers (vi, vim, gvim, emacs, nano, ...). You will find some basic information below |
- | * JYP's .emacs file: {{:other:emacs_linux_150806.tar|for Linux}} - {{:other:emacs_win_7_64_140408.zip|for Windows}}, with [[other:win7apps#gnu_emacs_gnuwin_diffutils|emacs for Windows]] | + | * ''vi'': [[https://www.atmos.albany.edu/daes/atmclasses/atm350/vi_cheat_sheet.pdf|vi cheat sheet]] and [[https://web.mit.edu/merolish/Public/vi-ref.pdf|vi reference card]] |
- | + | * An annotated reference card of the ''emacs'' text editor ({{:other:newppl:emacs_jyp.pdf}}) | |
- | You can also check the [[http://wiki.ipsl.jussieu.fr/FondamentauxpoleModelisationClimat|Les fondamentaux du pôle de modélisation du climat de l'IPSL]] wiki page | + | * JYP's .emacs file: {{:other:emacs_linux_150806.tar|for Linux}} - {{:other:emacs_win_7_64_140408.zip|for Windows}}, with [[other:win7apps#gnu_emacs_gnuwin_diffutils|emacs for Windows]] |
==== NetCDF and file formats ==== | ==== NetCDF and file formats ==== | ||
Line 484: | Line 495: | ||
{{ :other:newppl:xnview_capture.jpg?200 |Click to get a larger version}} | {{ :other:newppl:xnview_capture.jpg?200 |Click to get a larger version}} | ||
- | ===== Accessing the LSCE servers from outside the LSCE ===== | + | ===== Getting help, when using the IPSL Mesocenter ===== |
- | + | ||
- | The only way to access the LSCE servers from outside LSCE is to connect first to the **ssh1.lsce.ipsl.fr** gateway server. | + | |
- | + | ||
- | ==== Interactive access ==== | + | |
- | + | ||
- | - Send a mail to //help-lsce//, and request an access to the //ssh1// server | + | |
- | - Use ''ssh'' to **connect** to //ssh1// | + | |
- | * From a terminal on a Linux/Windows10/Mac computer: ''ssh -A -X your_lsce_login@ssh1.lsce.ipsl.fr'' | + | |
- | * From a Windows computer: | + | |
- | * Text only: use [[other:win10apps#putty_pageant|Putty]]. Putty allows you to open text terminals on remote computers | + | |
- | * Text **and graphics**: you need to [[https://wiki.lsce.ipsl.fr/pmip3/doku.php/other:win10wsl#using_an_x_server|install an X server]] on your computer in order to display the graphics | + | |
- | - You can access all LSCE disks from //ssh1//, but there is only a limited number of programs that you can run, so you have to go from //ssh1// to //obelix// or //irene// with one of the ''ssh'' commands below: | + | |
- | * ''ssh obelix'' | + | |
- | * ''ssh your_tgcc_login@curie-ccrt.ccc.cea.fr'' | + | |
- | - It's possible to use only one line to to both ssh commands | + | |
- | * obelix: ''ssh -A -X your_lsce_login@ssh1.lsce.ipsl.fr -t ssh -A obelix'' | + | |
- | * TGCC: ''ssh -A -X your_lsce_login@ssh1.lsce.ipsl.fr -t ssh -A your_tgcc_login@curie-ccrt.ccc.cea.fr'' | + | |
- | - You can define an alias in order to connect more easily to the machines: | + | |
- | * //tcsh// users: add the following line to your ''~/.cshrc'' configuration file\\ ''alias sobelix 'ssh -A -X your_lsce_login@ssh1.lsce.ipsl.fr -t ssh -A obelix''' | + | |
- | * //bash// users: add the following line to your ''~/.bashrc'' configuration file\\ ''alias sobelix='ssh -A -X your_lsce_login@ssh1.lsce.ipsl.fr -t ssh -A obelix''' | + | |
- | - You should create and configure an //ssh key//, if you don't want to type your password each time you use ssh or scp | + | |
- | - If you want more information about ''ssh'' | + | |
- | * Linux users: http://ciclad-web.ipsl.jussieu.fr/data/documents/ssh-utilisateurs-unix.pdf | + | |
- | * Windows users: http://ciclad-web.ipsl.jussieu.fr/data/documents/ssh_putty_v2_2011-1.pdf | + | |
- | + | ||
- | ==== Copying files to/from LSCE ==== | + | |
- | + | ||
- | If you need to **transfer** files to/from LSCE, use ''scp'' (on Linux and Windows 10), or a graphical scp client such as [[other:win10apps#winscp|WinSCP]] (on Windows) between your computer and ''ssh1.lsce.ipsl.fr'' | + | |
- | + | ||
- | * Example: | + | |
- | * Sending **one file** from a Linux/Windows10/Mac computer to your //scratch// directory at LSCE:\\ ''scp -p file_on_your_computer_outside_lsce your_lsce_login@ssh1.lsce.ipsl.fr:/home/scratch01/your_lsce_login/'' | + | |
- | * Sending recursively **a full directory**:\\ ''scp -pr directory_on_your_computer_outside_lsce your_lsce_login@ssh1.lsce.ipsl.fr:/home/scratch01/your_lsce_login/'' | + | |
+ | Check the [[https://mesocentre.ipsl.fr/contacts//|Contacts]] page | ||
===== What next? ===== | ===== What next? ===== | ||