User Tools

Site Tools


other:newppl:starting

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
Next revision Both sides next revision
other:newppl:starting [2020/08/20 15:14]
jypeter [Accessing the Linux servers from your LSCE deskop]
other:newppl:starting [2022/11/23 16:54]
jypeter [Text editors] Added xkcd credit for emacs cartoon
Line 1: Line 1:
  
-====== Getting started ​in CLIM & ESTIMR ​======+====== Getting started ​at LSCE (by JYP) ======
  
-<note tip>​Welcome to the CLIM & ESTIMR teams!\\ \\ You are probably reading this page because you are a new intern student, visitor, etc...\\ This page will help you survive your first steps at LSCE, at least survive the computers...\\ \\ Reading this page will save your life (and a lot of time)!</​note>​+<note tip>​Welcome to LSCE!\\ \\ You are probably reading this page because you are a new PhD or intern student, visitor, etc...\\ This page will help you survive your first steps at LSCE, at least survive ​using the computers ​(LSCE computers are your future best friends)...\\ \\ Reading this page will save your life (and a lot of time)!\\ \\ This page used to be for the newcomers in the //CLIM// and //ESTIMR// teams, but we can share information LOL</​note>​
  
 ===== Miscellaneous information ===== ===== Miscellaneous information =====
  
-A few useful links that have nothing to do with science and software resources!+A few useful links. Some have nothing to do with science and LSCE hardware/software resources! 
 + 
 +  * [[#​accessing_the_lsce_intranet|LSCE intranet]]
  
   * [[other:​newppl:​pub_transport|LSCE-related public transport]]   * [[other:​newppl:​pub_transport|LSCE-related public transport]]
Line 12: Line 14:
   * [[https://​intranet.lsce.ipsl.fr/​Phocea/​Page/​index.php?​id=97|Survival kit and other information for CDD and interns]] (LSCE intranet)   * [[https://​intranet.lsce.ipsl.fr/​Phocea/​Page/​index.php?​id=97|Survival kit and other information for CDD and interns]] (LSCE intranet)
   * [[http://​internationaloffice.ceasaclay.com/?​lang=en|CEA Saclay International Office]] //Our multilingual staff is readily available to assist you through immigration procedures and to help you settle in France//   * [[http://​internationaloffice.ceasaclay.com/?​lang=en|CEA Saclay International Office]] //Our multilingual staff is readily available to assist you through immigration procedures and to help you settle in France//
-  * [[https://​www.universite-paris-saclay.fr/​en/​e-international-welcome-office|e-International ​Welcome Office]] //​Paris-Saclay ​university help to prepare for your arrival in France ​and help you settle down in the best conditions//​+  * [[https://​www.universite-paris-saclay.fr/​en/​campus-life/international-welcome-desk|International ​welcome desk]] //Université ​Paris-Saclay ​provides you with a variety of services and documentation ​to welcome international students ​and researchers under the best conditions//​
   * [[https://​logement.campus-paris-saclay.fr/​| Trouver un logement dans une résidence universitaire]] (in French... //Finding a room in a student dorm//)   * [[https://​logement.campus-paris-saclay.fr/​| Trouver un logement dans une résidence universitaire]] (in French... //Finding a room in a student dorm//)
   * [[https://​www.science-accueil.org/​en/​|Science Accueil]]   * [[https://​www.science-accueil.org/​en/​|Science Accueil]]
 +    * [[https://​www.science-accueil.org/​en/​request-services/​|Service request page]]
   * {{:​other:​newppl:​uvsq-guide-du-personnel-nov2019.pdf|Guide du Personnel UVSQ}}   * {{:​other:​newppl:​uvsq-guide-du-personnel-nov2019.pdf|Guide du Personnel UVSQ}}
  
Line 62: Line 65:
 Mails sent to these lists will reach lots of people. Think well **before** sending a mail to these lists! Mails sent to these lists will reach lots of people. Think well **before** sending a mail to these lists!
  
-==== The '​clim'​ and '​estimr' ​lists ====+==== The teams mailing ​lists ====
  
-Ask your team leader ​or Jean-Yves ​to add you to your team's mailing list+Ask your team leader to add you to your team's mailing list. Example below: the //CLIM// and //ESTIMR// lists
  
 ^  List  ^  Team  ^  Archive ​ ^ ^  List  ^  Team  ^  Archive ​ ^
Line 78: Line 81:
 ===== Using your own computer at LSCE? ===== ===== Using your own computer at LSCE? =====
  
-No need to try to connect your laptop to the LSCE wire network, it will not work!+<wrap em>You can'​t ​connect your personal ​laptop to the LSCE wired network</​wrap>​ (aka //​ethernet//​), it will **not** work!
  
-The best you can do is use the [[https://​intranet.lsce.ipsl.fr/​informatique/​wifi/​index.php|eduroam ​or guest wifi]] network, if your office is close enough to one of the access points.+The best you can do is use the [[https://​intranet.lsce.ipsl.fr/​informatique/en/​wifi/​index.php|Guest WiFi]] ​or [[https://​intranet.lsce.ipsl.fr/​informatique/​en/​wifi/​eduroam.php|eduroam]] network, if your office is close enough to one of the access points.
  
-**Warning!** You can't connect directly to the //obelix// LSCE servers from the wifi network. You first have to connect to ''​ssh1.lsce.ipsl.fr'',​ and then to ''​obelix''​+**Warning!** You **can't** connect directly to the //obelix// LSCE servers from the wifi network. You first have to connect to the ''​ssh1.lsce.ipsl.fr'' ​//gateway// server, and then to ''​obelix''​. More details in [[other:​ssh#​lsce_servers|LSCE servers]]
  
 ===== Accessing the LSCE intranet ===== ===== Accessing the LSCE intranet =====
  
 <WRAP center round tip 60%> <WRAP center round tip 60%>
-If you try to access the intranet **from outside the LSCE** network (including //​eduroam//​),​ your browser will open a ''​login''/''​password''​ popup window. Use your LSCE login (not your email address!) and password+If you try to access the intranet **from outside the LSCE** network (including //​eduroam//​),​ your browser will open a ''​login''/''​password''​ popup window. 
 + 
 +Use your LSCE login (not your email address!) and password\\ e.g. use ''​jdoe''​ and not ''​jane.doe@lsce.ipsl.fr''​
 </​WRAP>​ </​WRAP>​
  
Line 98: Line 103:
  
   * Reading the mails with the [[https://​agenda.lsce.ipsl.fr/​|webmail]] or [[https://​intranet.lsce.ipsl.fr/​informatique/​en/​mail/​thunderbird.php|Thunderbird]]   * Reading the mails with the [[https://​agenda.lsce.ipsl.fr/​|webmail]] or [[https://​intranet.lsce.ipsl.fr/​informatique/​en/​mail/​thunderbird.php|Thunderbird]]
-    * As soon as you have a LSCE e-mail address, make sure it is added to the //clim// or //estimr// **mailing ​list**+    * As soon as you have a LSCE e-mail address, make sure it is added to [[#​the_teams_mailing_lists|you team'​s ​list]]
   * [[https://​intranet.lsce.ipsl.fr/​informatique/​en/​orme/​imprimantes.php|Printers]]   * [[https://​intranet.lsce.ipsl.fr/​informatique/​en/​orme/​imprimantes.php|Printers]]
  
Line 124: Line 129:
 ===== Setting up your desktop computer ===== ===== Setting up your desktop computer =====
  
-Everybody working for CLIM & ESTIMR gets computer that can be connected to the LSCE network. Please take the time to read the instructions below, that may help make your life easier+You should receive ​desktop/​laptop ​connected to the LSCE network ​when you arrive. Please take the time to read the instructions below, that may help make your life easier
  
 ==== Windows computer ==== ==== Windows computer ====
  
 Read the [[other:​index#​windows_10_notes|Windows 10 notes]], especially the //​Configuring Windows 10// section Read the [[other:​index#​windows_10_notes|Windows 10 notes]], especially the //​Configuring Windows 10// section
- 
-Note: there are also some [[other:​index#​windows_7_notes|Windows 7 notes]], but you are supposed to use Windows 10 since January 2020! 
  
 === Getting administrator'​s rights === === Getting administrator'​s rights ===
Line 156: Line 159:
 ==== Mac ==== ==== Mac ====
  
-Sorry, you are on your own, but it'​s ​soooo easy to use, right?+Sorry, you are (almost) ​on your own, but a Mac is soooo easy to use, right? ​8-) 
 + 
 +Some useful mac links: 
 +  * [[other:​ssh#​a_recommended_terminal_for_mac|A recommended terminal for Mac]] 
 +  * [[other:​x_conf#​using_an_x_server_on_a_mac|Using an X server on a Mac]] 
 +  * [[other:​ssh#​mac_ssh_agent|Mac ssh agent]]
  
 ===== Accessing the Windows cluster from a Linux computer ===== ===== Accessing the Windows cluster from a Linux computer =====
  
-Follow ​the instructions in the [[https://​intranet.lsce.ipsl.fr/​informatique/​en/​winsrv.php|Windows servers]] page. If you need to use a program that is missing on this cluster, see the [[#​getting_help_from_the_lsce_system_administrators|Help]] section+If you have a Linux computer, but need to use a Windows application,​ follow ​the instructions in the [[https://​intranet.lsce.ipsl.fr/​informatique/​en/​winsrv.php|Windows servers]] page.
  
-===== Accessing ​the Linux servers from your LSCE deskop =====+If you need to use a program that is missing on the Windows cluster, see the [[#​getting_help_from_the_lsce_system_administrators|Help]] section.
  
-[[other:​ssh|Use ssh to connect to the servers]]+===== Accessing ​the LSCE Linux servers ​=====
  
-If you are really in a hurry, go directly to the [[other:​ssh#​useful_aliases|Useful aliases]] section, but it is important that you read the full page at least once!+You have to [[other:​ssh|use ssh]] to connect to the [[other:​ssh#​lsce_servers|LSCE Linux servers]], and [[other:​ssh#​copying_files_with_scp|use scp to copy files between servers]] 
 + 
 +If you are really in a hurry, go directly to the [[other:​ssh#​connecting_to_servers_commonly_used_by_lsce_users|Connecting to servers commonly used by LSCE users]] section, but it is important that you **read the full [[other:​ssh|ssh documentation]] ​page at least once**!
  
  
Line 174: Line 184:
 ==== Working directly on your desktop ==== ==== Working directly on your desktop ====
  
-Always remember that **your local LSCE desktop can [[#​accessing_remote_disks|access remote disks on the LSCE servers]]**.+Always remember that **your local LSCE desktop/​laptop ​can [[#​accessing_remote_disks|access remote disks on the LSCE servers]]**.
  
-There are lots of things you can do directly on your **local** ​Windows 10 or Linux desktop ​(displaying pdf, images, using a text editor, ...), rather than on the remote servers. For example, if a script running on the servers generates a pdf file, it is more efficient to open this pdf file using ''​Acrobat''/''​evince''​ on your desktop, than by using ''​evince''​ on the server.+There are **lots** of things you can do directly on your **local** ​computer ​(displaying pdf, images, using a text editor, ...), rather than on the remote servers. For example, if a script running on the servers generates a pdf file, it is **more efficient** to open this pdf file using ''​Acrobat''/''​evince''​ on your local computer, than by using ''​evince''​ on the server.
  
 ==== Available servers ==== ==== Available servers ====
  
-  * **The LSCE interactive servers**: ''​obelix//​NN//''​Use ''​ssh obelix''​ to access these servers, and the //load balancing// system will send you to the server that has currently the smallest load.\\ Never forget that you are sharing these servers with other users! Do not use too much CPU and/or memory for a long time. Heavy computation should be done on the obelix ​cluster+  * **The LSCE interactive servers**: ''​obelix//​NN//''​\\ Use ''​ssh obelix''​ to access these servers, and the //load balancing// system will send you to the server that has currently the smallest load. 
 +    * <wrap hi>Never forget that you are sharing these servers with other users!</​wrap>​ 
 +    * <wrap hi>Do not use too much CPU and/or memory for a long time</​wrap>​. Heavy computation should be done on the [[https://​intranet.lsce.ipsl.fr/​informatique/​en/​calcul/​batch.php|LSCE ​cluster]] 
 +      * Learn how to [[other:​newppl:​starting#​determining_the_load_of_a_linux_server|use the top command]] to determine the current load of a server and the CPU/memory usage of your processes !
     * <​code>​$ ssh obelix     * <​code>​$ ssh obelix
 Last login: Mon Jun  3 08:49:53 2019 from somewhere Last login: Mon Jun  3 08:49:53 2019 from somewhere
Line 189: Line 202:
 obelix5</​code>​ obelix5</​code>​
  
-  * **[[https://​intranet.lsce.ipsl.fr/​informatique/​en/​calcul/​batch.php|The LSCE cluster]]** (aka the //batch system//)Use this for really heavy duty programs +  * **[[https://​intranet.lsce.ipsl.fr/​informatique/​en/​calcul/​batch.php|The LSCE cluster]]** (aka the //batch system//)\\ Use this cluster ​for really heavy duty programs, rather than killing the multi-users interactive servers 
-  * **[[http://​mesocentre.ipsl.fr/​|The ciclad and climserv ​servers]]**. ​In some cases, you may need an account ​to use the [[http://mesocentre.ipsl.fr/|IPSL/ESPRI clusters]], especially if you need to use data files that are already available/​mirrored there (e.g. **''​CMIPn''​ data**), rather than copying the data to LSCE+ 
 +  * **The [[http://​mesocentre.ipsl.fr/​|IPSL/ESPRI Mesocenter ​servers/clusters]]** (''​ciclad''​ / ''​climserv''​ / etc...)\\ You will need an account ​(different from your //LSCE// account) ​to access these servers and use data files that are already available/​mirrored there (e.g. **''​CMIPn''​ data**). **Do not duplicate** at LSCE data that is already available on IPSL servers and that you can process there!
     * [[http://​mesocentre.ipsl.fr/​account-opening/​|Requesting a new account]]     * [[http://​mesocentre.ipsl.fr/​account-opening/​|Requesting a new account]]
-  ​* **The ''​asterix//​N//''​ servers**: some wise LSCE elders may mention these servers, but they don't exist any more!+    * [[https://​documentations.ipsl.fr/​MESO_User/​|IPSL ESPRI Mesocenter documentation]] (//​English//​) 
 +    * [[https://​mesocentre.ipsl.fr/​quick-start/​|Utilisation du Mésocentre IPSL]] (//​French//,​ the //English// documentation link above has more information) 
 + 
 +  ​* **The ''​asterix//​NN//''​ servers**\\ Some wise LSCE elders may mention these servers, but they don't exist any more!
  
 ==== Which shell are you using? ==== ==== Which shell are you using? ====
Line 266: Line 283:
 ==== Accessing remote disks ==== ==== Accessing remote disks ====
  
-It is possible to access ​directly all the disks on the LSCE servers from your //local// Linux or Windows computer\\ (//local// = a computer on the LSCE ethernet/​wired network)+It is possible to **directly** ​access ​some disks on the LSCE servers from:
  
-  * Example path on the LSCE Linux server: ''/​home/​scratch01/​your_lsce_login''​ +  * a Linux or Windows computer connected directly to the LSCE ethernet/​wired network 
-  * Accessing the path above from a //local// computer+  * or a remote computer using the [[https://​intranet.lsce.ipsl.fr/​informatique/​fr/​vpn-forticlient.php#​vpnlsce|LSCE VPN]] 
-    * Linux computer: ''/​home/​scratch01/​your_lsce_login''​ + 
-    * Windows computer: ''​\\dfshost\dfs\scratch01\your_lsce_login''​\\ {{ :​other:​newppl:​dfs_on_win.png?​nolink |}}+For security reasons, only backed up disks and ''​scratch01''​ can be accessed from Windows with //dfs// 
 + 
 +e.g. if you have a ''/​home/​scratch01/​your_lsce_login''​ path on Linux server, you can access it the following way from your desktop/laptop
 + 
 +  ​* Linux computer: ''​cd /​home/​scratch01/​your_lsce_login''​ 
 +  * Windows computer ​explorer: ''​\\dfshost\dfs\scratch01\your_lsce_login''​\\ {{ :​other:​newppl:​dfs_on_win.png?​nolink |}}
  
 ==== The home directory ==== ==== The home directory ====
Line 417: Line 439:
     - A tutorial     - A tutorial
   * Useful Linux commands for working with (potentially big) text files ({{:​other:​newppl:​houchesa4_updated.pdf}})   * Useful Linux commands for working with (potentially big) text files ({{:​other:​newppl:​houchesa4_updated.pdf}})
-  * Using ssh on [[http://​ciclad-web.ipsl.jussieu.fr/​data/​documents/​ssh-utilisateurs-unix.pdf|Linux]] and [[http://​ciclad-web.ipsl.jussieu.fr/​data/​documents/​ssh_putty_v2_2011-1.pdf|Windows]] +  * Using [[other:ssh|ssh]] and [[other:ssh#copying_files_with_scp|scp]]
-  * An annotated reference card of the emacs text editor ({{:other:newppl:​emacs_jyp.pdf}}) +
-    * JYP's .emacs file: {{:​other:​emacs_linux_150806.tar|for Linux}} - {{:​other:​emacs_win_7_64_140408.zip|for Windows}}, with [[other:​win7apps#gnu_emacs_gnuwin_diffutils|emacs for Windows]]+
  
-You can also check the [[http://​wiki.ipsl.jussieu.fr/​FondamentauxpoleModelisationClimat|Les fondamentaux du pôle de modélisation du climat de l'​IPSL]] wiki page+==== Text editors ====
  
 +<note important>​A //jupyter notebook// is **not** a text editor!
 +
 +You need a correct text editor to efficiently work with scripts and programs</​note> ​
 +
 +There are **lots** of text editors used on Linux computers/​servers (vi, vim, gvim, emacs, nano, ...), that you can use:
 +  * in basic text terminals (if you know the basic commands and shortcuts)
 +  * or in graphics mode (you may need to have an [[other:​x_conf|X server configured]])
 +
 +=== emacs ===
 +
 +<note important>​Read the **dedicated [[other:​emacs_doc|Using emacs]] page**, and become a power user!</​note>​
 +
 +{{ :​other:​newppl:​real_programmers.png?​direct&​600 |}} [[https://​www.explainxkcd.com/​wiki/​index.php/​378:​_Real_Programmers|xkcd & Real Programmers]]
 +
 +
 +=== vi (vim, gvim) ===
 +
 +  * [[https://​www.atmos.albany.edu/​daes/​atmclasses/​atm350/​vi_cheat_sheet.pdf|vi cheat sheet]]
 +  * [[https://​web.mit.edu/​merolish/​Public/​vi-ref.pdf|vi reference card]]
 +
 +=== Notepad++ ===
 +
 +[[other:​win10apps#​notepad|Notepad++]] seems like a nice and powerful text editor for **Windows**,​ if you don't have  the time and resource to install WSL+emacs
 ==== NetCDF and file formats ==== ==== NetCDF and file formats ====
  
Line 438: Line 481:
     * Using the [[http://​unidata.github.io/​netcdf4-python/​|netCDF4]] module     * Using the [[http://​unidata.github.io/​netcdf4-python/​|netCDF4]] module
  
-==== Using the Python language ​====+==== Programming languages ​====
  
-  ​[[other:python:​starting|Working with Python]] +  ​[[other:index#​python_notes|JYP'​s ​Python notes]]
-  - [[other:​python:​jyp_steps|JYP'​s ​recommended steps for learning python]]+
  
 ===== Getting help (from the LSCE system administrators) ===== ===== Getting help (from the LSCE system administrators) =====
Line 481: Line 523:
 {{ :​other:​newppl:​screenshot_xfce.jpg?​200 |Click to get a larger version}} {{ :​other:​newppl:​screenshot_xfce.jpg?​200 |Click to get a larger version}}
  
-On Windows, you can use the //Capture screen// option of [[other:win7apps#xnview|XnView]]+On Windows, you can use [[other:​win10apps#​snip_sketch|Snip & Sketch]], or the //Capture screen// option of [[other:win10apps#xnview_classic|XnView]]
 {{ :​other:​newppl:​xnview_capture.jpg?​200 |Click to get a larger version}} {{ :​other:​newppl:​xnview_capture.jpg?​200 |Click to get a larger version}}
  
-===== Accessing the LSCE servers from outside the LSCE ===== +===== Getting ​help, when using the IPSL Mesocenter ​=====
- +
-The only way to access the LSCE servers from outside LSCE is to connect first to the **ssh1.lsce.ipsl.fr** gateway server. +
- +
-==== Interactive access ==== +
- +
-  - Send a mail to //help-lsce//and request an access to the //ssh1// server +
-  - Use ''​ssh''​ to **connect** to //ssh1// +
-    * From a terminal on a Linux/​Windows10/​Mac computer: ''​ssh -A -X your_lsce_login@ssh1.lsce.ipsl.fr''​ +
-    * From a Windows computer: +
-      * Text only: use [[other:​win10apps#​putty_pageant|Putty]]. Putty allows you to open text terminals on remote computers +
-      * Text **and graphics**: you need to [[https://​wiki.lsce.ipsl.fr/​pmip3/​doku.php/​other:​win10wsl#​using_an_x_server|install an X server]] on your computer in order to display the graphics +
-  - You can access all LSCE disks from //ssh1//, but there is only a limited number of programs that you can run, so you have to go from //ssh1// to //obelix// or //irene// with one of the ''​ssh''​ commands below: +
-    * ''​ssh obelix''​ +
-    * ''​ssh your_tgcc_login@curie-ccrt.ccc.cea.fr''​ +
-  - It's possible to use only one line to to both ssh commands +
-    * obelix: ''​ssh -A -X your_lsce_login@ssh1.lsce.ipsl.fr -t ssh -A obelix''​ +
-    * TGCC: ''​ssh -A -X your_lsce_login@ssh1.lsce.ipsl.fr -t ssh -A your_tgcc_login@curie-ccrt.ccc.cea.fr''​ +
-  - You can define an alias in order to connect more easily to the machines: +
-    * //tcsh// users: add the following line to your ''​~/​.cshrc''​ configuration file\\ ''​alias sobelix 'ssh -A -X your_lsce_login@ssh1.lsce.ipsl.fr -t ssh -A obelix'''​ +
-    * //bash// users: add the following line to your ''​~/​.bashrc''​ configuration file\\ ''​alias sobelix='ssh -A -X your_lsce_login@ssh1.lsce.ipsl.fr -t ssh -A obelix'''​ +
-  - You should create and configure an //ssh key//, if you don't want to type your password each time you use ssh or scp +
-  - If you want more information about ''​ssh''​ +
-    * Linux users: http://​ciclad-web.ipsl.jussieu.fr/​data/​documents/​ssh-utilisateurs-unix.pdf +
-    * Windows users: http://​ciclad-web.ipsl.jussieu.fr/​data/​documents/​ssh_putty_v2_2011-1.pdf +
- +
-==== Copying files to/from LSCE ==== +
- +
-If you need to **transfer** files to/from LSCE, use ''​scp''​ (on Linux and Windows 10), or a graphical scp client such as [[other:​win10apps#​winscp|WinSCP]] (on Windows) between your computer and ''​ssh1.lsce.ipsl.fr''​ +
- +
-  * Example: +
-    * Sending **one file** from a Linux/​Windows10/​Mac computer to your //scratch// directory at LSCE:\\ ''​scp -p file_on_your_computer_outside_lsce your_lsce_login@ssh1.lsce.ipsl.fr:/​home/​scratch01/​your_lsce_login/''​ +
-    * Sending recursively **a full directory**:​\\ ''​scp -pr directory_on_your_computer_outside_lsce your_lsce_login@ssh1.lsce.ipsl.fr:/​home/​scratch01/​your_lsce_login/''​+
  
 +Check the [[https://​mesocentre.ipsl.fr/​contacts//​|Contacts]] page
 ===== What next? ===== ===== What next? =====
  
other/newppl/starting.txt · Last modified: 2024/04/24 12:37 by jypeter