This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision Next revision Both sides next revision | ||
other:newppl:starting [2018/07/27 08:18] jypeter [Miscellaneous information] Added Trouver un logement... |
other:newppl:starting [2022/06/28 14:12] jypeter Added link to IPSL Mesocenter contact page |
||
---|---|---|---|
Line 1: | Line 1: | ||
- | ====== Getting started in CLIM & ESTIMR ====== | + | ====== Getting started at LSCE (by JYP) ====== |
- | <note tip>Welcome to the CLIM & ESTIMR teams!\\ \\ You are probably reading this page because you are a new intern student, visitor, etc...\\ This page will help you survive your first steps at LSCE, at least survive the computers...\\ \\ Reading this page will save your life (and a lot of time)!</note> | + | <note tip>Welcome to LSCE!\\ \\ You are probably reading this page because you are a new PhD or intern student, visitor, etc...\\ This page will help you survive your first steps at LSCE, at least survive using the computers (LSCE computers are your future best friends)...\\ \\ Reading this page will save your life (and a lot of time)!\\ \\ This page used to be for the newcomers in the //CLIM// and //ESTIMR// teams, but we can share information LOL</note> |
===== Miscellaneous information ===== | ===== Miscellaneous information ===== | ||
- | A few useful links that have nothing to do with science and software resources! | + | A few useful links. Some have nothing to do with science and LSCE hardware/software resources! |
+ | * [[#accessing_the_lsce_intranet|LSCE intranet]] | ||
+ | |||
+ | * [[other:newppl:pub_transport|LSCE-related public transport]] | ||
* [[other:newppl:riealgo|Adding money online to your restaurant account]] | * [[other:newppl:riealgo|Adding money online to your restaurant account]] | ||
* [[https://intranet.lsce.ipsl.fr/Phocea/Page/index.php?id=97|Survival kit and other information for CDD and interns]] (LSCE intranet) | * [[https://intranet.lsce.ipsl.fr/Phocea/Page/index.php?id=97|Survival kit and other information for CDD and interns]] (LSCE intranet) | ||
* [[http://internationaloffice.ceasaclay.com/?lang=en|CEA Saclay International Office]] //Our multilingual staff is readily available to assist you through immigration procedures and to help you settle in France// | * [[http://internationaloffice.ceasaclay.com/?lang=en|CEA Saclay International Office]] //Our multilingual staff is readily available to assist you through immigration procedures and to help you settle in France// | ||
- | * [[https://www.universite-paris-saclay.fr/en/e-international-welcome-office|e-International Welcome Office]] //Paris-Saclay university help to prepare for your arrival in France and help you settle down in the best conditions// | + | * [[https://www.universite-paris-saclay.fr/en/campus-life/international-welcome-desk|International welcome desk]] //Université Paris-Saclay provides you with a variety of services and documentation to welcome international students and researchers under the best conditions// |
* [[https://logement.campus-paris-saclay.fr/| Trouver un logement dans une résidence universitaire]] (in French... //Finding a room in a student dorm//) | * [[https://logement.campus-paris-saclay.fr/| Trouver un logement dans une résidence universitaire]] (in French... //Finding a room in a student dorm//) | ||
* [[https://www.science-accueil.org/en/|Science Accueil]] | * [[https://www.science-accueil.org/en/|Science Accueil]] | ||
+ | * [[https://www.science-accueil.org/en/request-services/|Service request page]] | ||
+ | * {{:other:newppl:uvsq-guide-du-personnel-nov2019.pdf|Guide du Personnel UVSQ}} | ||
+ | |||
+ | ===== Phone directory, and map of the building ===== | ||
+ | |||
+ | ==== Using existing information ==== | ||
+ | |||
+ | * [[https://intranet.lsce.ipsl.fr/en/Phocea/Membres/Annuaire/index.php|Phone directory]] (intranet) | ||
+ | * Dial **2** + ''NNNN'' (last 4 digits) to call somebody at LSCE (or CEA Saclay) from LSCE | ||
+ | * [[https://intranet.lsce.ipsl.fr/PlanLabo/index.html|701 and 714 map]] (intranet) | ||
+ | |||
+ | ==== Updating the directory/map information ==== | ||
+ | |||
+ | <WRAP center round important 60%> | ||
+ | It's very important that you update your phone/office information when you arrive at LSCE, so that other people can find you using the tools above! | ||
+ | </WRAP> | ||
+ | |||
+ | === Finding your phone number === | ||
+ | |||
+ | Use the following sequence of keys on the //Mitel// phone in your office: | ||
+ | - Select **MENU** (use the downward arrow) | ||
+ | - Select **PARAMETRES** (use the downward arrow) | ||
+ | - Select **GENERAL** (use the downward arrow) | ||
+ | - Select **MON NUMERO** | ||
+ | * This will display your **2** + ''NNNN'' phone number | ||
+ | * You can be called from outside with ''01 69 08 NN NN'' | ||
+ | |||
+ | === Updating your entry in the directory === | ||
+ | |||
+ | - Find your name in the [[https://intranet.lsce.ipsl.fr/en/Phocea/Membres/Annuaire/index.php|phone directory]] | ||
+ | - Click on **Modifier mes coordonnées** (in blue on the right side) | ||
+ | - Click on **Informations dans l'annuaire** and update the different fields | ||
+ | - Click on **Envoyez votre demande** | ||
+ | |||
===== The LSCE mailing lists ===== | ===== The LSCE mailing lists ===== | ||
Line 28: | Line 65: | ||
Mails sent to these lists will reach lots of people. Think well **before** sending a mail to these lists! | Mails sent to these lists will reach lots of people. Think well **before** sending a mail to these lists! | ||
- | ==== The 'clim' and 'estimr' lists ==== | + | ==== The teams mailing lists ==== |
- | Ask your team leader or Jean-Yves to add you to your team's mailing list | + | Ask your team leader to add you to your team's mailing list. Example below: the //CLIM// and //ESTIMR// lists |
^ List ^ Team ^ Archive ^ | ^ List ^ Team ^ Archive ^ | ||
Line 44: | Line 81: | ||
===== Using your own computer at LSCE? ===== | ===== Using your own computer at LSCE? ===== | ||
- | No need to try to connect your laptop to the LSCE wire network, it will not work! | + | No need to try to connect your personal laptop to the LSCE wire network, it will **not** work! |
- | The best you can do is use the [[https://intranet.lsce.ipsl.fr/informatique/wifi/index.php|eduroam or guest wifi]] network, if your office is close enough to one of the access points. | + | The best you can do is use the [[https://intranet.lsce.ipsl.fr/informatique/en/wifi/index.php|Guest WiFi]] or [[https://intranet.lsce.ipsl.fr/informatique/en/wifi/eduroam.php|eduroam]] network, if your office is close enough to one of the access points. |
- | **Warning!** You can't connect directly to the //obelix// LSCE servers from the wifi network. You first have to connect to ''ssh1.lsce.ipsl.fr'', and then to ''obelix'' | + | **Warning!** You **can't** connect directly to the //obelix// LSCE servers from the wifi network. You first have to connect to the ''ssh1.lsce.ipsl.fr'' //gateway// server, and then to ''obelix''. More details in [[#accessing_the_lsce_servers_from_outside_the_lsce|Accessing the LSCE servers from outside the LSCE]] |
===== Accessing the LSCE intranet ===== | ===== Accessing the LSCE intranet ===== | ||
- | Web site: https://intranet.lsce.ipsl.fr/ | + | <WRAP center round tip 60%> |
+ | If you try to access the intranet **from outside the LSCE** network (including //eduroam//), your browser will open a ''login''/''password'' popup window. Use your LSCE login (not your email address!) and password | ||
+ | </WRAP> | ||
+ | |||
+ | |||
+ | Intranet web site: https://intranet.lsce.ipsl.fr/ | ||
There is a lot of information available on the LSCE intranet, but you can only access it from a computer connected to the LSCE network | There is a lot of information available on the LSCE intranet, but you can only access it from a computer connected to the LSCE network | ||
Line 59: | Line 101: | ||
* Reading the mails with the [[https://agenda.lsce.ipsl.fr/|webmail]] or [[https://intranet.lsce.ipsl.fr/informatique/en/mail/thunderbird.php|Thunderbird]] | * Reading the mails with the [[https://agenda.lsce.ipsl.fr/|webmail]] or [[https://intranet.lsce.ipsl.fr/informatique/en/mail/thunderbird.php|Thunderbird]] | ||
- | * As soon as you have a LSCE e-mail address, make sure it is added to the //clim// or //estimr// **mailing list** | + | * As soon as you have a LSCE e-mail address, make sure it is added to [[#the_teams_mailing_lists|you team's list]] |
* [[https://intranet.lsce.ipsl.fr/informatique/en/orme/imprimantes.php|Printers]] | * [[https://intranet.lsce.ipsl.fr/informatique/en/orme/imprimantes.php|Printers]] | ||
Line 85: | Line 127: | ||
===== Setting up your desktop computer ===== | ===== Setting up your desktop computer ===== | ||
- | Everybody working for CLIM & ESTIMR gets a computer that can be connected to the LSCE network. Please take the time to read the instructions below, that may help make your life easier | + | You should receive a desktop/laptop connected to the LSCE network when you arrive. Please take the time to read the instructions below, that may help make your life easier |
+ | |||
+ | ==== Windows computer ==== | ||
- | ==== Windows 7 computer ==== | + | Read the [[other:index#windows_10_notes|Windows 10 notes]], especially the //Configuring Windows 10// section |
- | Read the notes (and follow the instructions) in [[other:index#windows_7_notes|Windows 7 notes]], especially the [[other:win7config|Basic Windows 7 Configuration]] section | + | Note: there are also some [[other:index#windows_7_notes|Windows 7 notes]], but you are supposed to use Windows 10 since January 2020! |
=== Getting administrator's rights === | === Getting administrator's rights === | ||
Line 95: | Line 139: | ||
<note warning>\\ Make sure you know what you are doing and that you are not executing a virus asking you suspicious access rights!\\ </note> | <note warning>\\ Make sure you know what you are doing and that you are not executing a virus asking you suspicious access rights!\\ </note> | ||
- | If an application requests administrator's rights to install something or make changes to the computer, **and you are sure it's not a virus**, use the ''.\adminuser'' account and the adminuser password you got when your computer was configured, or ask the [[.:starting?do=edit#getting_help_from_the_lsce_system_administrators|system administrators]]. | + | If an application requests administrator's rights to install something or make changes to the computer, **and you are sure it's not a virus**, use the ''.\admin'' local account and the ''admin'' password you received when your computer was configured, or ask the [[.:starting?do=edit#getting_help_from_the_lsce_system_administrators|system administrators]]. |
==== Linux computer ==== | ==== Linux computer ==== | ||
Line 121: | Line 165: | ||
Follow the instructions in the [[https://intranet.lsce.ipsl.fr/informatique/en/winsrv.php|Windows servers]] page. If you need to use a program that is missing on this cluster, see the [[#getting_help_from_the_lsce_system_administrators|Help]] section | Follow the instructions in the [[https://intranet.lsce.ipsl.fr/informatique/en/winsrv.php|Windows servers]] page. If you need to use a program that is missing on this cluster, see the [[#getting_help_from_the_lsce_system_administrators|Help]] section | ||
- | ===== Accessing the Linux servers from your LSCE deskop ===== | + | ===== Accessing the LSCE Linux servers ===== |
- | ==== Linux or mac desktop ==== | + | You have to [[other:ssh|use ssh to connect to the servers]], and [[other:ssh#copying_files_with_scp|use scp to copy files between servers]] |
- | Just open a terminal and [[#which_linux_servers_should_you_use|use ssh to connect to the appropriate server]] | + | If you are really in a hurry, go directly to the [[other:ssh#connecting_to_the_lsce_servers_ipsl_servers_tgcc|Connecting to the LSCE servers, IPSL servers, TGCC, ...]] section, but it is important that you **read the full [[other:ssh|ssh documentation]] page at least once**! |
- | ==== Windows desktop ==== | ||
- | There should be an //Obelix// shortcut on the left side of your desktop. Double-click on it in order to open a window (e.g. with graphics) environment on one of the obelix servers. Each terminal you will open in this environment will run on the same obelix server. Use ssh to [[#which_linux_servers_should_you_use|connect another server]] | ||
- | If there is not yet an //Obelix// shortcut, use the [[other:win7apps#setup|VcXsrv XLaunch]] program to create it | + | ===== Which Linux servers should you use? ===== |
- | Note: you can also use [[other:win7apps#putty|Putty]] if you just need text windows, or [[other:win7apps#vcxsrv_windows_x_server|VcXsrv]] or [[other:win7apps#putty|Putty]]+[[other:win7apps#cygwin-x|Cygwin-X]] if you also need graphics | + | ==== Working directly on your desktop ==== |
- | ===== Which Linux servers should you use? ===== | + | Always remember that **your local LSCE desktop can [[#accessing_remote_disks|access remote disks on the LSCE servers]]**. |
- | There are lots of things you can do directly on your **local** Win7 or Linux desktop (displaying pdf, images, using a text editor, ...), rather than on the remote servers. Never forget that **your local desktop has access to the remote disks on the Linux servers**. | + | There are lots of things you can do directly on your **local** Windows 10 or Linux desktop (displaying pdf, images, using a text editor, ...), rather than on the remote servers. For example, if a script running on the servers generates a pdf file, it is more efficient to open this pdf file using ''Acrobat''/''evince'' on your desktop, than by using ''evince'' on the server. |
- | Otherwise, **use the appropriate Linux servers**. The //load balancing// system will send you to the server that has currently the smallest load | + | ==== Available servers ==== |
- | * obelixN (''ssh obelix'', or ''ssh obelix.lb''): never forget that you are sharing these servers with other users! Do not use too much CPU and memory for a long time. Heavy computation should be done on the obelix cluster | + | * **The LSCE interactive servers**: ''obelix//NN//''\\ Use ''ssh obelix'' to access these servers, and the //load balancing// system will send you to the server that has currently the smallest load.\\ Never forget that you are sharing these servers with other users! Do not use too much CPU and/or memory for a long time. Heavy computation should be done on the //LSCE cluster// |
- | * [[https://intranet.lsce.ipsl.fr/informatique/en/calcul/batch.php|the batch system]] (aka //obelix cluster//) for really heavy duty programs | + | * <code>$ ssh obelix |
- | * in some cases, you may need an account to use the [[http://mesocentre.ipsl.fr/|IPSL/ESPRI clusters]] (aka //ciclad// and //climserv//), especially if you need to use data that is already available/mirrored there, rather than copying the data to LSCE | + | Last login: Mon Jun 3 08:49:53 2019 from somewhere |
- | * asterixN: some people may mention these servers, but they don't exist any more! | + | # You can use one of the following commands if you want to know on which obelix you are |
+ | $ echo $HOST | ||
+ | obelix5 | ||
+ | $ hostname | ||
+ | obelix5</code> | ||
+ | |||
+ | * **[[https://intranet.lsce.ipsl.fr/informatique/en/calcul/batch.php|The LSCE cluster]]** (aka the //batch system//)\\ Use this cluster for really heavy duty programs, rather than killing the multi-users interactive servers | ||
+ | |||
+ | * **The [[http://mesocentre.ipsl.fr/|IPSL/ESPRI Mesocenter servers/clusters]]** (''ciclad'' / ''climserv'' / etc...)\\ You will need an account (different from your //LSCE// account) to access these servers and use data files that are already available/mirrored there (e.g. **''CMIPn'' data**). **Do not duplicate** at LSCE data that is already available on IPSL servers and that you can process there! | ||
+ | * [[http://mesocentre.ipsl.fr/account-opening/|Requesting a new account]] | ||
+ | * [[https://documentations.ipsl.fr/MESO_User/|IPSL ESPRI Mesocenter documentation]] (//English//) | ||
+ | * [[https://mesocentre.ipsl.fr/quick-start/|Utilisation du Mésocentre IPSL]] (//French//, the //English// documentation link above has more information) | ||
+ | |||
+ | * **The ''asterix//NN//'' servers**\\ Some wise LSCE elders may mention these servers, but they don't exist any more! | ||
==== Which shell are you using? ==== | ==== Which shell are you using? ==== | ||
Line 166: | Line 221: | ||
If the Linux server you are working on seems slow, or if you want to get an idea of the resources **you** are using, you should use the ''top'' command | If the Linux server you are working on seems slow, or if you want to get an idea of the resources **you** are using, you should use the ''top'' command | ||
- | <code>jypeter@obelix4 - ...jypeter - 46 >top | + | <code> >hostname |
+ | obelix3 | ||
+ | |||
+ | >top | ||
top - 17:48:51 up 8 days, 23:43, 29 users, load average: 1.22, 1.38, 1.98 | top - 17:48:51 up 8 days, 23:43, 29 users, load average: 1.22, 1.38, 1.98 | ||
Tasks: 324 total, 2 running, 320 sleeping, 2 stopped, 0 zombie | Tasks: 324 total, 2 running, 320 sleeping, 2 stopped, 0 zombie | ||
Line 174: | Line 232: | ||
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND | PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND | ||
- | 10193 mpeau 20 0 302m 4336 2272 R 100.0 0.0 7033:08 emacs | + | 10193 john 20 0 302m 4336 2272 R 100.0 0.0 7033:08 emacs |
- | 16504 mpeau 20 0 110m 2008 1228 S 0.7 0.0 0:00.13 tcsh | + | 16504 john 20 0 110m 2008 1228 S 0.7 0.0 0:00.13 tcsh |
- | 26344 dzhu 20 0 1635m 20m 3880 S 0.3 0.1 0:44.90 ipython | + | 26344 jane 20 0 1635m 20m 3880 S 0.3 0.1 0:44.90 ipython |
1 root 20 0 21448 1108 892 S 0.0 0.0 0:01.61 init | 1 root 20 0 21448 1108 892 S 0.0 0.0 0:01.61 init | ||
[...] | [...] | ||
Line 186: | Line 244: | ||
<code> PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND | <code> PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND | ||
- | 16092 jchang 20 0 8488m 8.1g 7912 R 99.6 25.9 1:41.38 idl | + | 16092 bob 20 0 8488m 8.1g 7912 R 99.6 25.9 1:41.38 idl |
- | 23256 pvait 20 0 232m 70m 2632 S 0.0 0.2 0:01.36 R | + | 23256 john 20 0 232m 70m 2632 S 0.0 0.2 0:01.36 R |
- | 26344 dzhu 20 0 1635m 20m 3880 S 0.0 0.1 0:44.87 ipython | + | 26344 jane 20 0 1635m 20m 3880 S 0.0 0.1 0:44.87 ipython |
- | 10619 astege 20 0 954m 9292 2664 S 0.0 0.0 0:40.67 gedit | + | 10619 bob 20 0 954m 9292 2664 S 0.0 0.0 0:40.67 gedit |
1362 nslcd 20 0 442m 6056 2208 S 0.0 0.0 2:13.98 nslcd | 1362 nslcd 20 0 442m 6056 2208 S 0.0 0.0 2:13.98 nslcd | ||
- | 16238 twang 20 0 128m 5068 2076 S 0.0 0.0 0:00.05 gconfd-2 | + | 10193 john 20 0 302m 4336 2272 R 99.9 0.0 7024:13 emacs |
- | 10193 mpeau 20 0 302m 4336 2272 R 99.9 0.0 7024:13 emacs | + | |
[...]</code> | [...]</code> | ||
Line 206: | Line 263: | ||
<note warning> | <note warning> | ||
* It is very important to use the correct directories and make it easy for your advisor to find things after you have left | * It is very important to use the correct directories and make it easy for your advisor to find things after you have left | ||
- | * **Put the source codes, scripts and papers you are writing on a backed up disk** | + | * <wrap em>**Put the source codes, scripts and papers you are writing on a backed up disk**</wrap> |
- | * Put temporary files on a scratch disk | + | * The <wrap em>backed up disk at LSCE</wrap> is [[#the_home_directory|home directory]]\\ You should have a few Gb available on //home//\\ Use the ''quota -s'' command to find out the exact amount |
- | * Do NOT put (big) data files on a backed up disk | + | * Put **temporary files** on a scratch disk (''scratch01'' at LSCE) |
+ | * Do **NOT** put (big) data files on a backed up disk | ||
* Do not forget to clean your directories before you leave (ask your advisor what should be kept or cleaned) | * Do not forget to clean your directories before you leave (ask your advisor what should be kept or cleaned) | ||
Line 215: | Line 273: | ||
==== Accessing remote disks ==== | ==== Accessing remote disks ==== | ||
- | It is possible to access directly all the disks on the LSCE servers from your local Linux or Windows desktop | + | It is possible to access directly all the disks on the LSCE servers from your //local// Linux or Windows computer\\ (//local// = a computer on the LSCE ethernet/wired network) |
* Example path on the LSCE Linux server: ''/home/scratch01/your_lsce_login'' | * Example path on the LSCE Linux server: ''/home/scratch01/your_lsce_login'' | ||
- | * Accessing the same path from a local desktop: | + | * Accessing the path above from a //local// computer: |
- | * Linux desktop: ''/home/scratch01/your_lsce_login'' | + | * Linux computer: ''/home/scratch01/your_lsce_login'' |
- | * Windows desktop: ''\\dfshost\dfs\scratch01\your_lsce_login''\\ {{ :other:newppl:dfs_on_win.png?nolink |}} | + | * Windows computer: ''\\dfshost\dfs\scratch01\your_lsce_login''\\ {{ :other:newppl:dfs_on_win.png?nolink |}} |
==== The home directory ==== | ==== The home directory ==== | ||
Line 234: | Line 292: | ||
* bash shell users: ''.profile'' and ''.bashrc'' | * bash shell users: ''.profile'' and ''.bashrc'' | ||
* emacs text editor: ''.emacs'' | * emacs text editor: ''.emacs'' | ||
+ | * You can go to your home directory by typing ''cd'' (no arguments),\\ and to the home directory of somebody else with ''cd ~login_name'' | ||
+ | * At LSCE, you can't read the content of somebody else's //home// directory by default | ||
* **Backup of the home directory on the LSCE servers**: YES! Every night | * **Backup of the home directory on the LSCE servers**: YES! Every night | ||
- | * More details on the [[https://intranet.lsce.ipsl.fr/informatique/en/nsr/index.php|backup system]] page | + | * More details on the [[https://intranet.lsce.ipsl.fr/informatique/en/nsr/index.php|LSCE backup system]] page |
- | * Put the most important sources/scripts/data/papers in this directory | + | * <wrap em>Put the most important sources/scripts/data/papers in this directory</wrap> |
- | * Do not put temporary files, or big data files that are available somewhere else in this directory! | + | * **Do not** use the //home// directory to store: |
- | * Your home directory will also be archived when your account is closed | + | * temporary files (use ''scratch01'') |
+ | * big (or many) data files (use ''scratch01'' or a project specific disk) | ||
+ | * Your home directory will be archived when your account is closed, so that you or your advisor can access it later, if required | ||
* **Backup of the TGCC home directory**: YES! | * **Backup of the TGCC home directory**: YES! | ||
Line 247: | Line 309: | ||
> quota -s | > quota -s | ||
- | Disk quotas for user jypeter (uid 6369): | + | Disk quotas for user johndoe (uid 6369): |
Filesystem blocks quota limit grace files quota limit grace | Filesystem blocks quota limit grace files quota limit grace | ||
prolix3:/users/ 4658M 4883M 4981M 23503 0 0</code> | prolix3:/users/ 4658M 4883M 4981M 23503 0 0</code> | ||
==== The scratch directory ==== | ==== The scratch directory ==== | ||
+ | |||
+ | <note warning>Do not put anything in the scratch directory that you can't recreate with a program, or copy/download from somewhere else!</note> | ||
* **Location**: ''/home/scratch01/your_lsce_login'' | * **Location**: ''/home/scratch01/your_lsce_login'' | ||
Line 264: | Line 328: | ||
==== Project specific directories ==== | ==== Project specific directories ==== | ||
+ | |||
+ | <note warning>The data on these disks is <wrap em>probably not backed up</wrap>... You are not protected against file deletion by mistake, or a disk crash (a major disk crash is not likely, but can happen) | ||
+ | |||
+ | \\ You should <wrap em>store your source codes, scripts, notebooks, manuscripts, reports, figures, on a backed up directory</wrap>, and only store on the project disks data downloaded from outside, or that you can regenerate with the backed up scripts</note> | ||
+ | |||
* **Location**: ''/home/some_project_name/your_lsce_login'' | * **Location**: ''/home/some_project_name/your_lsce_login'' | ||
* Ask your advisor if you should use a specific project directory and the technical details about it | * Ask your advisor if you should use a specific project directory and the technical details about it | ||
- | * Use this directory for storing the (big) data files that you can't store safely in the //scratch// directory, and should not store in the //scratch// directory | + | * Use this directory for storing the (big) data files that you can't store safely in the //scratch// directory, and should not store in the //home// directory |
* **Backup**: ask your advisor | * **Backup**: ask your advisor | ||
Line 277: | Line 346: | ||
Your Linux environment may sometimes stop working correctly because you have exceeded the allowed quota on your disks (check your quotas with ''quota -s''). You can use the following command to get the size of all the directories and files in the current directory, sorted by size: ''du -sh * | sort -rh'' | Your Linux environment may sometimes stop working correctly because you have exceeded the allowed quota on your disks (check your quotas with ''quota -s''). You can use the following command to get the size of all the directories and files in the current directory, sorted by size: ''du -sh * | sort -rh'' | ||
- | <code>jypeter@obelix4 - ...jypeter - 46 >cd /home/scratch01/jypeter | + | <code> >cd /home/scratch01/johndoe |
- | /home/scratch01/jypeter | + | /home/scratch01/johndoe |
- | jypeter@obelix4 - ...jypeter - 47 >du -sh * | sort -rh | + | >du -sh * | sort -rh |
58M GLAC1DHiceF26.nc | 58M GLAC1DHiceF26.nc | ||
47M dashboard | 47M dashboard | ||
Line 288: | Line 357: | ||
3.2M cmake | 3.2M cmake | ||
...</code> | ...</code> | ||
+ | |||
+ | ===== Which programs should you use? ===== | ||
+ | |||
+ | Your advisor will let you know which (version of which) programs you should use. Some programs are available by default, and you have to use the ''module'' command to access other programs. | ||
+ | |||
+ | ==== Which program am I using? ==== | ||
+ | |||
+ | At any time, you can use the ''which'' command to determine where a program is located. The option to get the //version// information of a program may vary (launch the program without arguments, with ''-v'' or ''%%--%%v'', ...). | ||
+ | |||
+ | <code> > which ncdump | ||
+ | /usr/bin/ncdump | ||
+ | |||
+ | > ncdump | ||
+ | ncdump [-c|-h] [-v ...] [[-b|-f] [c|f]] [-l len] [-n name] [-p n[,n]] [-k] [-x] [-s] [-t|-i] [-g ...] [-w] file | ||
+ | [...] | ||
+ | netcdf library version 4.3.3.1 of Dec 10 2015 16:44:18 $ | ||
+ | |||
+ | > which python | ||
+ | /usr/bin/python | ||
+ | |||
+ | > python --version | ||
+ | Python 2.7.5 | ||
+ | </code> | ||
+ | |||
+ | ==== Using module to access optional programs ==== | ||
+ | |||
+ | Main ''module'' options: | ||
+ | * ''module list'': list the currently loaded modules | ||
+ | * ''module avail'': list the available modules | ||
+ | * ''module load module_a ... module_n'': load modules (automatically including dependencies) | ||
+ | * ''module load module_a'': load default version of //module_a// | ||
+ | * ''module load module_a/vvv'': load ''vvv'' version of //module_a// | ||
+ | * ''module purge'': remove all modules | ||
+ | |||
+ | Detailed example: | ||
+ | <code> > which ncview | ||
+ | ncview: Command not found. | ||
+ | |||
+ | > module list | ||
+ | No Modulefiles Currently Loaded. | ||
+ | |||
+ | > module avail | ||
+ | [...] | ||
+ | batch_env grib_api/1.14.0 netcdf/4 python/3.6 | ||
+ | [...] | ||
+ | glost/0.3.1 ncview/2.1.7 python/2.7 | ||
+ | |||
+ | > module load ncview netcdf/4 | ||
+ | |||
+ | > module list | ||
+ | Currently Loaded Modulefiles: | ||
+ | 1) ncview/2.1.7 2) netcdf/4 | ||
+ | | ||
+ | > which ncview | ||
+ | /usr/local/install/ncview-2.1.7/bin/ncview | ||
+ | |||
+ | > which ncdump | ||
+ | /usr/local/install/netcdf-4.3.2/bin/ncdump</code> | ||
===== Useful documentation for beginners ===== | ===== Useful documentation for beginners ===== | ||
Line 297: | Line 424: | ||
- A tutorial | - A tutorial | ||
* Useful Linux commands for working with (potentially big) text files ({{:other:newppl:houchesa4_updated.pdf}}) | * Useful Linux commands for working with (potentially big) text files ({{:other:newppl:houchesa4_updated.pdf}}) | ||
- | * Using ssh on [[http://ciclad-web.ipsl.jussieu.fr/data/documents/ssh-utilisateurs-unix.pdf|Linux]] and [[http://ciclad-web.ipsl.jussieu.fr/data/documents/ssh_putty_v2_2011-1.pdf|Windows]] | + | * Using [[other:ssh|ssh]] and [[other:ssh#copying_files_with_scp|scp]] |
- | * An annotated reference card of the emacs text editor ({{:other:newppl:emacs_jyp.pdf}}) | + | * Text editors: there are **lots** of text editors used on Linux computers/servers (vi, vim, gvim, emacs, nano, ...). You will find some basic information below |
- | * JYP's .emacs file: {{:other:emacs_linux_150806.tar|for Linux}} - {{:other:emacs_win_7_64_140408.zip|for Windows}}, with [[other:win7apps#gnu_emacs_gnuwin_diffutils|emacs for Windows]] | + | * ''vi'': [[https://www.atmos.albany.edu/daes/atmclasses/atm350/vi_cheat_sheet.pdf|vi cheat sheet]] and [[https://web.mit.edu/merolish/Public/vi-ref.pdf|vi reference card]] |
- | + | * An annotated reference card of the ''emacs'' text editor ({{:other:newppl:emacs_jyp.pdf}}) | |
- | You can also check the [[http://wiki.ipsl.jussieu.fr/FondamentauxpoleModelisationClimat|Les fondamentaux du pôle de modélisation du climat de l'IPSL]] wiki page | + | * JYP's .emacs file: {{:other:emacs_linux_150806.tar|for Linux}} - {{:other:emacs_win_7_64_140408.zip|for Windows}}, with [[other:win7apps#gnu_emacs_gnuwin_diffutils|emacs for Windows]] |
==== NetCDF and file formats ==== | ==== NetCDF and file formats ==== | ||
Line 325: | Line 451: | ||
===== Getting help (from the LSCE system administrators) ===== | ===== Getting help (from the LSCE system administrators) ===== | ||
- | Send a mail to: [[help-lsce@lsce.ipsl.fr]] | + | Send a mail to //help-lsce// |
==== Describing your problem ==== | ==== Describing your problem ==== | ||
Line 335: | Line 461: | ||
<code> >ssh -v obelix | <code> >ssh -v obelix | ||
OpenSSH_7.4p1, OpenSSL 1.0.2k-fips 26 Jan 2017 | OpenSSH_7.4p1, OpenSSL 1.0.2k-fips 26 Jan 2017 | ||
- | debug1: Reading configuration data /home/users/jypeter/.ssh/config | + | debug1: Reading configuration data /home/users/johndoe/.ssh/config |
debug1: Reading configuration data /etc/ssh/ssh_config | debug1: Reading configuration data /etc/ssh/ssh_config | ||
debug1: /etc/ssh/ssh_config line 58: Applying options for * | debug1: /etc/ssh/ssh_config line 58: Applying options for * | ||
Line 341: | Line 467: | ||
debug1: Connection established. | debug1: Connection established. | ||
debug1: key_load_public: No such file or directory | debug1: key_load_public: No such file or directory | ||
- | debug1: identity file /home/users/jypeter/.ssh/id_rsa type -1 | + | debug1: identity file /home/users/johndoe/.ssh/id_rsa type -1 |
[...] | [...] | ||
debug1: Entering interactive session. | debug1: Entering interactive session. | ||
Line 350: | Line 476: | ||
debug1: Sending env LANG = en_US | debug1: Sending env LANG = en_US | ||
Last login: Thu Mar 1 15:52:44 2018 from lsce4078.lsce.ipsl.fr | Last login: Thu Mar 1 15:52:44 2018 from lsce4078.lsce.ipsl.fr | ||
- | Disk quotas for user jypeter (uid 6369): | + | |
- | Filesystem space quota limit grace files quota limit grace | + | > |
- | prolix3:/users 4558M 9766M 10743M 23741 0 0 | + | |
- | jypeter@obelix3 - ...jypeter - 41 > | + | |
</code> | </code> | ||
Line 366: | Line 490: | ||
{{ :other:newppl:xnview_capture.jpg?200 |Click to get a larger version}} | {{ :other:newppl:xnview_capture.jpg?200 |Click to get a larger version}} | ||
- | ===== Accessing the LSCE servers from outside the LSCE ===== | + | ===== Getting help, when using the IPSL Mesocenter ===== |
- | + | ||
- | The only way to access the LSCE servers from outside LSCE is to connect first to the **ssh1.lsce.ipsl.fr** gateway server. | + | |
- | + | ||
- | ==== Interactive access ==== | + | |
- | + | ||
- | - Send a mail to [[help-lsce@lsce.ipsl.fr]], and request an access to the //ssh1// server | + | |
- | - Use ''ssh'' to **connect** to //ssh1// | + | |
- | * From a Linux/mac desktop: ''ssh -A -X your_lsce_login@ssh1.lsce.ipsl.fr'' | + | |
- | * From a Windows desktop: | + | |
- | * Text only: use [[other:win7apps#putty|Putty]] | + | |
- | * Text & graphics. This is more complex to set up, and you need to use one of the options below: | + | |
- | * use [[other:win7apps#vcxsrv_windows_x_server|VcXsrv]] | + | |
- | * use [[other:win7apps#cygwin-x|cygwin/X]] | + | |
- | * use [[other:index#virtualbox_notes|VirtualBox]] | + | |
- | - You can access all LSCE disks from //ssh1//, but there is only a limited number of programs that you can run, so you have to go from //ssh1// to //obelix// or //curie// with one of the ''ssh'' commands below: | + | |
- | * ''ssh obelix'' | + | |
- | * ''ssh your_tgcc_login@curie-ccrt.ccc.cea.fr'' | + | |
- | - It's possible to use only one line to to both ssh commands | + | |
- | * obelix: ''ssh -A -X your_lsce_login@ssh1.lsce.ipsl.fr -t ssh -A obelix'' | + | |
- | * TGCC: ''ssh -A -X your_lsce_login@ssh1.lsce.ipsl.fr -t ssh -A your_tgcc_login@curie-ccrt.ccc.cea.fr'' | + | |
- | - You can define an alias in order to connect more easily to the machines: | + | |
- | * //tcsh// users: add the following line to your ''~/.cshrc'' configuration file\\ ''alias sobelix 'ssh -A -X your_lsce_login@ssh1.lsce.ipsl.fr -t ssh -A obelix''' | + | |
- | * //bash// users: add the following line to your ''~/.bashrc'' configuration file\\ ''alias sobelix='ssh -A -X your_lsce_login@ssh1.lsce.ipsl.fr -t ssh -A obelix''' | + | |
- | - You should create and configure an //ssh key//, if you don't want to type your password each time you use ssh or scp | + | |
- | - If you want more information about ''ssh'' | + | |
- | * Linux users: http://ciclad-web.ipsl.jussieu.fr/data/documents/ssh-utilisateurs-unix.pdf | + | |
- | * Windows users: http://ciclad-web.ipsl.jussieu.fr/data/documents/ssh_putty_v2_2011-1.pdf | + | |
- | + | ||
- | ==== Copying files to/from LSCE ==== | + | |
- | + | ||
- | If you need to **transfer** files to/from LSCE, use ''scp'' (on Linux), or an scp client such as [[other:win7apps#winscp|WinSCP]] (on Windows) between your computer and ''ssh1.lsce.ipsl.fr'' | + | |
- | + | ||
- | * Example from a Linux/mac desktop: ''scp -p file_outside_lsce your_lsce_login@ssh1.lsce.ipsl.fr:/home/scratch01/your_lsce_login/'' | + | |
+ | Check the [[https://mesocentre.ipsl.fr/contacts//|Contacts]] page | ||
===== What next? ===== | ===== What next? ===== | ||