other:newppl:starting
Differences
This shows you the differences between two versions of the page.
Both sides previous revisionPrevious revisionNext revision | Previous revisionNext revisionBoth sides next revision | ||
other:newppl:starting [2016/02/11 10:45] – [Useful documentation for beginners] Improved the netcdf documentation jypeter | other:newppl:starting [2022/11/18 11:46] – Added a specific Text editors section jypeter | ||
---|---|---|---|
Line 1: | Line 1: | ||
- | ====== Getting started | + | ====== Getting started |
- | <note tip> | + | <note tip> |
+ | |||
+ | ===== Miscellaneous information ===== | ||
+ | |||
+ | A few useful links. Some have nothing to do with science and LSCE hardware/ | ||
+ | |||
+ | * [[# | ||
+ | |||
+ | * [[other: | ||
+ | * [[other: | ||
+ | * [[https:// | ||
+ | * [[http:// | ||
+ | * [[https:// | ||
+ | * [[https:// | ||
+ | * [[https:// | ||
+ | * [[https:// | ||
+ | * {{: | ||
+ | |||
+ | ===== Phone directory, and map of the building ===== | ||
+ | |||
+ | ==== Using existing information ==== | ||
+ | |||
+ | * [[https:// | ||
+ | * Dial **2** + '' | ||
+ | * [[https:// | ||
+ | |||
+ | ==== Updating the directory/ | ||
+ | |||
+ | <WRAP center round important 60%> | ||
+ | It's very important that you update your phone/ | ||
+ | </ | ||
+ | |||
+ | === Finding your phone number === | ||
+ | |||
+ | Use the following sequence of keys on the //Mitel// phone in your office: | ||
+ | - Select **MENU** (use the downward arrow) | ||
+ | - Select **PARAMETRES** (use the downward arrow) | ||
+ | - Select **GENERAL** (use the downward arrow) | ||
+ | - Select **MON NUMERO** | ||
+ | * This will display your **2** + '' | ||
+ | * You can be called from outside with '' | ||
+ | |||
+ | === Updating your entry in the directory === | ||
+ | |||
+ | - Find your name in the [[https:// | ||
+ | - Click on **Modifier mes coordonnées** (in blue on the right side) | ||
+ | - Click on **Informations dans l' | ||
+ | - Click on **Envoyez votre demande** | ||
+ | |||
+ | ===== The LSCE mailing lists ===== | ||
+ | |||
+ | It is important to join the correct mailing lists, if you want to get all the information you need, on time. | ||
+ | |||
+ | ==== The ' | ||
+ | |||
+ | When your account is created, your email address should automatically be added to the the //all// list, that can be used to send mails to all the people working at LSCE. You will also get IPSL information through this list | ||
+ | |||
+ | | [[all@lsce.ipsl.fr]] | Everybody at LSCE | | ||
+ | | [[lsce-orme@lsce.ipsl.fr]] | People working at Orme | | ||
+ | | [[lsce-gif@lsce.ipsl.fr]] | People working in Gif | | ||
+ | |||
+ | Mails sent to these lists will reach lots of people. Think well **before** sending a mail to these lists! | ||
+ | |||
+ | ==== The teams mailing lists ==== | ||
+ | |||
+ | Ask your team leader to add you to your team's mailing list. Example below: the //CLIM// and //ESTIMR// lists | ||
+ | |||
+ | ^ List ^ Team ^ Archive | ||
+ | | [[clim@lists.lsce.ipsl.fr]] | // | ||
+ | | [[estimr@lists.lsce.ipsl.fr]] | // | ||
+ | |||
+ | ==== Notes ==== | ||
+ | |||
+ | * You have to be identified on the server to access most lists' | ||
+ | * You may want/need to join other mailing lists (project specific, sports, ...). Check the [[https:// | ||
+ | * It is possible to [[https:// | ||
===== Using your own computer at LSCE? ===== | ===== Using your own computer at LSCE? ===== | ||
- | No need to try to connect your laptop to the LSCE wire network, it will not work! | + | <wrap em>You can' |
- | The best you can do is use the [[https:// | + | The best you can do is use the [[https:// |
- | **Warning!** You can't connect directly to the LSCE servers from the wifi network. | + | **Warning!** You **can't** connect directly to the // |
===== Accessing the LSCE intranet ===== | ===== Accessing the LSCE intranet ===== | ||
- | Web site: https:// | + | <WRAP center round tip 60%> |
+ | If you try to access the intranet **from outside the LSCE** network (including // | ||
+ | |||
+ | Use your LSCE login (not your email address!) and password\\ e.g. use '' | ||
+ | </ | ||
+ | |||
+ | |||
+ | Intranet web site: https:// | ||
There is a lot of information available on the LSCE intranet, but you can only access it from a computer connected to the LSCE network | There is a lot of information available on the LSCE intranet, but you can only access it from a computer connected to the LSCE network | ||
Line 21: | Line 103: | ||
* Reading the mails with the [[https:// | * Reading the mails with the [[https:// | ||
- | * As soon as you have a LSCE e-mail address, make sure it is added to the clim or estimr **mailing | + | * As soon as you have a LSCE e-mail address, make sure it is added to [[# |
* [[https:// | * [[https:// | ||
- | ===== Accessing the CEA saclay | + | ===== Accessing the CEA Saclay |
- | Web site: http:// | + | <WRAP center round important 60%> |
+ | It used to be possible to access the CEA Saclay intranet by just clicking on http:// | ||
- | You can only access it from the LSCE and CEA network! This intranet is the place where you can get information about: | + | This is **not possible** anymore, now that LSCE is on the Paris-Saclay network (and not on the CEA network) |
+ | </ | ||
- | * [[http://www-saclay.cea.fr/Phocea/Page/index.php? | + | Use the following steps: |
- | * [[http://www-saclay.cea.fr/fna/index.php|Security training registration]] | + | - Start Chrome (or try another browser) |
+ | - Open the following link: https://vpnssl.cea.fr/ | ||
+ | * ignore the security errors | ||
+ | * this link will work from the Paris Saclay network, and ANY other location (e.g. home) OUTSIDE of CEA | ||
+ | - Use your initials and badge number as the **login** (e.g. "//James Bond//" | ||
+ | - Select the CEA web site you want from the " | ||
+ | * **Espace Sigma**: that's where you specify when you will be on holidays | ||
+ | * **Intranet Saclay**: where you can get information about the CEA buses, CEA directory, security training registration and information, | ||
+ | * **Intranet du voyageur**: if you need to make a plane/train reservation | ||
+ | * ... | ||
+ | - Click on //logout// when you are done | ||
===== Setting up your desktop computer ===== | ===== Setting up your desktop computer ===== | ||
- | Everybody working for CLIM & ESTIMR gets a computer that can be connected to the LSCE network. Please take the time to read the instructions below, that may help make your life easier | + | You should receive |
- | ==== Windows | + | ==== Windows computer ==== |
- | Read the notes (and follow the instructions) in [[other: | + | Read the [[other: |
=== Getting administrator' | === Getting administrator' | ||
Line 45: | Line 139: | ||
<note warning> | <note warning> | ||
- | If an application requests administrator' | + | If an application requests administrator' |
==== Linux computer ==== | ==== Linux computer ==== | ||
Line 65: | Line 159: | ||
==== Mac ==== | ==== Mac ==== | ||
- | Sorry, you are on your own, but it' | + | Sorry, you are (almost) |
- | ===== Accessing the Linux servers from your LSCE deskop ===== | + | Some useful mac links: |
+ | * [[other: | ||
+ | * [[other: | ||
+ | * [[other: | ||
- | ==== Linux or mac desktop | + | ===== Accessing the Windows cluster from a Linux computer ===== |
- | Just open a terminal and [[#which_linux_servers_should_you_use|use ssh to connect to the appropriate server]] | + | If you have a Linux computer, but need to use a Windows application, |
+ | |||
+ | If you need to use a program that is missing on the Windows cluster, see the [[#getting_help_from_the_lsce_system_administrators|Help]] section. | ||
+ | |||
+ | ===== Accessing the LSCE Linux servers ===== | ||
+ | |||
+ | You have to [[other:ssh|use ssh]] to connect to the [[other: | ||
+ | |||
+ | If you are really in a hurry, go directly to the [[other: | ||
- | ==== Windows desktop ==== | ||
- | There should be an //Asterix// shortcut on the left side of your desktop. Double-click on it in order to open a window environment on one of the asterix servers. Each terminal you will open in this environment will run on the same asterix server. Use ssh to [[# | ||
===== Which Linux servers should you use? ===== | ===== Which Linux servers should you use? ===== | ||
- | There are lots of things you can do directly on your local Win7 or Linux desktop | + | ==== Working |
- | Otherwise, use the appropriate Linux servers. | + | Always remember that **your local LSCE desktop/ |
- | | + | There are **lots** of things you can do directly on your **local** computer |
- | * obelixN ('' | + | |
- | * [[https:// | + | ==== Available servers ==== |
+ | |||
+ | * **The LSCE interactive servers**: | ||
+ | * <wrap hi>Never forget that you are sharing these servers with other users!</ | ||
+ | * <wrap hi>Do not use too much CPU and/ | ||
+ | * Learn how to [[other: | ||
+ | * < | ||
+ | Last login: Mon Jun 3 08:49:53 2019 from somewhere | ||
+ | # You can use one of the following commands if you want to know on which obelix you are | ||
+ | $ echo $HOST | ||
+ | obelix5 | ||
+ | $ hostname | ||
+ | obelix5</ | ||
+ | |||
+ | * **[[https:// | ||
+ | |||
+ | * **The [[http:// | ||
+ | * [[http:// | ||
+ | * [[https:// | ||
+ | * [[https:// | ||
+ | |||
+ | * **The '' | ||
+ | |||
+ | ==== Which shell are you using? ==== | ||
+ | |||
+ | It is important to know which //shell// you are using if you need to configure and tune your Linux account. The shell is basically the program that waits for you to type commands in a terminal and passes them to the computer | ||
+ | |||
+ | If you are not sure which shell is running in your terminals, you can use '' | ||
+ | |||
+ | < | ||
+ | # Somewhere with tcsh | ||
+ | > echo $SHELL | ||
+ | / | ||
+ | |||
+ | # Somewhere else with bash | ||
+ | $ echo $SHELL | ||
+ | / | ||
+ | </ | ||
==== Determining the load of a Linux server ==== | ==== Determining the load of a Linux server ==== | ||
Line 91: | Line 231: | ||
If the Linux server you are working on seems slow, or if you want to get an idea of the resources **you** are using, you should use the '' | If the Linux server you are working on seems slow, or if you want to get an idea of the resources **you** are using, you should use the '' | ||
- | < | + | < |
+ | obelix3 | ||
+ | |||
+ | >top | ||
top - 17:48:51 up 8 days, 23:43, 29 users, | top - 17:48:51 up 8 days, 23:43, 29 users, | ||
Tasks: 324 total, | Tasks: 324 total, | ||
Line 99: | Line 242: | ||
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND | PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND | ||
- | 10193 mpeau 20 | + | 10193 john |
- | 16504 mpeau 20 | + | 16504 john |
- | 26344 dzhu | + | 26344 jane |
1 root 20 0 21448 1108 892 S 0.0 0.0 | 1 root 20 0 21448 1108 892 S 0.0 0.0 | ||
[...] | [...] | ||
Line 111: | Line 254: | ||
< | < | ||
- | 16092 jchang | + | 16092 bob 20 0 8488m 8.1g 7912 R 99.6 25.9 |
- | 23256 pvait 20 | + | 23256 john |
- | 26344 dzhu | + | 26344 jane |
- | 10619 astege | + | 10619 bob 20 |
1362 nslcd | 1362 nslcd | ||
- | 16238 twang | + | 10193 john |
- | 10193 mpeau 20 | + | |
[...]</ | [...]</ | ||
Line 129: | Line 271: | ||
===== Which disks should you use? ===== | ===== Which disks should you use? ===== | ||
- | < | + | < |
+ | * It is very important to use the correct directories and make it easy for your advisor to find things after you have left | ||
+ | * <wrap em>**Put the source codes, scripts and papers you are writing on a backed up disk**</ | ||
+ | * The <wrap em> | ||
+ | * Put **temporary files** on a scratch disk ('' | ||
+ | * Do **NOT** put (big) data files on a backed up disk | ||
+ | |||
+ | * | ||
+ | </ | ||
==== Accessing remote disks ==== | ==== Accessing remote disks ==== | ||
- | It is possible to access | + | It is possible to **directly** |
- | * Example path on the LSCE Linux server: ''/ | + | * a Linux or Windows computer connected directly to the LSCE ethernet/ |
- | * Accessing the same path from a local desktop: | + | * or a remote computer using the [[https:// |
- | * Linux desktop: ''/ | + | |
- | * Windows | + | For security reasons, only backed up disks and '' |
+ | |||
+ | e.g. if you have a ''/ | ||
+ | |||
+ | | ||
+ | * Windows | ||
==== The home directory ==== | ==== The home directory ==== | ||
* **Location**: | * **Location**: | ||
- | * On the LSCE servers (asterixN, | + | * On the LSCE servers (obelixN): ''/ |
+ | * Non LSCE servers: | ||
+ | * TGCC: ''/ | ||
+ | * ciclad: ''/ | ||
* On a local Linux desktop (lsceNNNN): ''/ | * On a local Linux desktop (lsceNNNN): ''/ | ||
- | * The configuration files of your Linux account are stored in this directory (use '' | + | * The configuration files of your Linux account are stored in the // |
* tcsh shell users: '' | * tcsh shell users: '' | ||
* bash shell users: '' | * bash shell users: '' | ||
* emacs text editor: '' | * emacs text editor: '' | ||
+ | * You can go to your home directory by typing '' | ||
+ | * At LSCE, you can't read the content of somebody else's //home// directory by default | ||
* **Backup of the home directory on the LSCE servers**: YES! Every night | * **Backup of the home directory on the LSCE servers**: YES! Every night | ||
- | * Put the most important sources/ | + | * More details on the [[https:// |
- | * Do not put temporary files, or big data files that are available somewhere else in this directory! | + | * <wrap em>Put the most important sources/ |
- | * Your home directory will also be archived when your account is closed | + | |
+ | * temporary files (use '' | ||
+ | * big (or many) data files (use '' | ||
+ | * Your home directory will be archived when your account is closed, so that you or your advisor can access it later, if required | ||
- | * **Quota**: YES!\\ There is a limit to what you can store in your home directory. If you reach this limit, you may experience some seemingly random errors (can't connect to the servers, the new files have a 0 size, ...)\\ < | + | |
+ | * Use the following command to access the backup: '' | ||
+ | |||
+ | | ||
> quota -s | > quota -s | ||
- | Disk quotas for user jypeter | + | Disk quotas for user johndoe |
| | ||
prolix3:/ | prolix3:/ | ||
==== The scratch directory ==== | ==== The scratch directory ==== | ||
+ | |||
+ | <note warning> | ||
* **Location**: | * **Location**: | ||
Line 168: | Line 336: | ||
* **Backup**: NO | * **Backup**: NO | ||
* Use this directory for temporary and big data files | * Use this directory for temporary and big data files | ||
- | * The files older than 6 months (and possibly older than 1 month) will be **automatically deleted** if there is not enough free space. See the [[https:// | + | * The files older than 6 months (and possibly older than 1 month) will be **automatically deleted** if there is not enough free space. See the [[https:// |
+ | * In other words, the files are guaranteed to stay 1 month and possibly longer | ||
* **Quota**: NO | * **Quota**: NO | ||
Line 174: | Line 343: | ||
==== Project specific directories ==== | ==== Project specific directories ==== | ||
+ | |||
+ | <note warning> | ||
+ | |||
+ | \\ You should <wrap em>store your source codes, scripts, notebooks, manuscripts, | ||
+ | |||
* **Location**: | * **Location**: | ||
* Ask your advisor if you should use a specific project directory and the technical details about it | * Ask your advisor if you should use a specific project directory and the technical details about it | ||
- | * Use this directory for storing the (big) data files that you can't store in the //home// directory, and should not store in the //scratch// directory | + | * Use this directory for storing the (big) data files that you can't store safely |
* **Backup**: ask your advisor | * **Backup**: ask your advisor | ||
* **Quota**: ask your advisor | * **Quota**: ask your advisor | ||
+ | |||
+ | ==== Determining the space used by directories ==== | ||
+ | |||
+ | Your Linux environment may sometimes stop working correctly because you have exceeded the allowed quota on your disks (check your quotas with '' | ||
+ | |||
+ | < | ||
+ | / | ||
+ | |||
+ | > | ||
+ | 58M | ||
+ | 47M | ||
+ | 44M | ||
+ | 15M | ||
+ | 12M | ||
+ | 3.2M cmake | ||
+ | ...</ | ||
+ | |||
+ | ===== Which programs should you use? ===== | ||
+ | |||
+ | Your advisor will let you know which (version of which) programs you should use. Some programs are available by default, and you have to use the '' | ||
+ | |||
+ | ==== Which program am I using? ==== | ||
+ | |||
+ | At any time, you can use the '' | ||
+ | |||
+ | < | ||
+ | / | ||
+ | |||
+ | > ncdump | ||
+ | ncdump [-c|-h] [-v ...] [[-b|-f] [c|f]] [-l len] [-n name] [-p n[,n]] [-k] [-x] [-s] [-t|-i] [-g ...] [-w] file | ||
+ | [...] | ||
+ | netcdf library version 4.3.3.1 of Dec 10 2015 16:44:18 $ | ||
+ | |||
+ | > which python | ||
+ | / | ||
+ | |||
+ | > python --version | ||
+ | Python 2.7.5 | ||
+ | </ | ||
+ | |||
+ | ==== Using module to access optional programs ==== | ||
+ | |||
+ | Main '' | ||
+ | * '' | ||
+ | * '' | ||
+ | * '' | ||
+ | * '' | ||
+ | * '' | ||
+ | * '' | ||
+ | |||
+ | Detailed example: | ||
+ | < | ||
+ | ncview: Command not found. | ||
+ | |||
+ | > module list | ||
+ | No Modulefiles Currently Loaded. | ||
+ | |||
+ | > module avail | ||
+ | [...] | ||
+ | batch_env | ||
+ | [...] | ||
+ | glost/ | ||
+ | |||
+ | > module load ncview netcdf/4 | ||
+ | |||
+ | > module list | ||
+ | Currently Loaded Modulefiles: | ||
+ | 1) ncview/ | ||
+ | | ||
+ | > which ncview | ||
+ | / | ||
+ | |||
+ | > which ncdump | ||
+ | / | ||
===== Useful documentation for beginners ===== | ===== Useful documentation for beginners ===== | ||
Line 191: | Line 439: | ||
- A tutorial | - A tutorial | ||
* Useful Linux commands for working with (potentially big) text files ({{: | * Useful Linux commands for working with (potentially big) text files ({{: | ||
- | * Using ssh on [[http:// | + | * Using [[other:ssh|ssh]] and [[other:ssh# |
- | * An annotated reference card of the emacs text editor ({{: | + | |
- | You can also check the [[http:// | + | ==== Text editors ==== |
+ | <note important> | ||
+ | |||
+ | There are **lots** of text editors used on Linux computers/ | ||
+ | * in basic text terminals (if you know the basic commands and shortcuts) | ||
+ | * or in graphic mode (you may need to have an [[other: | ||
+ | |||
+ | === emacs === | ||
+ | |||
+ | * An annotated reference card of the '' | ||
+ | * JYP's .emacs file: {{: | ||
+ | |||
+ | === vi (vim, gvim) === | ||
+ | |||
+ | * [[https:// | ||
+ | * [[https:// | ||
==== NetCDF and file formats ==== | ==== NetCDF and file formats ==== | ||
Line 201: | Line 463: | ||
* [[http:// | * [[http:// | ||
* [[http:// | * [[http:// | ||
+ | * The NetCDF file format is **self-documented**, | ||
+ | * The files in the [[https:// | ||
+ | * You can use [[other: | ||
* [[https:// | * [[https:// | ||
* [[http:// | * [[http:// | ||
Line 207: | Line 472: | ||
* Using the [[http:// | * Using the [[http:// | ||
* Using the [[http:// | * Using the [[http:// | ||
- | ===== Getting help from the LSCE system administrators ===== | ||
- | Send a mail to: [[help-lsce@lsce.ipsl.fr]] | + | ==== Programming languages ==== |
- | ===== Accessing the LSCE servers | + | * [[other: |
+ | |||
+ | ===== Getting help (from the LSCE system administrators) | ||
+ | |||
+ | Send a mail to // | ||
+ | |||
+ | ==== Describing your problem ==== | ||
+ | |||
+ | When you need help from the administrators or other people, it will save a lot of time if you describe your problem as accurately as possible (do **not** just report //XXXXX is not working as expected// !) | ||
+ | |||
+ | You can copy-paste the error message(s). Finding the error //log file(s)// of the program/ | ||
+ | |||
+ | < | ||
+ | OpenSSH_7.4p1, | ||
+ | debug1: Reading configuration data / | ||
+ | debug1: Reading configuration data / | ||
+ | debug1: / | ||
+ | debug1: Connecting to obelix [157.136.72.75] port 22. | ||
+ | debug1: Connection established. | ||
+ | debug1: key_load_public: | ||
+ | debug1: identity file / | ||
+ | [...] | ||
+ | debug1: Entering interactive session. | ||
+ | debug1: pledge: exec | ||
+ | debug1: client_input_global_request: | ||
+ | debug1: Requesting X11 forwarding with authentication spoofing. | ||
+ | debug1: Sending environment. | ||
+ | debug1: Sending env LANG = en_US | ||
+ | Last login: Thu Mar 1 15:52:44 2018 from lsce4078.lsce.ipsl.fr | ||
+ | |||
+ | > | ||
+ | </ | ||
- | The only way to access the LSCE servers from outside LSCE is to connect first to the **idefix1.extra.cea.fr** gateway server. Unless you are on a machine that is outside LSCE, but still on the CEA network (e.g. one of the machines of the CEA computing center) | + | ==== Taking |
- | - Send a mail to [[help-lsce@lsce.ipsl.fr]], | + | Sometimes, it may also help to send a picture |
- | - Use ssh to connect to idefix1 | + | |
- | * From a Linux/mac desktop: '' | + | |
- | * From a Windows desktop: | + | |
- | * Text only: use [[other: | + | |
- | * Text & graphics. This is more complex to set up, and you need to use one of the options below: | + | |
- | * use [[other: | + | |
- | * use [[other: | + | |
- | - There is only a limited number of programs that you can run on idefix1, so you have to go from idefix1 to asterix, obelix or curie with on of the //ssh// commands below: | + | |
- | * '' | + | |
- | * '' | + | |
- | * '' | + | |
- | - It's possible to use only one line to to both ssh commands | + | |
- | * asterix: '' | + | |
- | * obelix: '' | + | |
- | * TGCC: '' | + | |
- | - You can define an alias in order to connect more easily to the machines: | + | |
- | * //tcsh// users: add the following line to your '' | + | |
- | * //bash// users: FIXME | + | |
- | - You should create and configure an //ssh key//, if you don't want to type your password each time you use ssh or scp: https:// | + | |
- | - If you want more information about ssh | + | |
- | * Linux users: http:// | + | |
- | * Windows users: http:// | + | |
- | ==== Copying files to/from LSCE ==== | + | On Linux, you should find a screenshot application in the tools available on the system. See the example below for people using the //xfce// windows manager |
+ | {{ : | ||
- | If you are on a computer outside LSCE and you need to transfer | + | On Windows, |
+ | {{ : | ||
- | * Example from a Linux/mac desktop: '' | + | ===== Getting help, when using the IPSL Mesocenter ===== |
- | * From a Windows desktop: use [[other: | + | |
+ | Check the [[https:// | ||
===== What next? ===== | ===== What next? ===== | ||
other/newppl/starting.txt · Last modified: 2025/02/04 14:39 by jypeter