other:newppl:starting
Differences
This shows you the differences between two versions of the page.
Both sides previous revisionPrevious revisionNext revision | Previous revisionNext revisionBoth sides next revision | ||
other:newppl:starting [2019/07/12 11:56] – [Which disks should you use?] Improved the details about backedp up disks jypeter | other:newppl:starting [2022/08/23 15:07] – [Working directly on your desktop] Improved jypeter | ||
---|---|---|---|
Line 1: | Line 1: | ||
- | ====== Getting started | + | ====== Getting started |
- | <note tip> | + | <note tip> |
===== Miscellaneous information ===== | ===== Miscellaneous information ===== | ||
- | A few useful links that have nothing to do with science and software resources! | + | A few useful links. Some have nothing to do with science and LSCE hardware/software resources! |
+ | * [[# | ||
+ | |||
+ | * [[other: | ||
* [[other: | * [[other: | ||
* [[https:// | * [[https:// | ||
* [[http:// | * [[http:// | ||
- | * [[https:// | + | * [[https:// |
* [[https:// | * [[https:// | ||
* [[https:// | * [[https:// | ||
+ | * [[https:// | ||
+ | * {{: | ||
===== Phone directory, and map of the building ===== | ===== Phone directory, and map of the building ===== | ||
Line 60: | Line 65: | ||
Mails sent to these lists will reach lots of people. Think well **before** sending a mail to these lists! | Mails sent to these lists will reach lots of people. Think well **before** sending a mail to these lists! | ||
- | ==== The ' | + | ==== The teams mailing |
- | Ask your team leader | + | Ask your team leader to add you to your team's mailing list. Example below: the //CLIM// and //ESTIMR// lists |
^ List ^ Team ^ Archive | ^ List ^ Team ^ Archive | ||
Line 76: | Line 81: | ||
===== Using your own computer at LSCE? ===== | ===== Using your own computer at LSCE? ===== | ||
- | No need to try to connect your laptop to the LSCE wire network, it will not work! | + | <wrap em>You can' |
- | The best you can do is use the [[https:// | + | The best you can do is use the [[https:// |
- | **Warning!** You can't connect directly to the //obelix// LSCE servers from the wifi network. You first have to connect to '' | + | **Warning!** You **can't** connect directly to the //obelix// LSCE servers from the wifi network. You first have to connect to the '' |
===== Accessing the LSCE intranet ===== | ===== Accessing the LSCE intranet ===== | ||
- | Web site: https:// | + | <WRAP center round tip 60%> |
+ | If you try to access the intranet **from outside the LSCE** network (including // | ||
+ | |||
+ | Use your LSCE login (not your email address!) and password\\ e.g. use '' | ||
+ | </ | ||
+ | |||
+ | |||
+ | Intranet web site: https:// | ||
There is a lot of information available on the LSCE intranet, but you can only access it from a computer connected to the LSCE network | There is a lot of information available on the LSCE intranet, but you can only access it from a computer connected to the LSCE network | ||
Line 91: | Line 103: | ||
* Reading the mails with the [[https:// | * Reading the mails with the [[https:// | ||
- | * As soon as you have a LSCE e-mail address, make sure it is added to the //clim// or //estimr// **mailing | + | * As soon as you have a LSCE e-mail address, make sure it is added to [[# |
* [[https:// | * [[https:// | ||
Line 117: | Line 129: | ||
===== Setting up your desktop computer ===== | ===== Setting up your desktop computer ===== | ||
- | Everybody working for CLIM & ESTIMR gets a computer that can be connected to the LSCE network. Please take the time to read the instructions below, that may help make your life easier | + | You should receive |
==== Windows computer ==== | ==== Windows computer ==== | ||
- | Read the notes in [[other: | + | Read the [[other: |
+ | |||
+ | Note: there are also some [[other: | ||
=== Getting administrator' | === Getting administrator' | ||
Line 127: | Line 141: | ||
<note warning> | <note warning> | ||
- | If an application requests administrator' | + | If an application requests administrator' |
==== Linux computer ==== | ==== Linux computer ==== | ||
Line 147: | Line 161: | ||
==== Mac ==== | ==== Mac ==== | ||
- | Sorry, you are on your own, but it' | + | Sorry, you are (almost) |
+ | |||
+ | Some useful mac links: | ||
+ | * [[other: | ||
+ | * [[other: | ||
+ | * [[other: | ||
===== Accessing the Windows cluster from a Linux computer ===== | ===== Accessing the Windows cluster from a Linux computer ===== | ||
- | Follow | + | If you have a Linux computer, but need to use a Windows application, |
- | ===== Accessing | + | If you need to use a program that is missing on the Windows cluster, see the [[# |
- | ==== Linux or mac desktop | + | ===== Accessing the LSCE Linux servers ===== |
- | Just open a terminal and [[# | + | You have to [[other:ssh|use ssh]] to connect to the [[other: |
- | ==== Windows desktop ==== | + | If you are really in a hurry, go directly to the [[other: |
- | There should be an //Obelix// shortcut on the left side of your desktop. Double-click on it in order to open a window (e.g. with graphics) environment on one of the obelix servers. Each terminal you will open in this environment will run on the same obelix server. Use ssh to [[# | ||
- | If there is not yet an //Obelix// shortcut, use the [[other: | ||
- | |||
- | Note: you can also use [[other: | ||
===== Which Linux servers should you use? ===== | ===== Which Linux servers should you use? ===== | ||
- | There are lots of things you can do directly on your **local** Win7/Win10 or Linux desktop | + | ==== Working |
- | Otherwise, | + | Always remember that **your local LSCE desktop/ |
- | | + | There are **lots** of things you can do directly on your **local** computer (displaying pdf, images, using a text editor, ...), rather than on the remote servers. For example, if a script running on the servers generates a pdf file, it is **more efficient** to open this pdf file using '' |
- | * < | + | |
+ | ==== Available servers ==== | ||
+ | |||
+ | * **The LSCE interactive servers**: '' | ||
+ | * < | ||
Last login: Mon Jun 3 08:49:53 2019 from somewhere | Last login: Mon Jun 3 08:49:53 2019 from somewhere | ||
# You can use one of the following commands if you want to know on which obelix you are | # You can use one of the following commands if you want to know on which obelix you are | ||
- | >echo $HOST | + | $ echo $HOST |
obelix5 | obelix5 | ||
- | >hostname | + | $ hostname |
obelix5</ | obelix5</ | ||
- | | + | |
- | * in some cases, you may need an account to use the [[http:// | + | * **[[https:// |
- | * //asterixN//: some people | + | |
+ | * **The [[http:// | ||
+ | * [[http://mesocentre.ipsl.fr/account-opening/|Requesting a new account]] | ||
+ | * [[https:// | ||
+ | * [[https:// | ||
+ | |||
+ | * **The '' | ||
==== Which shell are you using? ==== | ==== Which shell are you using? ==== | ||
Line 205: | Line 230: | ||
If the Linux server you are working on seems slow, or if you want to get an idea of the resources **you** are using, you should use the '' | If the Linux server you are working on seems slow, or if you want to get an idea of the resources **you** are using, you should use the '' | ||
- | < | + | < |
+ | obelix3 | ||
+ | |||
+ | >top | ||
top - 17:48:51 up 8 days, 23:43, 29 users, | top - 17:48:51 up 8 days, 23:43, 29 users, | ||
Tasks: 324 total, | Tasks: 324 total, | ||
Line 213: | Line 241: | ||
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND | PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND | ||
- | 10193 mpeau 20 | + | 10193 john |
- | 16504 mpeau 20 | + | 16504 john |
- | 26344 dzhu | + | 26344 jane |
1 root 20 0 21448 1108 892 S 0.0 0.0 | 1 root 20 0 21448 1108 892 S 0.0 0.0 | ||
[...] | [...] | ||
Line 225: | Line 253: | ||
< | < | ||
- | 16092 jchang | + | 16092 bob 20 0 8488m 8.1g 7912 R 99.6 25.9 |
- | 23256 pvait 20 | + | 23256 john |
- | 26344 dzhu | + | 26344 jane |
- | 10619 astege | + | 10619 bob 20 |
1362 nslcd | 1362 nslcd | ||
- | 16238 twang | + | 10193 john |
- | 10193 mpeau 20 | + | |
[...]</ | [...]</ | ||
Line 246: | Line 273: | ||
* It is very important to use the correct directories and make it easy for your advisor to find things after you have left | * It is very important to use the correct directories and make it easy for your advisor to find things after you have left | ||
* <wrap em>**Put the source codes, scripts and papers you are writing on a backed up disk**</ | * <wrap em>**Put the source codes, scripts and papers you are writing on a backed up disk**</ | ||
- | * The <wrap em> | + | * The <wrap em> |
- | * Put temporary files on a scratch disk ('' | + | * Put **temporary files** on a scratch disk ('' |
- | * Do NOT put (big) data files on a backed up disk | + | * Do **NOT** put (big) data files on a backed up disk |
* Do not forget to clean your directories before you leave (ask your advisor what should be kept or cleaned) | * Do not forget to clean your directories before you leave (ask your advisor what should be kept or cleaned) | ||
Line 255: | Line 282: | ||
==== Accessing remote disks ==== | ==== Accessing remote disks ==== | ||
- | It is possible to access | + | It is possible to **directly** |
- | * Example path on the LSCE Linux server: ''/ | + | * a Linux or Windows computer connected directly to the LSCE ethernet/ |
- | * Accessing the same path from a local desktop: | + | * or a remote computer using the [[https:// |
- | * Linux desktop: ''/ | + | |
- | * Windows | + | For security reasons, only backed up disks and '' |
+ | |||
+ | e.g. if you have a ''/ | ||
+ | |||
+ | | ||
+ | * Windows | ||
==== The home directory ==== | ==== The home directory ==== | ||
Line 274: | Line 306: | ||
* bash shell users: '' | * bash shell users: '' | ||
* emacs text editor: '' | * emacs text editor: '' | ||
+ | * You can go to your home directory by typing '' | ||
+ | * At LSCE, you can't read the content of somebody else's //home// directory by default | ||
* **Backup of the home directory on the LSCE servers**: YES! Every night | * **Backup of the home directory on the LSCE servers**: YES! Every night | ||
- | * More details on the [[https:// | + | * More details on the [[https:// |
- | * Put the most important sources/ | + | * <wrap em>Put the most important sources/ |
- | * Do not put temporary files, or big data files that are available somewhere else in this directory! | + | |
- | * Your home directory will also be archived when your account is closed | + | * temporary files (use '' |
+ | * big (or many) data files (use '' | ||
+ | * Your home directory will be archived when your account is closed, so that you or your advisor can access it later, if required | ||
* **Backup of the TGCC home directory**: | * **Backup of the TGCC home directory**: | ||
Line 287: | Line 323: | ||
> quota -s | > quota -s | ||
- | Disk quotas for user jypeter | + | Disk quotas for user johndoe |
| | ||
prolix3:/ | prolix3:/ | ||
==== The scratch directory ==== | ==== The scratch directory ==== | ||
+ | |||
+ | <note warning> | ||
* **Location**: | * **Location**: | ||
Line 304: | Line 342: | ||
==== Project specific directories ==== | ==== Project specific directories ==== | ||
+ | |||
+ | <note warning> | ||
+ | |||
+ | \\ You should <wrap em>store your source codes, scripts, notebooks, manuscripts, | ||
+ | |||
* **Location**: | * **Location**: | ||
* Ask your advisor if you should use a specific project directory and the technical details about it | * Ask your advisor if you should use a specific project directory and the technical details about it | ||
- | * Use this directory for storing the (big) data files that you can't store safely in the //scratch// directory, and should not store in the //scratch// directory | + | * Use this directory for storing the (big) data files that you can't store safely in the //scratch// directory, and should not store in the //home// directory |
* **Backup**: ask your advisor | * **Backup**: ask your advisor | ||
Line 317: | Line 360: | ||
Your Linux environment may sometimes stop working correctly because you have exceeded the allowed quota on your disks (check your quotas with '' | Your Linux environment may sometimes stop working correctly because you have exceeded the allowed quota on your disks (check your quotas with '' | ||
- | < | + | < |
- | / | + | / |
- | jypeter@obelix4 - ...jypeter - 47 >du -sh * | sort -rh | + | >du -sh * | sort -rh |
58M | 58M | ||
47M | 47M | ||
Line 395: | Line 438: | ||
- A tutorial | - A tutorial | ||
* Useful Linux commands for working with (potentially big) text files ({{: | * Useful Linux commands for working with (potentially big) text files ({{: | ||
- | * Using ssh on [[http://ciclad-web.ipsl.jussieu.fr/data/documents/ssh-utilisateurs-unix.pdf|Linux]] and [[http://ciclad-web.ipsl.jussieu.fr/data/documents/ssh_putty_v2_2011-1.pdf|Windows]] | + | * Using [[other:ssh|ssh]] and [[other: |
- | * An annotated reference card of the emacs text editor ({{: | + | * Text editors: there are **lots** of text editors used on Linux computers/ |
- | * JYP's .emacs file: {{: | + | * '' |
- | + | * An annotated reference card of the '' | |
- | You can also check the [[http:// | + | * JYP's .emacs file: {{: |
==== NetCDF and file formats ==== | ==== NetCDF and file formats ==== | ||
Line 433: | Line 475: | ||
< | < | ||
OpenSSH_7.4p1, | OpenSSH_7.4p1, | ||
- | debug1: Reading configuration data / | + | debug1: Reading configuration data / |
debug1: Reading configuration data / | debug1: Reading configuration data / | ||
debug1: / | debug1: / | ||
Line 439: | Line 481: | ||
debug1: Connection established. | debug1: Connection established. | ||
debug1: key_load_public: | debug1: key_load_public: | ||
- | debug1: identity file / | + | debug1: identity file / |
[...] | [...] | ||
debug1: Entering interactive session. | debug1: Entering interactive session. | ||
Line 448: | Line 490: | ||
debug1: Sending env LANG = en_US | debug1: Sending env LANG = en_US | ||
Last login: Thu Mar 1 15:52:44 2018 from lsce4078.lsce.ipsl.fr | Last login: Thu Mar 1 15:52:44 2018 from lsce4078.lsce.ipsl.fr | ||
- | Disk quotas for user jypeter (uid 6369): | + | |
- | Filesystem | + | > |
- | | + | |
- | jypeter@obelix3 - ...jypeter - 41 > | + | |
</ | </ | ||
Line 464: | Line 504: | ||
{{ : | {{ : | ||
- | ===== Accessing the LSCE servers from outside the LSCE ===== | + | ===== Getting |
- | + | ||
- | The only way to access the LSCE servers from outside LSCE is to connect first to the **ssh1.lsce.ipsl.fr** gateway server. | + | |
- | + | ||
- | ==== Interactive access ==== | + | |
- | + | ||
- | - Send a mail to //help-lsce//, and request an access to the //ssh1// server | + | |
- | - Use '' | + | |
- | * From a Linux/mac desktop: '' | + | |
- | * From a Windows desktop: | + | |
- | * Text only: use [[other: | + | |
- | * Text & graphics. This is more complex to set up, and you need to use one of the options below: | + | |
- | * use [[other: | + | |
- | * use [[other: | + | |
- | * use [[other: | + | |
- | - You can access all LSCE disks from //ssh1//, but there is only a limited number of programs that you can run, so you have to go from //ssh1// to //obelix// or //curie// with one of the '' | + | |
- | * '' | + | |
- | * '' | + | |
- | - It's possible to use only one line to to both ssh commands | + | |
- | * obelix: '' | + | |
- | * TGCC: '' | + | |
- | - You can define an alias in order to connect more easily to the machines: | + | |
- | * //tcsh// users: add the following line to your '' | + | |
- | * //bash// users: add the following line to your '' | + | |
- | - You should create and configure an //ssh key//, if you don't want to type your password each time you use ssh or scp | + | |
- | - If you want more information about '' | + | |
- | * Linux users: http:// | + | |
- | * Windows users: http:// | + | |
- | + | ||
- | ==== Copying files to/from LSCE ==== | + | |
- | + | ||
- | If you need to **transfer** files to/from LSCE, use '' | + | |
- | + | ||
- | * Example from a Linux/mac desktop: '' | + | |
+ | Check the [[https:// | ||
===== What next? ===== | ===== What next? ===== | ||
other/newppl/starting.txt · Last modified: 2025/02/04 14:39 by jypeter