This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision Next revision Both sides next revision | ||
other:newppl:starting [2020/03/18 14:24] jypeter [Windows computer] Updated |
other:newppl:starting [2020/08/20 15:03] jypeter Replaced the connection section with a link to the new ssh page |
||
---|---|---|---|
Line 164: | Line 164: | ||
===== Accessing the Linux servers from your LSCE deskop ===== | ===== Accessing the Linux servers from your LSCE deskop ===== | ||
- | ==== Linux or mac desktop ==== | + | [[other:ssh|Use ssh to connect to the servers]] |
- | + | ||
- | Just open a terminal and [[#which_linux_servers_should_you_use|use ssh to connect to the appropriate server]] | + | |
==== Windows desktop ==== | ==== Windows desktop ==== | ||
Line 178: | Line 176: | ||
===== Which Linux servers should you use? ===== | ===== Which Linux servers should you use? ===== | ||
- | There are lots of things you can do directly on your **local** Win7/Win10 or Linux desktop (displaying pdf, images, using a text editor, ...), rather than on the remote servers. Never forget that **your local desktop has access to the remote disks on the Linux servers**. | + | ==== Working directly on your desktop ==== |
- | Otherwise, **use the appropriate Linux servers**. The //load balancing// system will send you to the server that has currently the smallest load | + | Always remember that **your local LSCE desktop can [[#accessing_remote_disks|access remote disks on the LSCE servers]]**. |
- | * **obelix**//NN// (type ''ssh obelix'' to get there): never forget that you are sharing these servers with other users! Do not use too much CPU and memory for a long time. Heavy computation should be done on the obelix cluster | + | There are lots of things you can do directly on your **local** Windows 10 or Linux desktop (displaying pdf, images, using a text editor, ...), rather than on the remote servers. For example, if a script running on the servers generates a pdf file, it is more efficient to open this pdf file using ''Acrobat''/''evince'' on your desktop, than by using ''evince'' on the server. |
- | * <code> $ ssh obelix | + | |
+ | ==== Available servers ==== | ||
+ | |||
+ | * **The LSCE interactive servers**: ''obelix//NN//''. Use ''ssh obelix'' to access these servers, and the //load balancing// system will send you to the server that has currently the smallest load.\\ Never forget that you are sharing these servers with other users! Do not use too much CPU and/or memory for a long time. Heavy computation should be done on the obelix cluster | ||
+ | * <code>$ ssh obelix | ||
Last login: Mon Jun 3 08:49:53 2019 from somewhere | Last login: Mon Jun 3 08:49:53 2019 from somewhere | ||
# You can use one of the following commands if you want to know on which obelix you are | # You can use one of the following commands if you want to know on which obelix you are | ||
- | >echo $HOST | + | $ echo $HOST |
obelix5 | obelix5 | ||
- | >hostname | + | $ hostname |
obelix5</code> | obelix5</code> | ||
- | * [[https://intranet.lsce.ipsl.fr/informatique/en/calcul/batch.php|the batch system]] (aka //obelix **cluster**//) for really heavy duty programs | + | |
- | * in some cases, you may need an account to use the [[http://mesocentre.ipsl.fr/|IPSL/ESPRI clusters]] (aka //ciclad// and //climserv//), especially if you need to use data that is already available/mirrored there, rather than copying the data to LSCE | + | * **[[https://intranet.lsce.ipsl.fr/informatique/en/calcul/batch.php|The LSCE cluster]]** (aka the //batch system//). Use this for really heavy duty programs |
- | * //asterixN//: some people may mention these servers, but they don't exist any more! | + | * **[[http://mesocentre.ipsl.fr/|The ciclad and climserv servers]]**. In some cases, you may need an account to use the [[http://mesocentre.ipsl.fr/|IPSL/ESPRI clusters]], especially if you need to use data files that are already available/mirrored there (e.g. **''CMIPn'' data**), rather than copying the data to LSCE |
+ | * [[http://mesocentre.ipsl.fr/account-opening/|Requesting a new account]] | ||
+ | * **The ''asterix//N//'' servers**: some wise LSCE elders may mention these servers, but they don't exist any more! | ||
==== Which shell are you using? ==== | ==== Which shell are you using? ==== | ||
Line 214: | Line 218: | ||
If the Linux server you are working on seems slow, or if you want to get an idea of the resources **you** are using, you should use the ''top'' command | If the Linux server you are working on seems slow, or if you want to get an idea of the resources **you** are using, you should use the ''top'' command | ||
- | <code>jypeter@obelix4 - ...jypeter - 46 >top | + | <code> >hostname |
+ | obelix3 | ||
+ | |||
+ | >top | ||
top - 17:48:51 up 8 days, 23:43, 29 users, load average: 1.22, 1.38, 1.98 | top - 17:48:51 up 8 days, 23:43, 29 users, load average: 1.22, 1.38, 1.98 | ||
Tasks: 324 total, 2 running, 320 sleeping, 2 stopped, 0 zombie | Tasks: 324 total, 2 running, 320 sleeping, 2 stopped, 0 zombie | ||
Line 222: | Line 229: | ||
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND | PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND | ||
- | 10193 mpeau 20 0 302m 4336 2272 R 100.0 0.0 7033:08 emacs | + | 10193 john 20 0 302m 4336 2272 R 100.0 0.0 7033:08 emacs |
- | 16504 mpeau 20 0 110m 2008 1228 S 0.7 0.0 0:00.13 tcsh | + | 16504 john 20 0 110m 2008 1228 S 0.7 0.0 0:00.13 tcsh |
- | 26344 dzhu 20 0 1635m 20m 3880 S 0.3 0.1 0:44.90 ipython | + | 26344 jane 20 0 1635m 20m 3880 S 0.3 0.1 0:44.90 ipython |
1 root 20 0 21448 1108 892 S 0.0 0.0 0:01.61 init | 1 root 20 0 21448 1108 892 S 0.0 0.0 0:01.61 init | ||
[...] | [...] | ||
Line 234: | Line 241: | ||
<code> PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND | <code> PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND | ||
- | 16092 jchang 20 0 8488m 8.1g 7912 R 99.6 25.9 1:41.38 idl | + | 16092 bob 20 0 8488m 8.1g 7912 R 99.6 25.9 1:41.38 idl |
- | 23256 pvait 20 0 232m 70m 2632 S 0.0 0.2 0:01.36 R | + | 23256 john 20 0 232m 70m 2632 S 0.0 0.2 0:01.36 R |
- | 26344 dzhu 20 0 1635m 20m 3880 S 0.0 0.1 0:44.87 ipython | + | 26344 jane 20 0 1635m 20m 3880 S 0.0 0.1 0:44.87 ipython |
- | 10619 astege 20 0 954m 9292 2664 S 0.0 0.0 0:40.67 gedit | + | 10619 bob 20 0 954m 9292 2664 S 0.0 0.0 0:40.67 gedit |
1362 nslcd 20 0 442m 6056 2208 S 0.0 0.0 2:13.98 nslcd | 1362 nslcd 20 0 442m 6056 2208 S 0.0 0.0 2:13.98 nslcd | ||
- | 16238 twang 20 0 128m 5068 2076 S 0.0 0.0 0:00.05 gconfd-2 | + | 10193 john 20 0 302m 4336 2272 R 99.9 0.0 7024:13 emacs |
- | 10193 mpeau 20 0 302m 4336 2272 R 99.9 0.0 7024:13 emacs | + | |
[...]</code> | [...]</code> | ||
Line 255: | Line 261: | ||
* It is very important to use the correct directories and make it easy for your advisor to find things after you have left | * It is very important to use the correct directories and make it easy for your advisor to find things after you have left | ||
* <wrap em>**Put the source codes, scripts and papers you are writing on a backed up disk**</wrap> | * <wrap em>**Put the source codes, scripts and papers you are writing on a backed up disk**</wrap> | ||
- | * The <wrap em>backed up disk at LSCE</wrap> is [[#the_home_directory|/home/users/your_login]]. You should have a few Gb available on //home// (use the ''quota -s'' command to find out the exact amount) | + | * The <wrap em>backed up disk at LSCE</wrap> is [[#the_home_directory|home directory]]\\ You should have a few Gb available on //home//\\ Use the ''quota -s'' command to find out the exact amount |
* Put **temporary files** on a scratch disk (''scratch01'' at LSCE) | * Put **temporary files** on a scratch disk (''scratch01'' at LSCE) | ||
* Do **NOT** put (big) data files on a backed up disk | * Do **NOT** put (big) data files on a backed up disk | ||
Line 264: | Line 270: | ||
==== Accessing remote disks ==== | ==== Accessing remote disks ==== | ||
- | It is possible to access directly all the disks on the LSCE servers from your local Linux or Windows desktop | + | It is possible to access directly all the disks on the LSCE servers from your //local// Linux or Windows computer\\ (//local// = a computer on the LSCE ethernet/wired network) |
* Example path on the LSCE Linux server: ''/home/scratch01/your_lsce_login'' | * Example path on the LSCE Linux server: ''/home/scratch01/your_lsce_login'' | ||
- | * Accessing the path above from a local desktop: | + | * Accessing the path above from a //local// computer: |
- | * Linux desktop: ''/home/scratch01/your_lsce_login'' | + | * Linux computer: ''/home/scratch01/your_lsce_login'' |
- | * Windows desktop: ''\\dfshost\dfs\scratch01\your_lsce_login''\\ {{ :other:newppl:dfs_on_win.png?nolink |}} | + | * Windows computer: ''\\dfshost\dfs\scratch01\your_lsce_login''\\ {{ :other:newppl:dfs_on_win.png?nolink |}} |
==== The home directory ==== | ==== The home directory ==== | ||
Line 283: | Line 289: | ||
* bash shell users: ''.profile'' and ''.bashrc'' | * bash shell users: ''.profile'' and ''.bashrc'' | ||
* emacs text editor: ''.emacs'' | * emacs text editor: ''.emacs'' | ||
- | * You can go to your home directory by typing ''cd'' (no arguments), and to the home directory of somebody else with ''cd ~login_name'' | + | * You can go to your home directory by typing ''cd'' (no arguments),\\ and to the home directory of somebody else with ''cd ~login_name'' |
- | * At LSCE, you can't read the content of somebody else's //home// directory | + | * At LSCE, you can't read the content of somebody else's //home// directory by default |
* **Backup of the home directory on the LSCE servers**: YES! Every night | * **Backup of the home directory on the LSCE servers**: YES! Every night | ||
Line 300: | Line 306: | ||
> quota -s | > quota -s | ||
- | Disk quotas for user jypeter (uid 6369): | + | Disk quotas for user johndoe (uid 6369): |
Filesystem blocks quota limit grace files quota limit grace | Filesystem blocks quota limit grace files quota limit grace | ||
prolix3:/users/ 4658M 4883M 4981M 23503 0 0</code> | prolix3:/users/ 4658M 4883M 4981M 23503 0 0</code> | ||
Line 337: | Line 343: | ||
Your Linux environment may sometimes stop working correctly because you have exceeded the allowed quota on your disks (check your quotas with ''quota -s''). You can use the following command to get the size of all the directories and files in the current directory, sorted by size: ''du -sh * | sort -rh'' | Your Linux environment may sometimes stop working correctly because you have exceeded the allowed quota on your disks (check your quotas with ''quota -s''). You can use the following command to get the size of all the directories and files in the current directory, sorted by size: ''du -sh * | sort -rh'' | ||
- | <code>jypeter@obelix4 - ...jypeter - 46 >cd /home/scratch01/jypeter | + | <code> >cd /home/scratch01/johndoe |
- | /home/scratch01/jypeter | + | /home/scratch01/johndoe |
- | jypeter@obelix4 - ...jypeter - 47 >du -sh * | sort -rh | + | >du -sh * | sort -rh |
58M GLAC1DHiceF26.nc | 58M GLAC1DHiceF26.nc | ||
47M dashboard | 47M dashboard | ||
Line 453: | Line 459: | ||
<code> >ssh -v obelix | <code> >ssh -v obelix | ||
OpenSSH_7.4p1, OpenSSL 1.0.2k-fips 26 Jan 2017 | OpenSSH_7.4p1, OpenSSL 1.0.2k-fips 26 Jan 2017 | ||
- | debug1: Reading configuration data /home/users/jypeter/.ssh/config | + | debug1: Reading configuration data /home/users/johndoe/.ssh/config |
debug1: Reading configuration data /etc/ssh/ssh_config | debug1: Reading configuration data /etc/ssh/ssh_config | ||
debug1: /etc/ssh/ssh_config line 58: Applying options for * | debug1: /etc/ssh/ssh_config line 58: Applying options for * | ||
Line 459: | Line 465: | ||
debug1: Connection established. | debug1: Connection established. | ||
debug1: key_load_public: No such file or directory | debug1: key_load_public: No such file or directory | ||
- | debug1: identity file /home/users/jypeter/.ssh/id_rsa type -1 | + | debug1: identity file /home/users/johndoe/.ssh/id_rsa type -1 |
[...] | [...] | ||
debug1: Entering interactive session. | debug1: Entering interactive session. | ||
Line 468: | Line 474: | ||
debug1: Sending env LANG = en_US | debug1: Sending env LANG = en_US | ||
Last login: Thu Mar 1 15:52:44 2018 from lsce4078.lsce.ipsl.fr | Last login: Thu Mar 1 15:52:44 2018 from lsce4078.lsce.ipsl.fr | ||
- | Disk quotas for user jypeter (uid 6369): | + | |
- | Filesystem space quota limit grace files quota limit grace | + | > |
- | prolix3:/users 4558M 9766M 10743M 23741 0 0 | + | |
- | jypeter@obelix3 - ...jypeter - 41 > | + | |
</code> | </code> | ||