other:newppl:starting
Differences
This shows you the differences between two versions of the page.
| Both sides previous revision Previous revision Next revision | Previous revision Next revision Both sides next revision | ||
|
other:newppl:starting [2020/05/15 14:02] jypeter [Which Linux servers should you use?] Improved |
other:newppl:starting [2020/07/23 13:16] jypeter removed references to jyp account (and others) |
||
|---|---|---|---|
| Line 197: | Line 197: | ||
| * **[[https://intranet.lsce.ipsl.fr/informatique/en/calcul/batch.php|The LSCE cluster]]** (aka the //batch system//). Use this for really heavy duty programs | * **[[https://intranet.lsce.ipsl.fr/informatique/en/calcul/batch.php|The LSCE cluster]]** (aka the //batch system//). Use this for really heavy duty programs | ||
| * **[[http://mesocentre.ipsl.fr/|The ciclad and climserv servers]]**. In some cases, you may need an account to use the [[http://mesocentre.ipsl.fr/|IPSL/ESPRI clusters]], especially if you need to use data files that are already available/mirrored there (e.g. **''CMIPn'' data**), rather than copying the data to LSCE | * **[[http://mesocentre.ipsl.fr/|The ciclad and climserv servers]]**. In some cases, you may need an account to use the [[http://mesocentre.ipsl.fr/|IPSL/ESPRI clusters]], especially if you need to use data files that are already available/mirrored there (e.g. **''CMIPn'' data**), rather than copying the data to LSCE | ||
| + | * [[http://mesocentre.ipsl.fr/account-opening/|Requesting a new account]] | ||
| * **The ''asterix//N//'' servers**: some wise LSCE elders may mention these servers, but they don't exist any more! | * **The ''asterix//N//'' servers**: some wise LSCE elders may mention these servers, but they don't exist any more! | ||
| Line 219: | Line 220: | ||
| If the Linux server you are working on seems slow, or if you want to get an idea of the resources **you** are using, you should use the ''top'' command | If the Linux server you are working on seems slow, or if you want to get an idea of the resources **you** are using, you should use the ''top'' command | ||
| - | <code>jypeter@obelix4 - ...jypeter - 46 >top | + | <code> >hostname |
| + | obelix3 | ||
| + | |||
| + | >top | ||
| top - 17:48:51 up 8 days, 23:43, 29 users, load average: 1.22, 1.38, 1.98 | top - 17:48:51 up 8 days, 23:43, 29 users, load average: 1.22, 1.38, 1.98 | ||
| Tasks: 324 total, 2 running, 320 sleeping, 2 stopped, 0 zombie | Tasks: 324 total, 2 running, 320 sleeping, 2 stopped, 0 zombie | ||
| Line 227: | Line 231: | ||
| PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND | PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND | ||
| - | 10193 mpeau 20 0 302m 4336 2272 R 100.0 0.0 7033:08 emacs | + | 10193 john 20 0 302m 4336 2272 R 100.0 0.0 7033:08 emacs |
| - | 16504 mpeau 20 0 110m 2008 1228 S 0.7 0.0 0:00.13 tcsh | + | 16504 john 20 0 110m 2008 1228 S 0.7 0.0 0:00.13 tcsh |
| - | 26344 dzhu 20 0 1635m 20m 3880 S 0.3 0.1 0:44.90 ipython | + | 26344 jane 20 0 1635m 20m 3880 S 0.3 0.1 0:44.90 ipython |
| 1 root 20 0 21448 1108 892 S 0.0 0.0 0:01.61 init | 1 root 20 0 21448 1108 892 S 0.0 0.0 0:01.61 init | ||
| [...] | [...] | ||
| Line 239: | Line 243: | ||
| <code> PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND | <code> PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND | ||
| - | 16092 jchang 20 0 8488m 8.1g 7912 R 99.6 25.9 1:41.38 idl | + | 16092 bob 20 0 8488m 8.1g 7912 R 99.6 25.9 1:41.38 idl |
| - | 23256 pvait 20 0 232m 70m 2632 S 0.0 0.2 0:01.36 R | + | 23256 john 20 0 232m 70m 2632 S 0.0 0.2 0:01.36 R |
| - | 26344 dzhu 20 0 1635m 20m 3880 S 0.0 0.1 0:44.87 ipython | + | 26344 jane 20 0 1635m 20m 3880 S 0.0 0.1 0:44.87 ipython |
| - | 10619 astege 20 0 954m 9292 2664 S 0.0 0.0 0:40.67 gedit | + | 10619 bob 20 0 954m 9292 2664 S 0.0 0.0 0:40.67 gedit |
| 1362 nslcd 20 0 442m 6056 2208 S 0.0 0.0 2:13.98 nslcd | 1362 nslcd 20 0 442m 6056 2208 S 0.0 0.0 2:13.98 nslcd | ||
| - | 16238 twang 20 0 128m 5068 2076 S 0.0 0.0 0:00.05 gconfd-2 | + | 10193 john 20 0 302m 4336 2272 R 99.9 0.0 7024:13 emacs |
| - | 10193 mpeau 20 0 302m 4336 2272 R 99.9 0.0 7024:13 emacs | + | |
| [...]</code> | [...]</code> | ||
| Line 260: | Line 263: | ||
| * It is very important to use the correct directories and make it easy for your advisor to find things after you have left | * It is very important to use the correct directories and make it easy for your advisor to find things after you have left | ||
| * <wrap em>**Put the source codes, scripts and papers you are writing on a backed up disk**</wrap> | * <wrap em>**Put the source codes, scripts and papers you are writing on a backed up disk**</wrap> | ||
| - | * The <wrap em>backed up disk at LSCE</wrap> is [[#the_home_directory|/home/users/your_login]]. You should have a few Gb available on //home// (use the ''quota -s'' command to find out the exact amount) | + | * The <wrap em>backed up disk at LSCE</wrap> is [[#the_home_directory|home directory]]\\ You should have a few Gb available on //home//\\ Use the ''quota -s'' command to find out the exact amount |
| * Put **temporary files** on a scratch disk (''scratch01'' at LSCE) | * Put **temporary files** on a scratch disk (''scratch01'' at LSCE) | ||
| * Do **NOT** put (big) data files on a backed up disk | * Do **NOT** put (big) data files on a backed up disk | ||
| Line 269: | Line 272: | ||
| ==== Accessing remote disks ==== | ==== Accessing remote disks ==== | ||
| - | It is possible to access directly all the disks on the LSCE servers from your local Linux or Windows desktop | + | It is possible to access directly all the disks on the LSCE servers from your //local// Linux or Windows computer\\ (//local// = a computer on the LSCE ethernet/wired network) |
| * Example path on the LSCE Linux server: ''/home/scratch01/your_lsce_login'' | * Example path on the LSCE Linux server: ''/home/scratch01/your_lsce_login'' | ||
| - | * Accessing the path above from a local desktop: | + | * Accessing the path above from a //local// computer: |
| - | * Linux desktop: ''/home/scratch01/your_lsce_login'' | + | * Linux computer: ''/home/scratch01/your_lsce_login'' |
| - | * Windows desktop: ''\\dfshost\dfs\scratch01\your_lsce_login''\\ {{ :other:newppl:dfs_on_win.png?nolink |}} | + | * Windows computer: ''\\dfshost\dfs\scratch01\your_lsce_login''\\ {{ :other:newppl:dfs_on_win.png?nolink |}} |
| ==== The home directory ==== | ==== The home directory ==== | ||
| Line 288: | Line 291: | ||
| * bash shell users: ''.profile'' and ''.bashrc'' | * bash shell users: ''.profile'' and ''.bashrc'' | ||
| * emacs text editor: ''.emacs'' | * emacs text editor: ''.emacs'' | ||
| - | * You can go to your home directory by typing ''cd'' (no arguments), and to the home directory of somebody else with ''cd ~login_name'' | + | * You can go to your home directory by typing ''cd'' (no arguments),\\ and to the home directory of somebody else with ''cd ~login_name'' |
| - | * At LSCE, you can't read the content of somebody else's //home// directory | + | * At LSCE, you can't read the content of somebody else's //home// directory by default |
| * **Backup of the home directory on the LSCE servers**: YES! Every night | * **Backup of the home directory on the LSCE servers**: YES! Every night | ||
| Line 305: | Line 308: | ||
| > quota -s | > quota -s | ||
| - | Disk quotas for user jypeter (uid 6369): | + | Disk quotas for user johndoe (uid 6369): |
| Filesystem blocks quota limit grace files quota limit grace | Filesystem blocks quota limit grace files quota limit grace | ||
| prolix3:/users/ 4658M 4883M 4981M 23503 0 0</code> | prolix3:/users/ 4658M 4883M 4981M 23503 0 0</code> | ||
| Line 342: | Line 345: | ||
| Your Linux environment may sometimes stop working correctly because you have exceeded the allowed quota on your disks (check your quotas with ''quota -s''). You can use the following command to get the size of all the directories and files in the current directory, sorted by size: ''du -sh * | sort -rh'' | Your Linux environment may sometimes stop working correctly because you have exceeded the allowed quota on your disks (check your quotas with ''quota -s''). You can use the following command to get the size of all the directories and files in the current directory, sorted by size: ''du -sh * | sort -rh'' | ||
| - | <code>jypeter@obelix4 - ...jypeter - 46 >cd /home/scratch01/jypeter | + | <code> >cd /home/scratch01/johndoe |
| - | /home/scratch01/jypeter | + | /home/scratch01/johndoe |
| - | jypeter@obelix4 - ...jypeter - 47 >du -sh * | sort -rh | + | >du -sh * | sort -rh |
| 58M GLAC1DHiceF26.nc | 58M GLAC1DHiceF26.nc | ||
| 47M dashboard | 47M dashboard | ||
| Line 458: | Line 461: | ||
| <code> >ssh -v obelix | <code> >ssh -v obelix | ||
| OpenSSH_7.4p1, OpenSSL 1.0.2k-fips 26 Jan 2017 | OpenSSH_7.4p1, OpenSSL 1.0.2k-fips 26 Jan 2017 | ||
| - | debug1: Reading configuration data /home/users/jypeter/.ssh/config | + | debug1: Reading configuration data /home/users/johndoe/.ssh/config |
| debug1: Reading configuration data /etc/ssh/ssh_config | debug1: Reading configuration data /etc/ssh/ssh_config | ||
| debug1: /etc/ssh/ssh_config line 58: Applying options for * | debug1: /etc/ssh/ssh_config line 58: Applying options for * | ||
| Line 464: | Line 467: | ||
| debug1: Connection established. | debug1: Connection established. | ||
| debug1: key_load_public: No such file or directory | debug1: key_load_public: No such file or directory | ||
| - | debug1: identity file /home/users/jypeter/.ssh/id_rsa type -1 | + | debug1: identity file /home/users/johndoe/.ssh/id_rsa type -1 |
| [...] | [...] | ||
| debug1: Entering interactive session. | debug1: Entering interactive session. | ||
| Line 473: | Line 476: | ||
| debug1: Sending env LANG = en_US | debug1: Sending env LANG = en_US | ||
| Last login: Thu Mar 1 15:52:44 2018 from lsce4078.lsce.ipsl.fr | Last login: Thu Mar 1 15:52:44 2018 from lsce4078.lsce.ipsl.fr | ||
| - | Disk quotas for user jypeter (uid 6369): | + | |
| - | Filesystem space quota limit grace files quota limit grace | + | > |
| - | prolix3:/users 4558M 9766M 10743M 23741 0 0 | + | |
| - | jypeter@obelix3 - ...jypeter - 41 > | + | |
| </code> | </code> | ||
other/newppl/starting.txt · Last modified: 2024/04/24 12:37 by jypeter
