This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision Next revision Both sides next revision | ||
other:newppl:starting [2018/03/13 15:01] jypeter Lots of updates |
other:newppl:starting [2018/03/13 16:23] jypeter Finished removing the references to idefix1 and asterix |
||
---|---|---|---|
Line 120: | Line 120: | ||
There should be an //Obelix// shortcut on the left side of your desktop. Double-click on it in order to open a window (e.g. with graphics) environment on one of the obelix servers. Each terminal you will open in this environment will run on the same obelix server. Use ssh to [[#which_linux_servers_should_you_use|connect another server]] | There should be an //Obelix// shortcut on the left side of your desktop. Double-click on it in order to open a window (e.g. with graphics) environment on one of the obelix servers. Each terminal you will open in this environment will run on the same obelix server. Use ssh to [[#which_linux_servers_should_you_use|connect another server]] | ||
+ | |||
+ | If there is not yet an //Obelix// shortcut, use the [[other:win7apps#setup|VcXsrv XLaunch]] program to create it | ||
Note: you can also use [[other:win7apps#putty|Putty]] if you just need text windows, or [[other:win7apps#vcxsrv_windows_x_server|VcXsrv]] or [[other:win7apps#putty|Putty]]+[[other:win7apps#cygwin-x|Cygwin-X]] if you also need graphics | Note: you can also use [[other:win7apps#putty|Putty]] if you just need text windows, or [[other:win7apps#vcxsrv_windows_x_server|VcXsrv]] or [[other:win7apps#putty|Putty]]+[[other:win7apps#cygwin-x|Cygwin-X]] if you also need graphics | ||
Line 125: | Line 127: | ||
===== Which Linux servers should you use? ===== | ===== Which Linux servers should you use? ===== | ||
- | There are lots of things you can do directly on your local Win7 or Linux desktop (displaying pdf, images, using a text editor, ...), rather than directly on the servers. Never forget that **your local desktop has access to the remote disks on the Linux servers**. | + | There are lots of things you can do directly on your **local** Win7 or Linux desktop (displaying pdf, images, using a text editor, ...), rather than on the remote servers. Never forget that **your local desktop has access to the remote disks on the Linux servers**. |
- | Otherwise, use the appropriate Linux servers. The //load balancing// system will send you to the server that has currently the smallest load | + | Otherwise, **use the appropriate Linux servers**. The //load balancing// system will send you to the server that has currently the smallest load |
- | * obelixN (''ssh obelix'', or ''ssh obelix.lscelb''): never forget that you are sharing these servers with other users! Do not use too much CPU and memory for a long time. Heavy computation should be done on the cluster | + | * obelixN (''ssh obelix'', or ''ssh obelix.lb''): never forget that you are sharing these servers with other users! Do not use too much CPU and memory for a long time. Heavy computation should be done on the obelix cluster |
- | * [[https://intranet.lsce.ipsl.fr/informatique/en/orme/calcul/batch.php|the batch system]] (aka //obelix cluster//) for really heavy duty programs | + | * [[https://intranet.lsce.ipsl.fr/informatique/en/calcul/batch.php|the batch system]] (aka //obelix cluster//) for really heavy duty programs |
* in some cases, you may need an account to use the [[http://mesocentre.ipsl.fr/|IPSL/ESPRI clusters]] (aka //ciclad// and //climserv//), especially if you need to use data that is already available/mirrored there, rather than copying the data to LSCE | * in some cases, you may need an account to use the [[http://mesocentre.ipsl.fr/|IPSL/ESPRI clusters]] (aka //ciclad// and //climserv//), especially if you need to use data that is already available/mirrored there, rather than copying the data to LSCE | ||
- | * asterixN (''ssh asterix'', or ''ssh asterix.lscelb''): some people may mention these servers, but they don't exist any more | + | * asterixN: some people may mention these servers, but they don't exist any more! |
==== Which shell are you using? ==== | ==== Which shell are you using? ==== | ||
Line 224: | Line 226: | ||
* **Backup of the home directory on the LSCE servers**: YES! Every night | * **Backup of the home directory on the LSCE servers**: YES! Every night | ||
- | * More details on the [[https://intranet.lsce.ipsl.fr/informatique/en/orme/nsr/index.php|backup system]] page | + | * More details on the [[https://intranet.lsce.ipsl.fr/informatique/en/nsr/index.php|backup system]] page |
* Put the most important sources/scripts/data/papers in this directory | * Put the most important sources/scripts/data/papers in this directory | ||
* Do not put temporary files, or big data files that are available somewhere else in this directory! | * Do not put temporary files, or big data files that are available somewhere else in this directory! | ||
Line 245: | Line 247: | ||
* **Backup**: NO | * **Backup**: NO | ||
* Use this directory for temporary and big data files | * Use this directory for temporary and big data files | ||
- | * The files older than 6 months (and possibly older than 1 month) will be **automatically deleted** if there is not enough free space. See the [[https://intranet.lsce.ipsl.fr/informatique/en/orme/disques.php|Scratch area]] section for more details | + | * The files older than 6 months (and possibly older than 1 month) will be **automatically deleted** if there is not enough free space. See the [[https://intranet.lsce.ipsl.fr/informatique/en/disques.php|Scratch area]] section for more details on the retention policy |
+ | * In other words, the files are guaranteed to stay 1 month and possibly longer | ||
* **Quota**: NO | * **Quota**: NO | ||
Line 254: | Line 257: | ||
* **Location**: ''/home/some_project_name/your_lsce_login'' | * **Location**: ''/home/some_project_name/your_lsce_login'' | ||
* Ask your advisor if you should use a specific project directory and the technical details about it | * Ask your advisor if you should use a specific project directory and the technical details about it | ||
- | * Use this directory for storing the (big) data files that you can't store in the //home// directory, and should not store in the //scratch// directory | + | * Use this directory for storing the (big) data files that you can't store safely in the //scratch// directory, and should not store in the //scratch// directory |
* **Backup**: ask your advisor | * **Backup**: ask your advisor | ||
Line 263: | Line 266: | ||
Your Linux environment may sometimes stop working correctly because you have exceeded the allowed quota on your disks (check your quotas with ''quota -s''). You can use the following command to get the size of all the directories and files in the current directory, sorted by size: ''du -sh * | sort -rh'' | Your Linux environment may sometimes stop working correctly because you have exceeded the allowed quota on your disks (check your quotas with ''quota -s''). You can use the following command to get the size of all the directories and files in the current directory, sorted by size: ''du -sh * | sort -rh'' | ||
+ | |||
+ | <code>jypeter@obelix4 - ...jypeter - 46 >cd /home/scratch01/jypeter | ||
+ | /home/scratch01/jypeter | ||
+ | |||
+ | jypeter@obelix4 - ...jypeter - 47 >du -sh * | sort -rh | ||
+ | 58M GLAC1DHiceF26.nc | ||
+ | 47M dashboard | ||
+ | 44M GLAC1DdrainagePointerF26ka.nc | ||
+ | 15M octcdf | ||
+ | 12M 1901.nc | ||
+ | 3.2M cmake | ||
+ | ...</code> | ||
===== Useful documentation for beginners ===== | ===== Useful documentation for beginners ===== | ||
Line 306: | Line 321: | ||
When you need help from the administrators or other people, it will save a lot of time if you describe your problem as accurately as possible (do **not** just report //XXXXX is not working as expected// !) | When you need help from the administrators or other people, it will save a lot of time if you describe your problem as accurately as possible (do **not** just report //XXXXX is not working as expected// !) | ||
- | You can copy-paste the error message(s). Finding the error //log file(s)// of the program/system (when available), or using the //verbose mode// of a program will make the problem resolution much easier and faster. The example below shows how to use the verbose mode of //ssh// | + | You can copy-paste the error message(s). Finding the error //log file(s)// of the program/system (when available), or using the //verbose mode// of a program will make the problem resolution much easier and faster. The example below shows how to use the verbose mode of ''ssh'' |
- | <code>> ssh -v asterix | + | <code> >ssh -v obelix |
- | OpenSSH_6.4, OpenSSL 1.0.1e-fips 11 Feb 2013 | + | OpenSSH_7.4p1, OpenSSL 1.0.2k-fips 26 Jan 2017 |
- | debug1: Reading configuration data /homel/jypisthebest/.ssh/config | + | debug1: Reading configuration data /home/users/jypeter/.ssh/config |
debug1: Reading configuration data /etc/ssh/ssh_config | debug1: Reading configuration data /etc/ssh/ssh_config | ||
- | debug1: /etc/ssh/ssh_config line 20: Applying options for * | + | debug1: /etc/ssh/ssh_config line 58: Applying options for * |
- | debug1: Connecting to asterix [132.166.72.26] port 22. | + | debug1: Connecting to obelix [157.136.72.75] port 22. |
debug1: Connection established. | debug1: Connection established. | ||
- | debug1: identity file /homel/jypisthebest/.ssh/id_rsa type -1 | + | debug1: key_load_public: No such file or directory |
- | debug1: identity file /homel/jypisthebest/.ssh/id_rsa-cert type -1 | + | debug1: identity file /home/users/jypeter/.ssh/id_rsa type -1 |
- | debug1: identity file /homel/jypisthebest/.ssh/id_dsa type 2 | + | |
[...] | [...] | ||
debug1: Entering interactive session. | debug1: Entering interactive session. | ||
+ | debug1: pledge: exec | ||
+ | debug1: client_input_global_request: rtype hostkeys-00@openssh.com want_reply 0 | ||
debug1: Requesting X11 forwarding with authentication spoofing. | debug1: Requesting X11 forwarding with authentication spoofing. | ||
- | debug1: Requesting authentication agent forwarding. | ||
debug1: Sending environment. | debug1: Sending environment. | ||
debug1: Sending env LANG = en_US | debug1: Sending env LANG = en_US | ||
- | Last login: Tue Mar 22 15:25:36 2016 from lsce3046.extra.cea.fr | + | Last login: Thu Mar 1 15:52:44 2018 from lsce4078.lsce.ipsl.fr |
- | Disk quotas for user jypisthebest (uid 6369): | + | Disk quotas for user jypeter (uid 6369): |
- | Filesystem blocks quota limit grace files quota limit grace | + | Filesystem space quota limit grace files quota limit grace |
- | prolix3:/users/ 4726M 4883M 4981M 23586 0 0 | + | prolix3:/users 4558M 9766M 10743M 23741 0 0 |
- | jypisthebest@asterix3 ></code> | + | jypeter@obelix3 - ...jypeter - 41 > |
+ | </code> | ||
==== Taking a screenshot ==== | ==== Taking a screenshot ==== | ||
Line 342: | Line 358: | ||
===== Accessing the LSCE servers from outside the LSCE ===== | ===== Accessing the LSCE servers from outside the LSCE ===== | ||
- | The only way to access the LSCE servers from outside LSCE is to connect first to the **idefix1.extra.cea.fr** gateway server. Unless you are on a machine that is outside LSCE, but still on the CEA network (e.g. one of the machines of the CEA computing center) | + | The only way to access the LSCE servers from outside LSCE is to connect first to the **ssh1.lsce.ipsl.fr** gateway server. |
+ | |||
+ | ==== Interactive access ==== | ||
- | - Send a mail to [[help-lsce@lsce.ipsl.fr]], and request an access to the idefix1 server | + | - Send a mail to [[help-lsce@lsce.ipsl.fr]], and request an access to the //ssh1// server |
- | - Use ssh to connect to idefix1 | + | - Use ''ssh'' to **connect** to //ssh1// |
- | * From a Linux/mac desktop: ''ssh -A -X your_lsce_login@idefix1.extra.cea.fr'' | + | * From a Linux/mac desktop: ''ssh -A -X your_lsce_login@ssh1.lsce.ipsl.fr'' |
* From a Windows desktop: | * From a Windows desktop: | ||
* Text only: use [[other:win7apps#putty|Putty]] | * Text only: use [[other:win7apps#putty|Putty]] | ||
* Text & graphics. This is more complex to set up, and you need to use one of the options below: | * Text & graphics. This is more complex to set up, and you need to use one of the options below: | ||
- | * use [[other:win7apps#putty|Putty]] **and** [[other:win7apps#cygwin-x|cygwin/X]] | + | * use [[other:win7apps#vcxsrv_windows_x_server|VcXsrv]] |
+ | * use [[other:win7apps#cygwin-x|cygwin/X]] | ||
* use [[other:index#virtualbox_notes|VirtualBox]] | * use [[other:index#virtualbox_notes|VirtualBox]] | ||
- | - There is only a limited number of programs that you can run on idefix1, so you have to go from idefix1 to asterix, obelix or curie with on of the //ssh// commands below: | + | - You can access all LSCE disks from //ssh1//, but there is only a limited number of programs that you can run, so you have to go from //ssh1// to //obelix// or //curie// with one of the ''ssh'' commands below: |
- | * ''ssh asterix.lscelb'' | + | * ''ssh obelix'' |
- | * ''ssh obelix.lscelb'' | + | |
* ''ssh your_tgcc_login@curie-ccrt.ccc.cea.fr'' | * ''ssh your_tgcc_login@curie-ccrt.ccc.cea.fr'' | ||
- It's possible to use only one line to to both ssh commands | - It's possible to use only one line to to both ssh commands | ||
- | * asterix: ''ssh -A -X your_lsce_login@idefix1.extra.cea.fr -t ssh -A asterix.lscelb'' | + | * obelix: ''ssh -A -X your_lsce_login@ssh1.lsce.ipsl.fr -t ssh -A obelix'' |
- | * obelix: ''ssh -A -X your_lsce_login@idefix1.extra.cea.fr -t ssh -A obelix.lscelb'' | + | * TGCC: ''ssh -A -X your_lsce_login@ssh1.lsce.ipsl.fr -t ssh -A your_tgcc_login@curie-ccrt.ccc.cea.fr'' |
- | * TGCC: ''ssh -A -X your_lsce_login@idefix1.extra.cea.fr -t ssh -A your_tgcc_login@curie-ccrt.ccc.cea.fr'' | + | |
- You can define an alias in order to connect more easily to the machines: | - You can define an alias in order to connect more easily to the machines: | ||
- | * //tcsh// users: add the following line to your ''~/.cshrc'' configuration file\\ ''alias iasterix 'ssh -A -X your_lsce_login@idefix1.extra.cea.fr -t ssh -A asterix.lscelb''' | + | * //tcsh// users: add the following line to your ''~/.cshrc'' configuration file\\ ''alias sobelix 'ssh -A -X your_lsce_login@ssh1.lsce.ipsl.fr -t ssh -A obelix''' |
- | * //bash// users: add the following line to your ''~/.bashrc'' configuration file\\ ''alias iasterix='ssh -A -X your_lsce_login@idefix1.extra.cea.fr -t ssh -A asterix.lscelb''' | + | * //bash// users: add the following line to your ''~/.bashrc'' configuration file\\ ''alias sobelix='ssh -A -X your_lsce_login@ssh1.lsce.ipsl.fr -t ssh -A obelix''' |
- | - You should create and configure an //ssh key//, if you don't want to type your password each time you use ssh or scp: https://intranet.lsce.ipsl.fr/informatique/orme/ssh.php | + | - You should create and configure an //ssh key//, if you don't want to type your password each time you use ssh or scp |
- | - If you want more information about ssh | + | - If you want more information about ''ssh'' |
* Linux users: http://ciclad-web.ipsl.jussieu.fr/data/documents/ssh-utilisateurs-unix.pdf | * Linux users: http://ciclad-web.ipsl.jussieu.fr/data/documents/ssh-utilisateurs-unix.pdf | ||
* Windows users: http://ciclad-web.ipsl.jussieu.fr/data/documents/ssh_putty_v2_2011-1.pdf | * Windows users: http://ciclad-web.ipsl.jussieu.fr/data/documents/ssh_putty_v2_2011-1.pdf | ||
Line 370: | Line 387: | ||
==== Copying files to/from LSCE ==== | ==== Copying files to/from LSCE ==== | ||
- | If you are on a computer outside LSCE and you need to transfer a file to/from LSCE, you need to make the transfer between your current machine and idefix1! | + | If you need to **transfer** files to/from LSCE, use ''scp'' (on Linux), or an scp client such as [[other:win7apps#winscp|WinSCP]] (on Windows) between your computer and ''ssh1.lsce.ipsl.fr'' |
- | * Example from a Linux/mac desktop: ''scp -p file_outside_lsce your_lsce_login@idefix1.extra.cea.fr:/home/scratch01/your_lsce_login/'' | + | * Example from a Linux/mac desktop: ''scp -p file_outside_lsce your_lsce_login@ssh1.lsce.ipsl.fr:/home/scratch01/your_lsce_login/'' |
- | * From a Windows desktop: use [[other:win7apps#winscp|winscp]] | + | |
===== What next? ===== | ===== What next? ===== |