This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision Next revision Both sides next revision | ||
other:newppl:starting [2019/04/24 14:45] jypeter [Which programs should you use?] Improved section |
other:newppl:starting [2019/07/12 15:13] jypeter [Project specific directories] Added warning |
||
---|---|---|---|
Line 169: | Line 169: | ||
===== Which Linux servers should you use? ===== | ===== Which Linux servers should you use? ===== | ||
- | There are lots of things you can do directly on your **local** Win7 or Linux desktop (displaying pdf, images, using a text editor, ...), rather than on the remote servers. Never forget that **your local desktop has access to the remote disks on the Linux servers**. | + | There are lots of things you can do directly on your **local** Win7/Win10 or Linux desktop (displaying pdf, images, using a text editor, ...), rather than on the remote servers. Never forget that **your local desktop has access to the remote disks on the Linux servers**. |
Otherwise, **use the appropriate Linux servers**. The //load balancing// system will send you to the server that has currently the smallest load | Otherwise, **use the appropriate Linux servers**. The //load balancing// system will send you to the server that has currently the smallest load | ||
- | * obelixN (''ssh obelix'', or ''ssh obelix.lb''): never forget that you are sharing these servers with other users! Do not use too much CPU and memory for a long time. Heavy computation should be done on the obelix cluster | + | * **obelix**//NN// (type ''ssh obelix'' to get there): never forget that you are sharing these servers with other users! Do not use too much CPU and memory for a long time. Heavy computation should be done on the obelix cluster |
- | * [[https://intranet.lsce.ipsl.fr/informatique/en/calcul/batch.php|the batch system]] (aka //obelix cluster//) for really heavy duty programs | + | * <code> $ ssh obelix |
+ | Last login: Mon Jun 3 08:49:53 2019 from somewhere | ||
+ | # You can use one of the following commands if you want to know on which obelix you are | ||
+ | >echo $HOST | ||
+ | obelix5 | ||
+ | >hostname | ||
+ | obelix5</code> | ||
+ | * [[https://intranet.lsce.ipsl.fr/informatique/en/calcul/batch.php|the batch system]] (aka //obelix **cluster**//) for really heavy duty programs | ||
* in some cases, you may need an account to use the [[http://mesocentre.ipsl.fr/|IPSL/ESPRI clusters]] (aka //ciclad// and //climserv//), especially if you need to use data that is already available/mirrored there, rather than copying the data to LSCE | * in some cases, you may need an account to use the [[http://mesocentre.ipsl.fr/|IPSL/ESPRI clusters]] (aka //ciclad// and //climserv//), especially if you need to use data that is already available/mirrored there, rather than copying the data to LSCE | ||
- | * asterixN: some people may mention these servers, but they don't exist any more! | + | * //asterixN//: some people may mention these servers, but they don't exist any more! |
==== Which shell are you using? ==== | ==== Which shell are you using? ==== | ||
Line 238: | Line 245: | ||
<note warning> | <note warning> | ||
* It is very important to use the correct directories and make it easy for your advisor to find things after you have left | * It is very important to use the correct directories and make it easy for your advisor to find things after you have left | ||
- | * **Put the source codes, scripts and papers you are writing on a backed up disk** | + | * <wrap em>**Put the source codes, scripts and papers you are writing on a backed up disk**</wrap> |
- | * Put temporary files on a scratch disk | + | * The <wrap em>backed up disk at LSCE</wrap> is [[#the_home_directory|/home/users/your_login]]. You should have a few Gb available on //home// (use the ''quota -s'' command to find out the exact amount) |
- | * Do NOT put (big) data files on a backed up disk | + | * Put **temporary files** on a scratch disk (''scratch01'' at LSCE) |
+ | * Do **NOT** put (big) data files on a backed up disk | ||
* Do not forget to clean your directories before you leave (ask your advisor what should be kept or cleaned) | * Do not forget to clean your directories before you leave (ask your advisor what should be kept or cleaned) | ||
Line 250: | Line 258: | ||
* Example path on the LSCE Linux server: ''/home/scratch01/your_lsce_login'' | * Example path on the LSCE Linux server: ''/home/scratch01/your_lsce_login'' | ||
- | * Accessing the same path from a local desktop: | + | * Accessing the path above from a local desktop: |
* Linux desktop: ''/home/scratch01/your_lsce_login'' | * Linux desktop: ''/home/scratch01/your_lsce_login'' | ||
* Windows desktop: ''\\dfshost\dfs\scratch01\your_lsce_login''\\ {{ :other:newppl:dfs_on_win.png?nolink |}} | * Windows desktop: ''\\dfshost\dfs\scratch01\your_lsce_login''\\ {{ :other:newppl:dfs_on_win.png?nolink |}} | ||
Line 266: | Line 274: | ||
* bash shell users: ''.profile'' and ''.bashrc'' | * bash shell users: ''.profile'' and ''.bashrc'' | ||
* emacs text editor: ''.emacs'' | * emacs text editor: ''.emacs'' | ||
+ | * You can go to your home directory by typing ''cd'' (no arguments), and to the home directory of somebody else with ''cd ~login_name'' | ||
+ | * At LSCE, you can't read the content of somebody else's //home// directory | ||
* **Backup of the home directory on the LSCE servers**: YES! Every night | * **Backup of the home directory on the LSCE servers**: YES! Every night | ||
- | * More details on the [[https://intranet.lsce.ipsl.fr/informatique/en/nsr/index.php|backup system]] page | + | * More details on the [[https://intranet.lsce.ipsl.fr/informatique/en/nsr/index.php|LSCE backup system]] page |
- | * Put the most important sources/scripts/data/papers in this directory | + | * <wrap em>Put the most important sources/scripts/data/papers in this directory</wrap> |
- | * Do not put temporary files, or big data files that are available somewhere else in this directory! | + | * **Do not** use the //home// directory to store: |
- | * Your home directory will also be archived when your account is closed | + | * temporary files (use ''scratch01'') |
+ | * big (or many) data files (use ''scratch01'' or a project specific disk) | ||
+ | * Your home directory will be archived when your account is closed, so that you or your advisor can access it later, if required | ||
* **Backup of the TGCC home directory**: YES! | * **Backup of the TGCC home directory**: YES! | ||
Line 284: | Line 296: | ||
==== The scratch directory ==== | ==== The scratch directory ==== | ||
+ | |||
+ | <note warning>Do not put anything in the scratch directory that you can't recreate with a program, or copy/download from somewhere else!</note> | ||
* **Location**: ''/home/scratch01/your_lsce_login'' | * **Location**: ''/home/scratch01/your_lsce_login'' | ||
Line 296: | Line 310: | ||
==== Project specific directories ==== | ==== Project specific directories ==== | ||
+ | |||
+ | <note warning>The data on these disks is <wrap em>probably not backed up</wrap>... You are not protected against file deletion by mistake, or a disk crash (a major disk crash is not likely, but can happen) | ||
+ | |||
+ | \\ You should <wrap em>store your source codes, scripts, notebooks, manuscripts, reports, figures, on a backed up directory</wrap>, and only store on the project disks data downloaded from outside, or that you can regenerate with the backed up scripts</note> | ||
+ | |||
* **Location**: ''/home/some_project_name/your_lsce_login'' | * **Location**: ''/home/some_project_name/your_lsce_login'' | ||
* Ask your advisor if you should use a specific project directory and the technical details about it | * Ask your advisor if you should use a specific project directory and the technical details about it | ||
- | * Use this directory for storing the (big) data files that you can't store safely in the //scratch// directory, and should not store in the //scratch// directory | + | * Use this directory for storing the (big) data files that you can't store safely in the //scratch// directory, and should not store in the //home// directory |
* **Backup**: ask your advisor | * **Backup**: ask your advisor |