other:available_servers
This is an old revision of the document!
Table of Contents
Linux servers used by LSCE users
Common sense reminders
- You can do what you want on your local laptop/desktop (except get viruses)
- Be very careful when you use remote interactive servers shared with other users
- Others should not even notice that you(r processes) are there!
Yes, you can use computing resources cleanly and efficiently… - Note: notebook servers are shared servers!
- If you have some heavy duty processing to do:
- Use shared interactive servers only for quick tests (ideally with a subset of your huge dataset)
- Use dedicated batch/computing clusters for heavy processing
- heavy =
- will run for a long time
- and/or use a lot of CPU (one or many CPUs)
- and/or use a lot of RAM
- and/or do a lot of disk reading/writing,
- …
- resources you use in High Performance Computing centers will probably be deducted from a (shared) project
- Disk space (and backup space) is also an important resource!
- When possible, avoid duplicating data, and run your computations near the data
- Use scratch disks, when available, for temporary data and do not forget to remove temporary data
- LSCE:
/home/scratch01/$USER - spiritx:
/scratchx/$USER - TGCC:
$SCRATCH
- Do not store temporary data, or replicated data, or data that can be easily re-created, on backed-up disks
- Ask your experienced colleagues when you are not sure about something (sometimes even if you are sure…)
- you can get better domain specific answers from your colleagues than from chatbots
- There are no stupid questions (especially for beginners)
- There are always different ways to do things, some are much less efficient than others
- Learn how to monitor resources usage:
- CPU and RAM:
top - …
- Read (some of) the local documentation
RTFM (Read The Fine Manual)- Some Linux related documents (by JYP)
- Learn at least how to use the
man(ual) command !!
- …
Accessing the servers
Connecting to the servers
- We use
sshand ssh clients to connect securely to the servers we work with
- Some computing resources can also be accessed with a web browser and a JupyterHub server
Transferring data
LSCE servers
IPSL servers
HPC centers
other/available_servers.1787299608.txt.gz · Last modified: by jypeter
