User Tools

Site Tools


other:uvcdat:cdat_conda:miniconda3_install

This is an old revision of the document!


JYP steps for installing Miniconda3

What? Why?

  • Miniconda3 is a minimal python environment/distribution that can be used for creating more complete working environments. It will basically make conda available on your computer, and then you can use conda to install and update more stuff.
  • A python environment is basically where and how you install python. A python distribution is more which packages you have chosen to install together in the environment. Hmmm, well, these are very similar things!
  • You don't need to be (and you should not be) root when you install Miniconda3. You just need enough disk space where you have write access
  • The way you do things will depend on how you are going to use python? Are you installing the environment just for you, or for multiple users?
  • We could also start with the Anaconda installer that will install a much more complete python environment, ready for use, but we choose not to do that because Anaconda requires more disk space at the beginning, with all its components coming from the default channel provided by the conda repository. It's not useful because we will be mostly using (the same) packages provided by the conda-forge repository]].

The steps on this page are adapted from the much older (but with lots of extra and possibly useful details) installing miniconda instructions

Installing miniconda3

  • Execute the installer
    • bash Miniconda3-latest-Linux-x86_64.sh
      • Accept the license
      • Note: at the end of the installation (next step), answer no to the following question, so that the installer does not change your existing shell initialization files!
        Do you wish the installer to initialize Miniconda3 by running conda init? [yes|no]NO
      • Specify an explicit installation path outside of your home directory, with enough disk space (more than 3 Gb if you are going to install CDAT and some extra packages), preferably on a disk that is not backed up:
        • Installations by JYP:
          • Linux at LSCE: /home/share/unix_files/cdat/miniconda3, or another subdirectory of /home/share/unix_files/cdat/
          • Linux on ciclad: /data/jypmce/cdat/miniconda3, or another sub-directory of /data/jypmce/cdat/
        • WSL: installing to a directory that is not in /home/ does not work (e.g. /mnt/h/CDAT/miniconda3,assuming there is a H:\CDAT\ directory, does not work)
          You need to accept the installation in the default location: /home/<your_login>/miniconda3
      • The resulting miniconda3 directory size is 342M
         > du -sh miniconda3
        342M    miniconda3
        
         > cd miniconda3
        
         > du -sh *
        20M     bin
        0       compiler_compat
        4.0K    condabin
        684K    conda-meta
        0       envs
        16K     etc
        5.5M    include
        4.0K    info
        198M    lib
        12K     LICENSE.txt
        114M    pkgs
        604K    share
        4.0K    shell
        0       ssl
        0       x86_64-conda_cos6-linux-gnu
  • Initialize the newly installed conda environment:
    • bash shell: source <installation_path>/miniconda3/etc/profile.d/conda.sh
    • tcsh shell: source <installation_path>/miniconda3/etc/profile.d/conda.csh
  • Check if you can use the conda command, and use it to initialize the base environment
    • $ which conda
      <installation_path>/miniconda3/condabin/conda
      $ which python
      /usr/bin/python
      $ conda activate
      (base) $ which python
      <installation_path>/miniconda3/bin/python
  • Update the new installation
    • $ conda update --all
      [...]
    • During the update, the miniconda3 directory size goes from 432 Mb to 581 Mb. This directory will keep on growing, which is the reason why you should put it on a (preferably non backed up) disk where you have enough space
  • Make sure we have the latest conda (just in case we did not get it with the update)
    conda update -n base -c defaults conda
  • Remove the installer:
    rm Miniconda3-latest-Linux-x86_64.sh

Post-Miniconda3 installation

The idea is to remove the miniconda3 initialization lines that were automatically added at the end of .bashrc and put them (and other useful commands) in a special initialization file, that can be sourced only when we actually want to use conda and CDAT (in order to avoid potentiel side effects)

New style initialization

Note: this is the new conda activate some_version style

See the ~jypeter/.conda3_jyp.sh file below, and how to use it, in a bash shell. In a tcsh shell, see the ~jypeter/.conda3_jyp.csh further down. In both shell cases, if you are installing your own version of python, you need to use your own location of the initialization files in the source lines, and you can use another file name than conda3_jyp

$ which python
/usr/bin/python

$ cat ~jypeter/.conda3_jyp.sh
# Conda initialization by JYP, NEW style
#
# Use this for working with conda and CDAT centrally managed by JYP
#
# Execute this file in a BASH shell with
#     source path/this_file
# Then get the list of available python distributions with
#     conda env list
# Then activate a specific distribution with
#     conda activate version_name
#
# More details in:
#   https://wiki.lsce.ipsl.fr/pmip3/doku.php/other:python:starting#conda-based_versions_of_uv-cdat
#   https://wiki.lsce.ipsl.fr/pmip3/doku.php/other:uvcdat:conda_notes
#
# Jean-Yves Peterschmitt - LSCE - 11/2018

source /home/share/unix_files/cdat/miniconda3/etc/profile.d/conda.sh

# Use the alias below to easily determine where your python
# interpreter is located
alias wp="which python"

# Where are ALL the python interpreters in the search path
alias wpa="which -a python"

# The end

$ source ~jypeter/.conda3_jyp.sh

$ conda activate
(base) $ which python
/home/share/unix_files/cdat/miniconda3/bin/python

tcsh shell usage example

 >which python
/usr/bin/python

 >cat ~jypeter/.conda3_jyp.csh
# Conda initialization by JYP, NEW style
#
# Use this for working with conda and CDAT centrally managed by JYP
#
# Execute this file in a TCSH shell with
#     source path/this_file
# Then get the list of available python distributions with
#     conda env list
# Then activate a specific distribution with
#     conda activate version_name
#
# More details in:
#   https://wiki.lsce.ipsl.fr/pmip3/doku.php/other:python:starting#conda-based_versions_of_uv-cdat
#   https://wiki.lsce.ipsl.fr/pmip3/doku.php/other:uvcdat:conda_notes
#
# Jean-Yves Peterschmitt - LSCE - 11/2018

source /home/share/unix_files/cdat/miniconda3/etc/profile.d/conda.csh

# Use the alias below to easily determine where your python
# interpreter is located
alias wp "which python"

# The end

 >source  ~jypeter/.conda3_jyp.csh

 >conda activate

(base) >which python
/home/share/unix_files/cdat/miniconda3/bin/python

You probably don't want to type the source line each time you need to use your conda based python, so you can add a source ~jypeter/.conda3_jyp.sh line in your ~/.bashrc file, and source ~jypeter/.conda3_jyp.csh line in your ~/.cshrc file. Then, when you need a specific python environment, just type conda activate name_of_the_specific_environment





[ PMIP3 Wiki Home ] - [ Help! ] - [ Wiki syntax ]

other/uvcdat/cdat_conda/miniconda3_install.1615210691.txt.gz · Last modified: 2021/03/08 13:38 by jypeter