User Tools

Site Tools


other:uvcdat:cdat_conda:cdat_8_0_py2

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
Next revision Both sides next revision
other:uvcdat:cdat_conda:cdat_8_0_py2 [2018/11/08 09:47]
jypeter
other:uvcdat:cdat_conda:cdat_8_0_py2 [2019/02/27 10:54]
jypeter
Line 16: Line 16:
 ===== Installation with Miniconda3 ===== ===== Installation with Miniconda3 =====
  
-We have installed a new version of Miniconda3, based on the old [[other:​uvcdat:​conda_notes#​installing_miniconda|installing miniconda]] instructions+==== Installing ​Miniconda3 ​==== 
  
-  * Follow ​the [[https://​conda.io/​docs/​install/​quick.html|Quick install]] steps to install Miniconda +We have installed a new version of Miniconda3 (steps below adapated from the [[other:uvcdat:​conda_notes#​installing_miniconda|installing miniconda]] instructions) 
-    * Get the [[https://​repo.continuum.io/​miniconda/​Miniconda3-latest-Linux-x86_64.sh|Python 3.7 Linux 64-bit (bash installer)]] (unless there is a [[https://​conda.io/​miniconda.html|more recent version?​]]) + 
-      * ''​cd /​home/​scratch01/​jypeter''​ (some temporary storage space for the installer) + 
-      * ''​wget https://​repo.continuum.io/​miniconda/​Miniconda3-latest-Linux-x86_64.sh''​ (60 Mo, 11 Nov 2018+  ​* Get the [[https://​repo.continuum.io/​miniconda/​Miniconda3-latest-Linux-x86_64.sh|Python 3.7 Linux 64-bit (bash installer)]] (unless there is a [[https://​conda.io/​miniconda.html|more recent version?​]]) 
-    * Execute the installer +    * ''​cd /​home/​scratch01/​jypeter''​ (some temporary storage space for the installer) 
-      * ''​bash Miniconda3-latest-Linux-x86_64.sh''​ +    * ''​wget https://​repo.continuum.io/​miniconda/​Miniconda3-latest-Linux-x86_64.sh''​ (67 Mo, 15 Feb 2019
-        * Accept the license +  * Execute the installer 
-        * Specify an explicit installation path **outside of the home directory**,​ with enough disk space (more than 3G if you are going to install UV-CDAT and some extra packages), preferably on a disk that is not backed up: ''/​home/​share/​unix_files/​cdat/​miniconda3''​ +    * ''​bash Miniconda3-latest-Linux-x86_64.sh''​ 
-          * Resulting ''​miniconda3''​ directory size is 302M\\ <​code>​ >du -sh miniconda3+      * Accept the license 
 +      * Specify an explicit installation path **outside of the home directory**,​ with enough disk space (more than 3G if you are going to install UV-CDAT and some extra packages), preferably on a disk that is not backed up: ''/​home/​share/​unix_files/​cdat/​miniconda3''​ 
 +        * Resulting ''​miniconda3''​ directory size is 302M\\ <​code>​ >du -sh miniconda3
 302M    miniconda3 302M    miniconda3
  >​cd miniconda3  >​cd miniconda3
Line 43: Line 45:
 92K     ssl 92K     ssl
 12K     ​x86_64-conda_cos6-linux-gnu</​code>​ 12K     ​x86_64-conda_cos6-linux-gnu</​code>​
-        ​* Accept the automatic update of the //PATH// variable in ''​.bashrc''​ (note: the installer automatically creates a backup of ''​.bashrc''​) +      ​* Accept the automatic update of the //PATH// variable in ''​.bashrc''​ (note: the installer automatically creates a backup of ''​.bashrc''​) 
-          * ''#​ added by Miniconda3 installer''​\\ ''​export PATH="/​home/​share/​unix_files/​cdat/​miniconda3/​bin:​$PATH"''​ +        * ''#​ added by Miniconda3 installer''​\\ ''​export PATH="/​home/​share/​unix_files/​cdat/​miniconda3/​bin:​$PATH"''​ 
-    * Open a new terminal (if you use bash) or open a new terminal and type ''​bash''​ +  * Open a new terminal (if you use bash) or open a new terminal and type ''​bash''​ 
-      * check if the python from the conda distribution has been correctly installed\\ <​code>​ > bash+    * check if the python from the conda distribution has been correctly installed\\ <​code>​ > bash
 $ which python $ which python
 /​home/​share/​unix_files/​cdat/​miniconda3/​bin/​python /​home/​share/​unix_files/​cdat/​miniconda3/​bin/​python
 $ which conda $ which conda
 /​home/​share/​unix_files/​cdat/​miniconda3/​bin/​conda</​code>​ /​home/​share/​unix_files/​cdat/​miniconda3/​bin/​conda</​code>​
-      ​* Update and clean the new installation\\ <​code>​$ conda update --all+    ​* Update and clean the new installation\\ <​code>​$ conda update --all
 $ du -sh /​home/​share/​unix_files/​cdat/​miniconda3 $ du -sh /​home/​share/​unix_files/​cdat/​miniconda3
 515M    /​home/​share/​unix_files/​cdat/​miniconda3 515M    /​home/​share/​unix_files/​cdat/​miniconda3
Line 66: Line 68:
 requests ​                 2.20.0 ​                  ​py37_0 requests ​                 2.20.0 ​                  ​py37_0
 [...]</​code>​ [...]</​code>​
-  * Remove the miniconda3 initialization lines automatically added at the end of ''​.bashrc''​ and put them (and other useful commands) in a special initialization file, that can be sourced only when we actually want to use conda and CDAT 
  
-Disk space used before 2.10 installation ​(after running ''​conda clean --all''​)+==== Post-Miniconda3 ​installation ​====
  
-<​code>​ > du -sh /​home/​share/​unix_files/​cdat/​miniconda2 +The idea is to remove the miniconda3 initialization lines that were automatically added at the end of ''​.bashrc''​ and put them (and other useful commands) in a special initialization file, that can be sourced only when we actually want to use conda and CDAT
-6.5G /​home/​share/​unix_files/​cdat/​miniconda2+
  
- > du -sh /​home/​share/​unix_files/​cdat/​miniconda2/​*  +=== New style initialization ===
-4.4M /​home/​share/​unix_files/​cdat/​miniconda2/​bin +
-4.0K /​home/​share/​unix_files/​cdat/​miniconda2/​conda-bld +
-272K /​home/​share/​unix_files/​cdat/​miniconda2/​conda-meta +
-6.4G /​home/​share/​unix_files/​cdat/​miniconda2/​envs +
-20K /​home/​share/​unix_files/​cdat/​miniconda2/​etc +
-3.8M /​home/​share/​unix_files/​cdat/​miniconda2/​include +
-99M /​home/​share/​unix_files/​cdat/​miniconda2/​lib +
-4.0K /​home/​share/​unix_files/​cdat/​miniconda2/​LICENSE.txt +
-76K /​home/​share/​unix_files/​cdat/​miniconda2/​pkgs +
-376K /​home/​share/​unix_files/​cdat/​miniconda2/​share +
-364K /​home/​share/​unix_files/​cdat/​miniconda2/​ssl+
  
- >​du -sh /​home/​share/​unix_files/​cdat/​miniconda2/​envs/​* +Note: this is the **new** ''​conda activate some_version''​ style
-2.8G /​home/​share/​unix_files/​cdat/​miniconda2/​envs/​cdatm14 +
-1.7G /​home/​share/​unix_files/​cdat/​miniconda2/​envs/​keras +
-2.0G /​home/​share/​unix_files/​cdat/​miniconda2/​envs/​uvcdat-2.8.0</​code>​+
  
-Actual installation+See the ''​~jypeter/​.conda3_jyp.sh''​ file below, and how to use it, **in a bash shell**. In a **tcsh shell**, see the ''​~jypeter/​.conda3_jyp.csh''​ further down
  
-<​code>​bash-4.1conda create -n uvcdat-2.10 -c conda-forge -c uvcdat uvcdat=2.10+<​code>​$ ​which python 
 +/​usr/​bin/​python
  
-Generate ​the list of installed packages +$ cat ~jypeter/​.conda3_jyp.sh 
-conda list -uvcdat-2.10 > /home/scratch01/jypeter/uvcdat-2.10_list_170721.txt<​/code>+# Conda initialization by JYP, NEW style 
 +
 +# Use this for working with conda and CDAT centrally managed by JYP 
 +
 +# Execute this file in a BASH shell with 
 +#     ​source path/​this_file 
 +Then get the list of available python distributions with 
 +#     conda env list 
 +# Then activate a specific distribution with 
 +#     conda activate version_name 
 +
 +# More details in: 
 +#   ​https://​wiki.lsce.ipsl.fr/​pmip3/​doku.php/​other:​python:​starting#​conda-based_versions_of_uv-cdat 
 +#   ​https://​wiki.lsce.ipsl.fr/​pmip3/​doku.php/​other:​uvcdat:​conda_notes 
 +
 +# Jean-Yves Peterschmitt - LSCE - 11/2018 
 + 
 +. /home/share/unix_files/cdat/​miniconda3/​etc/​profile.d/conda.sh
  
-List of installed packages: {{:​other:​uvcdat:​cdat_conda:​uvcdat-2.10_list_170721.txt}}+# Use the alias below to easily determine where your python 
 +# interpreter is located 
 +alias wp="​which python"​
  
-Disk space after 2.10 installation+# Where are ALL the python interpreters in the search path 
 +alias wpa="​which -a python"​
  
-<​code>​bash-4.1$ conda env list +# The end
-cdatm14 ​                 /​home/​share/​unix_files/​cdat/​miniconda2/​envs/​cdatm14 +
-keras                    /​home/​share/​unix_files/​cdat/​miniconda2/​envs/​keras +
-uvcdat-2.10 ​             /​home/​share/​unix_files/​cdat/​miniconda2/​envs/​uvcdat-2.10 +
-uvcdat-2.8.0 ​            /​home/​share/​unix_files/​cdat/​miniconda2/​envs/​uvcdat-2.8.0 +
-root                  *  /​home/​share/​unix_files/​cdat/​miniconda2+
  
- > du -sh /​home/​share/​unix_files/​cdat/​miniconda2 +$ source ~jypeter/​.conda3_jyp.sh
-11G /​home/​share/​unix_files/​cdat/​miniconda2+
  
- > du -sh /​home/​share/​unix_files/​cdat/​miniconda2/​*  +conda activate cdatm 
-4.4M /​home/​share/​unix_files/​cdat/​miniconda2/​bin +(cdatm) $ which python 
-4.0K /​home/​share/​unix_files/​cdat/​miniconda2/​conda-bld +/​home/​share/​unix_files/​cdat/​miniconda3/envs/cdatm/bin/python
-272K /​home/​share/​unix_files/​cdat/​miniconda2/​conda-meta +
-9.2G /​home/​share/​unix_files/​cdat/​miniconda2/envs +
-20K /home/share/​unix_files/​cdat/​miniconda2/​etc +
-3.8M /​home/​share/​unix_files/​cdat/​miniconda2/​include +
-99M /​home/​share/​unix_files/​cdat/​miniconda2/​lib +
-4.0K /​home/​share/​unix_files/​cdat/​miniconda2/​LICENSE.txt +
-1.4G /​home/​share/​unix_files/​cdat/​miniconda2/​pkgs +
-376K /​home/​share/​unix_files/​cdat/​miniconda2/​share +
-364K /​home/​share/​unix_files/​cdat/​miniconda2/ssl+
  
- > du -sh /​home/​share/​unix_files/​cdat/​miniconda2/​envs/​* 
-2.8G /​home/​share/​unix_files/​cdat/​miniconda2/​envs/​cdatm14 
-1.7G /​home/​share/​unix_files/​cdat/​miniconda2/​envs/​keras 
-2.8G /​home/​share/​unix_files/​cdat/​miniconda2/​envs/​uvcdat-2.10 
-2.0G /​home/​share/​unix_files/​cdat/​miniconda2/​envs/​uvcdat-2.8.0 
 </​code>​ </​code>​
  
-Disk space after removing the keras environment that we don't need any more+**tcsh shell** usage example
  
-<​code>​jypeter@asterix2 - ...cdat - 67 >du -sh /​home/​share/​unix_files/​cdat/​miniconda2 +<​code>​ >which python 
-9.0G /home/​share/​unix_files/​cdat/​miniconda2 +/usr/bin/python
-jypeter@asterix2 - ...cdat - 68 >du -sh /​home/​share/​unix_files/​cdat/​miniconda2/​* +
-4.4M /​home/​share/​unix_files/​cdat/​miniconda2/bin +
-4.0K /home/​share/​unix_files/​cdat/​miniconda2/​conda-bld +
-272K /​home/​share/​unix_files/​cdat/​miniconda2/​conda-meta +
-7.5G /​home/​share/​unix_files/​cdat/​miniconda2/​envs +
-20K /​home/​share/​unix_files/​cdat/​miniconda2/​etc +
-3.8M /​home/​share/​unix_files/​cdat/​miniconda2/​include +
-99M /​home/​share/​unix_files/​cdat/​miniconda2/​lib +
-4.0K /​home/​share/​unix_files/​cdat/​miniconda2/​LICENSE.txt +
-1.4G /​home/​share/​unix_files/​cdat/​miniconda2/​pkgs +
-376K /​home/​share/​unix_files/​cdat/​miniconda2/​share +
-364K /​home/​share/​unix_files/​cdat/​miniconda2/​ssl +
-jypeter@asterix2 - ...cdat - 69 >du -sh /​home/​share/​unix_files/​cdat/​miniconda2/​envs/​* +
-2.8G /​home/​share/​unix_files/​cdat/​miniconda2/​envs/​cdatm14 +
-2.8G /​home/​share/​unix_files/​cdat/​miniconda2/​envs/​uvcdat-2.10 +
-2.0G /​home/​share/​unix_files/​cdat/​miniconda2/​envs/​uvcdat-2.8.0</​code>​+
  
-Disk space used in <wrap em>a brand new directory hierarchy<​/wrap> (''​cdat/miniconda2b'',​ on the obelix servers)+ >cat ~jypeter/​.conda3_jyp.csh 
 +# Conda initialization by JYP, NEW style 
 +
 +# Use this for working with conda and CDAT centrally managed by JYP 
 +
 +# Execute this file in TCSH shell with 
 +#     ​source path/this_file 
 +# Then get the list of available python distributions with 
 +#     conda env list 
 +# Then activate a specific distribution with 
 +#     conda activate version_name 
 +
 +# More details in: 
 +#   ​https://​wiki.lsce.ipsl.fr/​pmip3/​doku.php/​other:​python:​starting#​conda-based_versions_of_uv-cdat 
 +#   ​https:​//​wiki.lsce.ipsl.fr/​pmip3/​doku.php/​other:​uvcdat:​conda_notes 
 +
 +# Jean-Yves Peterschmitt - LSCE - 11/2018
  
-<​code>​bash-4.2$ conda env list +source ​/​home/​share/​unix_files/​cdat/​miniconda3/etc/profile.d/conda.csh
-uvcdat-2.10 ​             ​/​home/​share/​unix_files/​cdat/​miniconda2b/envs/uvcdat-2.10 +
-root                  *  ​/home/​share/​unix_files/​cdat/​miniconda2b+
  
-bash-4.2$ du -sh /​home/​share/​unix_files/​cdat/​miniconda2b +# Use the alias below to easily determine where your python 
-4.3G /​home/​share/​unix_files/​cdat/​miniconda2b+# interpreter is located 
 +alias wp "which python"​
  
-bash-4.2$ du -sh /​home/​share/​unix_files/​cdat/​miniconda2b/​* +# Where are ALL the python interpreters in the search path 
-4.4M /​home/​share/​unix_files/​cdat/​miniconda2b/​bin +alias wpa "​\which ​-a python"​
-4.0K /​home/​share/​unix_files/​cdat/​miniconda2b/​conda-bld +
-280K /​home/​share/​unix_files/​cdat/​miniconda2b/​conda-meta +
-2.8G /​home/​share/​unix_files/​cdat/​miniconda2b/​envs +
-20K /​home/​share/​unix_files/​cdat/​miniconda2b/​etc +
-3.8M /​home/​share/​unix_files/​cdat/​miniconda2b/​include +
-100M /​home/​share/​unix_files/​cdat/​miniconda2b/​lib +
-8.0K /​home/​share/​unix_files/​cdat/​miniconda2b/​LICENSE.txt +
-1.4G /​home/​share/​unix_files/​cdat/​miniconda2b/​pkgs +
-16K /​home/​share/​unix_files/​cdat/​miniconda2b/​share +
-376K /​home/​share/​unix_files/​cdat/​miniconda2b/​ssl +
-</​code>​+
  
 +# The end
  
-===== Cloning uvcdat to add specific packages for LSCE =====+ >​source ​ ~jypeter/​.conda3_jyp.csh
  
-<WRAP center round tip 60%> + >conda activate cdatm
-This section is about the creation of the **cdatm15** environment+
  
-Notes about [[https://wiki.lsce.ipsl.fr/pmip3/doku.php/other:python:​starting#​conda-based_versions_of_uv-cdat|actually using the cdatm15 conda-based python]] +(cdatm) >which python 
-</WRAP>+/home/share/unix_files/cdat/​miniconda3/​envs/​cdatm/​bin/​python</​code>
  
 +=== Old style initialization ===
  
-Note: using hard links, cloning a full environment //only// adds an extra 500M of disk space+Note: this is the **old** ''​source activate some_version''​ style
  
-<​code>​bash-4.1$ du -sh /​home/​share/​unix_files/​cdat/​miniconda2 +See the ''​~jypeter/​.conda3old_jyp.sh''​ file below, and how to use it, **in a bash shell**
-9.0G /​home/​share/​unix_files/​cdat/​miniconda2+
  
-bash-4.1du -sh /​home/​share/​unix_files/​cdat/​miniconda2/​envs/​* +<​code>​bash-4.2which python 
-2.8G /home/share/unix_files/​cdat/​miniconda2/​envs/​cdatm14 +/usr/bin/python
-2.8G /​home/​share/​unix_files/​cdat/​miniconda2/​envs/​uvcdat-2.10 +
-2.0G /​home/​share/​unix_files/​cdat/​miniconda2/​envs/​uvcdat-2.8.0+
  
-bash-4.1conda create -n cdatm15 --clone uvcdat-2.10  +cat .conda3old_jyp.sh 
-Source     /home/share/unix_files/cdat/​miniconda2/envs/uvcdat-2.10 +# Conda initialization by JYP, OLD style 
-Destination: /home/share/unix_files/cdat/​miniconda2/​envs/cdatm15 +
-[...]+# Use this for working with conda and CDAT centrally managed by JYP 
 +
 +# Execute this file in a BASH shell with 
 +#     ​source path/​this_file 
 +# Then get the list of available python distributions with 
 +#     conda env list 
 +# Then activate a specific distribution with 
 +#     ​source activate version_name 
 +
 +# More details in: 
 +#   https://wiki.lsce.ipsl.fr/pmip3/doku.php/other:​python:​starting#​conda-based_versions_of_uv-cdat 
 +#   https://wiki.lsce.ipsl.fr/pmip3/doku.php/other:​uvcdat:​conda_notes 
 +
 +# Jean-Yves Peterschmitt - LSCE - 11/2018
  
-bash-4.1$ du -sh /​home/​share/​unix_files/​cdat/​miniconda2 +export PATH="/​home/​share/​unix_files/​cdat/​miniconda3/bin:​$PATH"​
-9.5G /home/​share/​unix_files/​cdat/​miniconda2+
  
-bash-4.1$ du -sh /​home/​share/​unix_files/​cdat/​miniconda2/​envs/​* +# Use the alias below to easily determine where your python 
-2.8G /​home/​share/​unix_files/​cdat/​miniconda2/​envs/​cdatm14 +# interpreter is located 
-2.8G /​home/​share/​unix_files/​cdat/​miniconda2/​envs/​cdatm15 +alias wp="​which python"​
-573M /​home/​share/​unix_files/​cdat/​miniconda2/​envs/​uvcdat-2.10 +
-2.0G /​home/​share/​unix_files/​cdat/​miniconda2/​envs/​uvcdat-2.8.0 +
-</​code>​+
  
-Disk space used after cloning, ​in <wrap em>in the  new directory hierarchy</​wrap>​ (''​cdat/​miniconda2b'',​ on the obelix servers)+# Where are ALL the python interpreters ​in the search path 
 +alias wpa="​which -a python"​
  
-<​code>​bash-4.2$ du -sh /​home/​share/​unix_files/​cdat/​miniconda2b +# The end
-4.8G /​home/​share/​unix_files/​cdat/​miniconda2b+
  
-bash-4.2du -sh /home/​share/​unix_files/​cdat/​miniconda2b/​* +source ~jypeter/.conda3old_jyp.sh
-4.4M /​home/​share/​unix_files/​cdat/​miniconda2b/​bin +
-4.0K /​home/​share/​unix_files/​cdat/​miniconda2b/​conda-bld +
-280K /​home/​share/​unix_files/​cdat/​miniconda2b/​conda-meta +
-3.4G /​home/​share/​unix_files/​cdat/​miniconda2b/​envs +
-20K /​home/​share/​unix_files/​cdat/​miniconda2b/​etc +
-3.8M /​home/​share/​unix_files/​cdat/​miniconda2b/​include +
-100M /​home/​share/​unix_files/​cdat/​miniconda2b/​lib +
-8.0K /​home/​share/​unix_files/​cdat/​miniconda2b/​LICENSE.txt +
-1.4G /​home/​share/​unix_files/​cdat/​miniconda2b/​pkgs +
-16K /​home/​share/​unix_files/​cdat/​miniconda2b/​share +
-376K /​home/​share/​unix_files/​cdat/​miniconda2b/​ssl+
  
-bash-4.2du -sh /​home/​share/​unix_files/​cdat/​miniconda2b/​envs/​* +wp 
-2.8G /​home/​share/​unix_files/​cdat/​miniconda2b/​envs/​cdatm15 +/​home/​share/​unix_files/​cdat/​miniconda3/bin/python
-574M /​home/​share/​unix_files/​cdat/​miniconda2b/envs/uvcdat-2.10+
 </​code>​ </​code>​
  
-===== Getting ready for a moving default ​CDAT =====+==== Installing ​CDAT 8.0 ====
  
-We create ​a **//cdatm// symbolic link** in the ''​envs''​ directory, that has a //stable name// but can be moved to point to the latest default CDATIn that case, most users can just activate this //cdatm// version and always get the latest stable version+<​code>​$ conda create ​-n cdat-8.0_py2 -c cdat/label/v80 -c conda-forge -c cdat python=2.7 cdat 
 +# Generate ​the list of installed packages 
 +$ conda list -n cdat-8.0_py2 > /home/scratch01/jypeter/cdat-8.0_py2_list_181108.txt</code>
  
-<​code>​bash-4.2$ cd /​home/​share/​unix_files/​cdat/​miniconda2b/​envs+List of installed packages: {{:​other:​uvcdat:​cdat_conda:​cdat-8.0_py2_list_181108.txt}}
  
-bash-4.2$ conda env list +Disk space after 8.0 installation
-cdatm15 ​                 /​home/​share/​unix_files/​cdat/​miniconda2b/​envs/​cdatm15 +
-uvcdat-2.10 ​             /​home/​share/​unix_files/​cdat/​miniconda2b/​envs/​uvcdat-2.10 +
-root                  *  /​home/​share/​unix_files/​cdat/​miniconda2b+
  
-bash-4.2$ ln -s cdatm15 cdatm+<​code>​$ du -sh /​home/​share/​unix_files/​cdat/​miniconda3 
 +4.3G    /​home/​share/​unix_files/​cdat/​miniconda3 
 +$ du -sh /​home/​share/​unix_files/​cdat/​miniconda3/​* 
 +15M     /​home/​share/​unix_files/​cdat/​miniconda3/​bin 
 +2.4M    /​home/​share/​unix_files/​cdat/​miniconda3/​compiler_compat 
 +4.0K    /​home/​share/​unix_files/​cdat/​miniconda3/​conda-bld 
 +3.7M    /​home/​share/​unix_files/​cdat/​miniconda3/​conda-meta 
 +2.8G    /​home/​share/​unix_files/​cdat/​miniconda3/​envs 
 +28K     /​home/​share/​unix_files/​cdat/​miniconda3/​etc 
 +4.9M    /​home/​share/​unix_files/​cdat/​miniconda3/​include 
 +156M    /​home/​share/​unix_files/​cdat/​miniconda3/​lib 
 +8.0K    /​home/​share/​unix_files/​cdat/​miniconda3/​LICENSE.txt 
 +1.4G    /​home/​share/​unix_files/​cdat/​miniconda3/​pkgs 
 +1.3M    /​home/​share/​unix_files/​cdat/​miniconda3/​share 
 +24K     /​home/​share/​unix_files/​cdat/​miniconda3/​ssl 
 +12K     /​home/​share/​unix_files/​cdat/​miniconda3/​x86_64-conda_cos6-linux-gnu 
 +du -sh /​home/​share/​unix_files/​cdat/​miniconda3/​envs/​* 
 +2.8G    /​home/​share/​unix_files/​cdat/​miniconda3/​envs/​cdat-8.0_py2</​code>​
  
-bash-4.2$ conda env list 
-cdatm                    /​home/​share/​unix_files/​cdat/​miniconda2b/​envs/​cdatm 
-cdatm15 ​                 /​home/​share/​unix_files/​cdat/​miniconda2b/​envs/​cdatm15 
-uvcdat-2.10 ​             /​home/​share/​unix_files/​cdat/​miniconda2b/​envs/​uvcdat-2.10 
-root                  *  /​home/​share/​unix_files/​cdat/​miniconda2b 
  
-bash-4.2$ source activate cdatm+===== Cloning cdat to add specific packages for LSCE ===== 
 + 
 +<WRAP center round tip 60%> 
 +This section is about the creation of the **cdatm17** environment 
 + 
 +Notes about [[https://​wiki.lsce.ipsl.fr/​pmip3/​doku.php/​other:​python:​starting#​conda-based_versions_of_uv-cdat|actually using the cdatm17 conda-based python]] 
 +</​WRAP>​ 
 + 
 + 
 +Note: using hard links, cloning a full environment //only// adds an extra 582M of disk space 
 + 
 +<​code>​$ du -sh /​home/​share/​unix_files/​cdat/​miniconda3/​envs/​* 
 +2.8G    /​home/​share/​unix_files/​cdat/​miniconda3/​envs/​cdat-8.0_py2 
 +conda create -n cdatm17_py2 --clone cdat-8.0_py2 
 +Source: ​     /​home/​share/​unix_files/​cdat/​miniconda3/​envs/​cdat-8.0_py2 
 +Destination:​ /​home/​share/​unix_files/​cdat/​miniconda3/​envs/​cdatm17_py2 
 +Packages: 226 
 +Files: 3 
 + 
 +[...] 
 + 
 +$ du -sh /​home/​share/​unix_files/​cdat/​miniconda3/​envs/​* 
 +2.8G    /​home/​share/​unix_files/​cdat/​miniconda3/​envs/​cdat-8.0_py2 
 +582M    /​home/​share/​unix_files/​cdat/​miniconda3/​envs/​cdatm17_py2
  
-(cdatm) bash-4.2$ conda env list 
-cdatm                 ​* ​ /​home/​share/​unix_files/​cdat/​miniconda2b/​envs/​cdatm 
-cdatm15 ​                 /​home/​share/​unix_files/​cdat/​miniconda2b/​envs/​cdatm15 
-uvcdat-2.10 ​             /​home/​share/​unix_files/​cdat/​miniconda2b/​envs/​uvcdat-2.10 
-root                     /​home/​share/​unix_files/​cdat/​miniconda2b 
 </​code>​ </​code>​
 +
 +===== Getting ready for a moving default CDAT =====
 +
 +We create a **//cdatm// symbolic link** in the ''​envs''​ directory, that has a //stable name// but can be moved to point to the latest default CDAT. In that case, most users can just activate this //cdatm// version and always get the latest stable version
 +
 +<​code>​$ cd /​home/​share/​unix_files/​cdat/​miniconda3/​envs
 +$ conda env list
 +base                  *  /​home/​share/​unix_files/​cdat/​miniconda3
 +cdat-8.0_py2 ​            /​home/​share/​unix_files/​cdat/​miniconda3/​envs/​cdat-8.0_py2
 +cdatm17_py2 ​             /​home/​share/​unix_files/​cdat/​miniconda3/​envs/​cdatm17_py2
 +$ ln -s cdatm17_py2 cdatm
 +$ conda env list
 +base                  *  /​home/​share/​unix_files/​cdat/​miniconda3
 +cdat-8.0_py2 ​            /​home/​share/​unix_files/​cdat/​miniconda3/​envs/​cdat-8.0_py2
 +cdatm                    /​home/​share/​unix_files/​cdat/​miniconda3/​envs/​cdatm
 +cdatm17_py2 ​             /​home/​share/​unix_files/​cdat/​miniconda3/​envs/​cdatm17_py2
 +$ source activate cdatm
 +(cdatm) bash-4.2$ conda env list
 +base                     /​home/​share/​unix_files/​cdat/​miniconda3
 +cdat-8.0_py2 ​            /​home/​share/​unix_files/​cdat/​miniconda3/​envs/​cdat-8.0_py2
 +cdatm                 ​* ​ /​home/​share/​unix_files/​cdat/​miniconda3/​envs/​cdatm
 +cdatm17_py2 ​             /​home/​share/​unix_files/​cdat/​miniconda3/​envs/​cdatm17_py2</​code>​
  
 ===== Customizing UV-CDAT for LSCE ===== ===== Customizing UV-CDAT for LSCE =====
Line 267: Line 288:
 ==== Downloading cdms2/vcs test data ==== ==== Downloading cdms2/vcs test data ====
  
-You should download the test data and use it in the example scripts that you want to distribute, and scripts you write for reporting the errors you find (if any...)+You should download the test data (174M of data...) ​and use it in the example scripts that you want to distribute, and scripts you write for reporting the errors you find (if any...)
  
-<​code>​bash-4.1$ source activate ​cdatm15+<​code>​$ source activate ​cdatm17_py2
  
-(cdatm15bash-4.1$ python -c '​import vcs; vcs.download_sample_data_files();​ print "​\nFinished downloading sample data to", vcs.sample_data'​+(cdatm17_py2) $ python -c '​import vcs; vcs.download_sample_data_files();​ print "​\nFinished downloading sample data to", vcs.sample_data'​
 [...] [...]
-Finished downloading sample data to /​home/​share/​unix_files/​cdat/​miniconda2/envs/cdatm15/​share/​uvcdat/​sample_data+Finished downloading sample data to /​home/​share/​unix_files/​cdat/​miniconda3/envs/cdatm17_py2/​share/​uvcdat/​sample_data
  
-(cdatm15bash-4.1$ du -sh /​home/​share/​unix_files/​cdat/​miniconda2/envs/cdatm15/​share/​uvcdat/​sample_data +(cdatm17_py2) $ du -sh /​home/​share/​unix_files/​cdat/​miniconda3/envs/cdatm17_py2/​share/​uvcdat/​sample_data 
-174M /​home/​share/​unix_files/​cdat/​miniconda2/envs/cdatm15/​share/​uvcdat/​sample_data</​code>​+174M    /​home/​share/​unix_files/​cdat/​miniconda3/envs/cdatm17_py2/​share/​uvcdat/​sample_data 
 +</​code>​
  
  
other/uvcdat/cdat_conda/cdat_8_0_py2.txt · Last modified: 2021/02/27 13:55 by jypeter