This shows you the differences between two versions of the page.
Both sides previous revision Previous revision | Next revision Both sides next revision | ||
other:uvcdat:cdat_conda:cdat_8_0_py2 [2018/11/08 15:30] jypeter |
other:uvcdat:cdat_conda:cdat_8_0_py2 [2018/11/08 16:10] jypeter |
||
---|---|---|---|
Line 18: | Line 18: | ||
==== Installing Miniconda3 ==== | ==== Installing Miniconda3 ==== | ||
- | We have installed a new version of Miniconda3, based on the old [[other:uvcdat:conda_notes#installing_miniconda|installing miniconda]] instructions | + | We have installed a new version of Miniconda3, by following the existing [[other:uvcdat:conda_notes#installing_miniconda|installing miniconda]] instructions |
* Follow the [[https://conda.io/docs/install/quick.html|Quick install]] steps to install Miniconda | * Follow the [[https://conda.io/docs/install/quick.html|Quick install]] steps to install Miniconda | ||
Line 98: | Line 98: | ||
==== Installing CDAT 8.0 ==== | ==== Installing CDAT 8.0 ==== | ||
- | + | <code>conda create -n cdat-8.0_py2 -c cdat/label/v80 -c conda-forge -c cdat python=2.7 cdat | |
- | <code>bash-4.1$ conda create -n uvcdat-2.10 -c conda-forge -c uvcdat uvcdat=2.10 | + | |
- | conda create -n cdat-8.0 -c cdat/label/v80 -c conda-forge -c cdat python=2.7 cdat | + | |
# Generate the list of installed packages | # Generate the list of installed packages | ||
- | conda list -n uvcdat-2.10 > /home/scratch01/jypeter/uvcdat-2.10_list_170721.txt</code> | + | conda list -n cdat-8.0_py2 > /home/scratch01/jypeter/cdat-8.0_py2_list_181108.txt</code> |
- | List of installed packages: {{:other:uvcdat:cdat_conda:uvcdat-2.10_list_170721.txt}} | + | List of installed packages: {{:other:uvcdat:cdat_conda:cdat-8.0_py2_list_181108.txt}} |
Disk space after 8.0 installation | Disk space after 8.0 installation | ||
- | <code>bash-4.1$ conda env list | + | <code>$ du -sh /home/share/unix_files/cdat/miniconda3 |
- | cdatm14 /home/share/unix_files/cdat/miniconda2/envs/cdatm14 | + | 4.3G /home/share/unix_files/cdat/miniconda3 |
- | keras /home/share/unix_files/cdat/miniconda2/envs/keras | + | $ du -sh /home/share/unix_files/cdat/miniconda3/* |
- | uvcdat-2.10 /home/share/unix_files/cdat/miniconda2/envs/uvcdat-2.10 | + | 15M /home/share/unix_files/cdat/miniconda3/bin |
- | uvcdat-2.8.0 /home/share/unix_files/cdat/miniconda2/envs/uvcdat-2.8.0 | + | 2.4M /home/share/unix_files/cdat/miniconda3/compiler_compat |
- | root * /home/share/unix_files/cdat/miniconda2 | + | 4.0K /home/share/unix_files/cdat/miniconda3/conda-bld |
- | + | 3.7M /home/share/unix_files/cdat/miniconda3/conda-meta | |
- | > du -sh /home/share/unix_files/cdat/miniconda2 | + | 2.8G /home/share/unix_files/cdat/miniconda3/envs |
- | 11G /home/share/unix_files/cdat/miniconda2 | + | 28K /home/share/unix_files/cdat/miniconda3/etc |
- | + | 4.9M /home/share/unix_files/cdat/miniconda3/include | |
- | > du -sh /home/share/unix_files/cdat/miniconda2/* | + | 156M /home/share/unix_files/cdat/miniconda3/lib |
- | 4.4M /home/share/unix_files/cdat/miniconda2/bin | + | 8.0K /home/share/unix_files/cdat/miniconda3/LICENSE.txt |
- | 4.0K /home/share/unix_files/cdat/miniconda2/conda-bld | + | 1.4G /home/share/unix_files/cdat/miniconda3/pkgs |
- | 272K /home/share/unix_files/cdat/miniconda2/conda-meta | + | 1.3M /home/share/unix_files/cdat/miniconda3/share |
- | 9.2G /home/share/unix_files/cdat/miniconda2/envs | + | 24K /home/share/unix_files/cdat/miniconda3/ssl |
- | 20K /home/share/unix_files/cdat/miniconda2/etc | + | 12K /home/share/unix_files/cdat/miniconda3/x86_64-conda_cos6-linux-gnu |
- | 3.8M /home/share/unix_files/cdat/miniconda2/include | + | $ du -sh /home/share/unix_files/cdat/miniconda3/envs/* |
- | 99M /home/share/unix_files/cdat/miniconda2/lib | + | 2.8G /home/share/unix_files/cdat/miniconda3/envs/cdat-8.0_py2</code> |
- | 4.0K /home/share/unix_files/cdat/miniconda2/LICENSE.txt | + | |
- | 1.4G /home/share/unix_files/cdat/miniconda2/pkgs | + | |
- | 376K /home/share/unix_files/cdat/miniconda2/share | + | |
- | 364K /home/share/unix_files/cdat/miniconda2/ssl | + | |
- | + | ||
- | > du -sh /home/share/unix_files/cdat/miniconda2/envs/* | + | |
- | 2.8G /home/share/unix_files/cdat/miniconda2/envs/cdatm14 | + | |
- | 1.7G /home/share/unix_files/cdat/miniconda2/envs/keras | + | |
- | 2.8G /home/share/unix_files/cdat/miniconda2/envs/uvcdat-2.10 | + | |
- | 2.0G /home/share/unix_files/cdat/miniconda2/envs/uvcdat-2.8.0 | + | |
- | </code> | + | |
Line 144: | Line 131: | ||
This section is about the creation of the **cdatm17** environment | This section is about the creation of the **cdatm17** environment | ||
- | Notes about [[https://wiki.lsce.ipsl.fr/pmip3/doku.php/other:python:starting#conda-based_versions_of_uv-cdat|actually using the cdatm15 conda-based python]] | + | Notes about [[https://wiki.lsce.ipsl.fr/pmip3/doku.php/other:python:starting#conda-based_versions_of_uv-cdat|actually using the cdatm17 conda-based python]] |
</WRAP> | </WRAP> | ||
- | Note: using hard links, cloning a full environment //only// adds an extra 500M of disk space | + | Note: using hard links, cloning a full environment //only// adds an extra 582M of disk space |
- | <code>bash-4.1$ du -sh /home/share/unix_files/cdat/miniconda3 | + | <code>$ du -sh /home/share/unix_files/cdat/miniconda3/envs/* |
- | 9.0G /home/share/unix_files/cdat/miniconda3 | + | 2.8G /home/share/unix_files/cdat/miniconda3/envs/cdat-8.0_py2 |
+ | $ conda create -n cdatm17_py2 --clone cdat-8.0_py2 | ||
+ | Source: /home/share/unix_files/cdat/miniconda3/envs/cdat-8.0_py2 | ||
+ | Destination: /home/share/unix_files/cdat/miniconda3/envs/cdatm17_py2 | ||
+ | Packages: 226 | ||
+ | Files: 3 | ||
- | bash-4.1$ du -sh /home/share/unix_files/cdat/miniconda3/envs/* | ||
- | |||
- | bash-4.1$ conda create -n cdatm16 --clone uvcdat-2.10 | ||
- | Source: /home/share/unix_files/cdat/miniconda2/envs/uvcdat-2.10 | ||
- | Destination: /home/share/unix_files/cdat/miniconda2/envs/cdatm15 | ||
[...] | [...] | ||
- | bash-4.1$ du -sh /home/share/unix_files/cdat/miniconda2 | + | $ du -sh /home/share/unix_files/cdat/miniconda3/envs/* |
- | 9.5G /home/share/unix_files/cdat/miniconda2 | + | 2.8G /home/share/unix_files/cdat/miniconda3/envs/cdat-8.0_py2 |
+ | 582M /home/share/unix_files/cdat/miniconda3/envs/cdatm17_py2 | ||
- | bash-4.1$ du -sh /home/share/unix_files/cdat/miniconda2/envs/* | ||
- | 2.8G /home/share/unix_files/cdat/miniconda2/envs/cdatm14 | ||
- | 2.8G /home/share/unix_files/cdat/miniconda2/envs/cdatm15 | ||
- | 573M /home/share/unix_files/cdat/miniconda2/envs/uvcdat-2.10 | ||
- | 2.0G /home/share/unix_files/cdat/miniconda2/envs/uvcdat-2.8.0 | ||
- | </code> | ||
- | |||
- | Disk space used after cloning, in <wrap em>in the new directory hierarchy</wrap> (''cdat/miniconda2b'', on the obelix servers) | ||
- | |||
- | <code>bash-4.2$ du -sh /home/share/unix_files/cdat/miniconda2b | ||
- | 4.8G /home/share/unix_files/cdat/miniconda2b | ||
- | |||
- | bash-4.2$ du -sh /home/share/unix_files/cdat/miniconda2b/* | ||
- | 4.4M /home/share/unix_files/cdat/miniconda2b/bin | ||
- | 4.0K /home/share/unix_files/cdat/miniconda2b/conda-bld | ||
- | 280K /home/share/unix_files/cdat/miniconda2b/conda-meta | ||
- | 3.4G /home/share/unix_files/cdat/miniconda2b/envs | ||
- | 20K /home/share/unix_files/cdat/miniconda2b/etc | ||
- | 3.8M /home/share/unix_files/cdat/miniconda2b/include | ||
- | 100M /home/share/unix_files/cdat/miniconda2b/lib | ||
- | 8.0K /home/share/unix_files/cdat/miniconda2b/LICENSE.txt | ||
- | 1.4G /home/share/unix_files/cdat/miniconda2b/pkgs | ||
- | 16K /home/share/unix_files/cdat/miniconda2b/share | ||
- | 376K /home/share/unix_files/cdat/miniconda2b/ssl | ||
- | |||
- | bash-4.2$ du -sh /home/share/unix_files/cdat/miniconda2b/envs/* | ||
- | 2.8G /home/share/unix_files/cdat/miniconda2b/envs/cdatm15 | ||
- | 574M /home/share/unix_files/cdat/miniconda2b/envs/uvcdat-2.10 | ||
</code> | </code> | ||
Line 197: | Line 157: | ||
We create a **//cdatm// symbolic link** in the ''envs'' directory, that has a //stable name// but can be moved to point to the latest default CDAT. In that case, most users can just activate this //cdatm// version and always get the latest stable version | We create a **//cdatm// symbolic link** in the ''envs'' directory, that has a //stable name// but can be moved to point to the latest default CDAT. In that case, most users can just activate this //cdatm// version and always get the latest stable version | ||
- | <code>bash-4.2$ cd /home/share/unix_files/cdat/miniconda2b/envs | + | <code>$ cd /home/share/unix_files/cdat/miniconda3/envs |
- | + | $ conda env list | |
- | bash-4.2$ conda env list | + | base * /home/share/unix_files/cdat/miniconda3 |
- | cdatm15 /home/share/unix_files/cdat/miniconda2b/envs/cdatm15 | + | cdat-8.0_py2 /home/share/unix_files/cdat/miniconda3/envs/cdat-8.0_py2 |
- | uvcdat-2.10 /home/share/unix_files/cdat/miniconda2b/envs/uvcdat-2.10 | + | cdatm17_py2 /home/share/unix_files/cdat/miniconda3/envs/cdatm17_py2 |
- | root * /home/share/unix_files/cdat/miniconda2b | + | $ ln -s cdatm17_py2 cdatm |
- | + | $ conda env list | |
- | bash-4.2$ ln -s cdatm15 cdatm | + | base * /home/share/unix_files/cdat/miniconda3 |
- | + | cdat-8.0_py2 /home/share/unix_files/cdat/miniconda3/envs/cdat-8.0_py2 | |
- | bash-4.2$ conda env list | + | cdatm /home/share/unix_files/cdat/miniconda3/envs/cdatm |
- | cdatm /home/share/unix_files/cdat/miniconda2b/envs/cdatm | + | cdatm17_py2 /home/share/unix_files/cdat/miniconda3/envs/cdatm17_py2 |
- | cdatm15 /home/share/unix_files/cdat/miniconda2b/envs/cdatm15 | + | $ source activate cdatm |
- | uvcdat-2.10 /home/share/unix_files/cdat/miniconda2b/envs/uvcdat-2.10 | + | |
- | root * /home/share/unix_files/cdat/miniconda2b | + | |
- | + | ||
- | bash-4.2$ source activate cdatm | + | |
(cdatm) bash-4.2$ conda env list | (cdatm) bash-4.2$ conda env list | ||
- | cdatm * /home/share/unix_files/cdat/miniconda2b/envs/cdatm | + | base /home/share/unix_files/cdat/miniconda3 |
- | cdatm15 /home/share/unix_files/cdat/miniconda2b/envs/cdatm15 | + | cdat-8.0_py2 /home/share/unix_files/cdat/miniconda3/envs/cdat-8.0_py2 |
- | uvcdat-2.10 /home/share/unix_files/cdat/miniconda2b/envs/uvcdat-2.10 | + | cdatm * /home/share/unix_files/cdat/miniconda3/envs/cdatm |
- | root /home/share/unix_files/cdat/miniconda2b | + | cdatm17_py2 /home/share/unix_files/cdat/miniconda3/envs/cdatm17_py2</code> |
- | </code> | + | |
===== Customizing UV-CDAT for LSCE ===== | ===== Customizing UV-CDAT for LSCE ===== |