This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision Next revision Both sides next revision | ||
other:uvcdat:cdat_conda:cdat_8_2_1 [2021/03/06 21:13] jypeter [Installing CDAT 8.2.1] added nompi package list |
other:uvcdat:cdat_conda:cdat_8_2_1 [2021/03/08 20:47] jypeter Added geopandas |
||
---|---|---|---|
Line 1: | Line 1: | ||
- | ====== CDAT 8.2.1 installation notes ====== | + | ====== Python distribution based on CDAT 8.2.1 notes ====== |
[ [[.:index|Back to all versions]] ] | [ [[.:index|Back to all versions]] ] | ||
Line 11: | Line 11: | ||
===== Using JYP version ===== | ===== Using JYP version ===== | ||
- | If you mostly want to use the CDAT 8.2.1 installed by JYP, just use the following steps and then read the //What should I do now?// section below | + | If you mostly want to use the **python distribution based on CDAT 8.2.1** installed by JYP, just use the following steps and then read the [[#what_should_i_do_now|What should I do now?]] section below |
* Initialize //conda// with: | * Initialize //conda// with: | ||
Line 23: | Line 23: | ||
* python 3.x: ''conda activate cdatm_py3'' | * python 3.x: ''conda activate cdatm_py3'' | ||
- | * Type ''which python'' (or the ''wp'' alias) and make sure you get something like\\ ''[...]/miniconda3/envs/env_name/bin/python'' | + | * Type ''which python'' (or the ''wp'' alias) and make sure you get something looking like |
+ | * ''[...]/miniconda3<possibly_some_version>/envs/<some_env_name>/bin/python'' | ||
+ | * e.g. ''cdatm_py3'' environment at LSCE:\\ ''/home/share/unix_files/cdat/miniconda3_21-02/envs/cdatm_py3/bin/python'' | ||
Line 40: | Line 42: | ||
==== You want to replicate this installation on your own server or desktop/laptop ==== | ==== You want to replicate this installation on your own server or desktop/laptop ==== | ||
+ | Read the next sections of this web page | ||
+ | |||
+ | There are some slight differences if you want to install this distribution: | ||
+ | * just for you. This is the usual case. Well, if you break something you can always remove everything and start from scratch | ||
+ | * for sharing a stable version with several other people | ||
+ | |||
+ | The notes at the beginning of each section will tell you if you can skip the section if you are just installing for you | ||
===== What's New in CDAT 8.2.1? ===== | ===== What's New in CDAT 8.2.1? ===== | ||
Line 45: | Line 54: | ||
* Full [[https://uvcdat.llnl.gov/changelog.html#8.2.1|Change log]] | * Full [[https://uvcdat.llnl.gov/changelog.html#8.2.1|Change log]] | ||
- | Note: this particular CDAT installation at LSCE (and on other machines/servers) provides **many extra (non-CDAT) packages**. You can jump directly to the [[#extra_packages_list|Extra package list]] at the bottom of this page to see what is available | + | Note: this particular CDAT installation at LSCE (and on other machines/servers) provides **many extra (non-CDAT) packages**. You can jump directly to the [[#extra_packages_list|Extra package list]] at the bottom of this page, if you want to see what is available |
===== Installation with Miniconda3 ===== | ===== Installation with Miniconda3 ===== | ||
- | We assume that Miniconda3 is already installed. Otherwise, follow the the [[other:uvcdat:cdat_conda:cdat_8_0_py2#installing_miniconda3|Installing Miniconda]] steps (and the //Post-Miniconda3 installation// section) we followed when installing CDAT 8.0 | + | ==== Installing Miniconda3 ==== |
+ | |||
+ | If //Miniconda3// is not already installed, or if you want to start over with a brand new version, read [[other:uvcdat:cdat_conda:miniconda3_install|JYP steps for installing Miniconda3]]. | ||
- | ==== Updating conda ==== | ||
- | The conda package itself can be updated (if need be) with\\ ''conda update -n base -c defaults conda'' | ||
==== Installing CDAT 8.2.1 ==== | ==== Installing CDAT 8.2.1 ==== | ||
Line 218: | Line 227: | ||
=== Pre-installation check with the dry-run option === | === Pre-installation check with the dry-run option === | ||
- | <code>/usr/bin/time mamba install -n cdatm19_nompi_py3 --dry-run -c conda-forge basemap basemap-data-hires cartopy cmocean cmor ferret_datasets gdal gdal glances gsw iris joblib netcdf4 palettable pandas pillow pyferret rpy2 scikit-image scikit-learn seaborn seawater shapely spyder statsmodels windspharm wrf-python xarray xlsxwriter | + | <code>/usr/bin/time mamba install -n cdatm19_nompi_py3 --dry-run -c conda-forge basemap basemap-data-hires cartopy cmocean cmor ferret_datasets gdal gdal geopandas glances gsw iris joblib netcdf4 palettable pandas pillow pyferret rpy2 scikit-image scikit-learn seaborn seawater shapely spyder statsmodels windspharm wrf-python xarray xlsxwriter |
[... lots of information about what would be done followed by some information about how long it took ...] | [... lots of information about what would be done followed by some information about how long it took ...] | ||
Line 235: | Line 244: | ||
=== Actual installation === | === Actual installation === | ||
- | <code>/usr/bin/time mamba install -n cdatm19_nompi_py3 -c conda-forge basemap basemap-data-hires cartopy cmocean cmor ferret_datasets gdal gdal glances gsw iris joblib netcdf4 palettable pandas pillow pyferret rpy2 scikit-image scikit-learn seaborn seawater shapely spyder statsmodels windspharm wrf-python xarray xlsxwriter</code> | + | <code>/usr/bin/time mamba install -n cdatm19_nompi_py3 -c conda-forge basemap basemap-data-hires cartopy cmocean cmor ferret_datasets gdal gdal geopandas glances gsw iris joblib netcdf4 palettable pandas pillow pyferret rpy2 scikit-image scikit-learn seaborn seawater shapely spyder statsmodels windspharm wrf-python xarray xlsxwriter</code> |
- | List of installed packages: {{ :other:uvcdat:cdat_conda:lsce-extra_01_install_190304.txt |}} | + | Resulting list of installed packages |
+ | * ''conda list -n cdatm19_nompi_py3 > cdatm19_nompi_py3_21-03-06.txt'' | ||
+ | * no mpi: {{ :other:uvcdat:cdat_conda:cdatm19_nompi_py3_21-03-06.txt |}} | ||
=== Extra packages installed with pip === | === Extra packages installed with pip === | ||
Line 323: | Line 334: | ||
* [[http://statsmodels.sourceforge.net/|statsmodels]]: a Python module that allows users to explore data, estimate statistical models, and perform statistical tests | * [[http://statsmodels.sourceforge.net/|statsmodels]]: a Python module that allows users to explore data, estimate statistical models, and perform statistical tests | ||
* [[https://seaborn.pydata.org/|seaborn]]: statistical data visualization | * [[https://seaborn.pydata.org/|seaborn]]: statistical data visualization | ||
- | * [[http://scikit-image.org/|scikit-image]]: image processing in Python | ||
* [[http://pythonhosted.org/seawater/|seawater]]: Python re-write of the CSIRO seawater toolbox | * [[http://pythonhosted.org/seawater/|seawater]]: Python re-write of the CSIRO seawater toolbox | ||
* [[https://pypi.python.org/pypi/gsw/|gsw]]: Python implementation of the Thermodynamic Equation Of Seawater | * [[https://pypi.python.org/pypi/gsw/|gsw]]: Python implementation of the Thermodynamic Equation Of Seawater | ||
Line 341: | Line 351: | ||
* [[https://rpy2.readthedocs.io/en/version_2.8.x/|rpy2]]: providing simple and robust access to R from within Python | * [[https://rpy2.readthedocs.io/en/version_2.8.x/|rpy2]]: providing simple and robust access to R from within Python | ||
* [[http://matplotlib.org/cmocean/|cmocean]]: beautiful colormaps for oceanography | * [[http://matplotlib.org/cmocean/|cmocean]]: beautiful colormaps for oceanography | ||
- | * [[http://www.gdal.org/|OSGeo/GDAL]]: Geospatial Data Abstraction Library. GDAL is a translator library for raster and vector geospatial data formats | ||
- | * [[https://pcjericks.github.io/py-gdalogr-cookbook/|Python GDAL/OGR Cookbook]] | ||
* [[https://github.com/stefraynaud/spanlib|spanlib]]: Spectral Analysis Library | * [[https://github.com/stefraynaud/spanlib|spanlib]]: Spectral Analysis Library | ||
* [[https://ajdawson.github.io/windspharm/latest/|windspharm]]: spherical harmonic wind analysis in Python | * [[https://ajdawson.github.io/windspharm/latest/|windspharm]]: spherical harmonic wind analysis in Python | ||
Line 348: | Line 356: | ||
* [[https://joblib.readthedocs.io/en/latest/|joblib]]: running Python functions as pipeline jobs | * [[https://joblib.readthedocs.io/en/latest/|joblib]]: running Python functions as pipeline jobs | ||
* [[https://jiffyclub.github.io/palettable/|Palettable]]: Color palettes for Python | * [[https://jiffyclub.github.io/palettable/|Palettable]]: Color palettes for Python | ||
+ | |||
+ | |||
+ | * [[http://www.gdal.org/|OSGeo/GDAL]]: Geospatial Data Abstraction Library. GDAL is a translator library for raster and vector geospatial data formats | ||
+ | * [[https://pcjericks.github.io/py-gdalogr-cookbook/|Python GDAL/OGR Cookbook]] | ||
+ | * [[https://geopandas.org/|geopandas]]: an open source project to make working with geospatial data in python easier. | ||
+ | * [[http://scikit-image.org/|scikit-image]]: image processing in Python | ||
+ | * [[https://scikit-learn.org/stable/index.html|scikit-learn]]: Machine Learning in Python | ||
==== Removed packages ==== | ==== Removed packages ==== |