User Tools

Site Tools


other:uvcdat:cdat_conda:cdat_2_10

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
Last revision Both sides next revision
other:uvcdat:cdat_conda:cdat_2_10 [2017/08/10 14:28]
jypeter Added cmocean and iris
other:uvcdat:cdat_conda:cdat_2_10 [2018/07/24 12:35]
jypeter Added vacumm to the extra package list
Line 209: Line 209:
 root                     /​home/​share/​unix_files/​cdat/​miniconda2b root                     /​home/​share/​unix_files/​cdat/​miniconda2b
 </​code>​ </​code>​
 +
 +===== Customizing UV-CDAT for LSCE =====
 +
  
 ==== Downloading cdms2/vcs test data ==== ==== Downloading cdms2/vcs test data ====
Line 297: Line 300:
   * [[http://​scitools.org.uk/​iris/​index.html|iris]]:​ A Python library for Meteorology and Climatology   * [[http://​scitools.org.uk/​iris/​index.html|iris]]:​ A Python library for Meteorology and Climatology
     * ''​conda install -n cdatm15 -c conda-forge -c scitools iris''​     * ''​conda install -n cdatm15 -c conda-forge -c scitools iris''​
 +  * [[http://​www.gdal.org/​|OSGeo/​GDAL]]:​ Geospatial Data Abstraction Library. GDAL is a translator library for raster and vector geospatial data formats
 +    * ''​conda install -c conda-forge gdal''​
 +    * [[https://​pcjericks.github.io/​py-gdalogr-cookbook/​|Python GDAL/OGR Cookbook]]
 +  * [[https://​github.com/​stefraynaud/​spanlib|spanlib]]:​ Spectral Analysis Library
 +    * ''​conda install -n cdatm15 -c stefraynaud -c conda-forge spanlib''​
 +    * Test: ''​python -c 'from spanlib.analyzer import Analyzer'​ ''​
 +  * [[http://​wrf-python.readthedocs.io/​en/​latest/​|wrf-python]]:​ A collection of diagnostic and interpolation routines for use with output from the Weather Research and Forecasting (WRF-ARW) Model
 +    * ''​conda install -n cdatm15 -c conda-forge wrf-python''​
 +  * [[https://​glances.readthedocs.io/​en/​stable/​index.html|glances]]:​ a cross-platform monitoring tool (similar to ''​top''​)
 +    * ''​conda install -n cdatm15 -c conda-forge glances''​
 +    * [[https://​github.com/​nicolargo/​glances|glances@github]]
 +
  
 ==== TODO ==== ==== TODO ====
Line 304: Line 319:
   * [[http://​www.ifremer.fr/​vacumm/​|vacumm]]:​ Validation, Analysis, Comparison - Utilities written in Python to validate and analyze Multi-Model outputs, and compare them to observations   * [[http://​www.ifremer.fr/​vacumm/​|vacumm]]:​ Validation, Analysis, Comparison - Utilities written in Python to validate and analyze Multi-Model outputs, and compare them to observations
     * As of August 08 2017, installing vacumm in 2.10 requires downgrading to 2.10 (see [[https://​github.com/​VACUMM/​vacumm/​issues/​9|github issue]])!     * As of August 08 2017, installing vacumm in 2.10 requires downgrading to 2.10 (see [[https://​github.com/​VACUMM/​vacumm/​issues/​9|github issue]])!
 +    * <wrap hi>​Problem solved</​wrap>​ with **vacumm 3.4.1-1** on August 31st! Installation was OK with\\ ''​conda install -n cdatm15 -c conda-forge -c vacumm vacumm''​
 +
 +  * Install PySPLIT for Sentia\\ [[https://​github.com/​mscross/​pysplit|PySPLIT]] A package for generating HYSPLIT air parcel trajectories trajectories,​ performing moisture uptake analyses, expediting HYSPLIT cluster analysis, and for visualizing trajectories,​ clusters, and along-trajectory meteorological data\\ Works with [[https://​ready.arl.noaa.gov/​HYSPLIT.php|HYSPLiT]]
 +    - ''​conda install -n cdatm15 -c conda-forge fiona geopandas''​
 +    - ''​pip install pysplit''​
  
 ==== Other packages ==== ==== Other packages ====
Line 309: Line 329:
 <note warning>​There is no warranty that the packages listed below will work correctly, because it was required to bypass the compatibility checks in order to install them...</​note>​ <note warning>​There is no warranty that the packages listed below will work correctly, because it was required to bypass the compatibility checks in order to install them...</​note>​
  
-  * NO such packages now! +  * NO such packages now! 
 + 
 +==== Updating some packages ==== 
 + 
 +Some packages change more often than others, and can be easily updated the following way: 
 + 
 +  * [[https://​cmor.llnl.gov/​|CMOR]] 
 +    * Update with: ''​conda update -n cdatm15 -c conda-forge -c pcmdi -c uvcdat cmor''​ 
 +      * Get version number with: ''​python -c 'from cmor import *; print CMOR_VERSION_MAJOR,​ CMOR_VERSION_MINOR,​ CMOR_VERSION_PATCH'​ ''​ 
 + 
 +  * [[https://​earthsystemcog.org/​projects/​wip/​CMIP6DataRequest|dreqPy]] 
 +    * Update with: ''​pip install %%--%%upgrade dreqPy''​ 
 +      * Get version number with: ''​drq -v''​ 
 + 
 +==== Cleaning up things ==== 
 + 
 +Some packages may have files that can only be read by the person who installed CDAT and the LSCE extensions (eg [[https://​github.com/​PCMDI/​pcmdi_metrics/​issues/​496|pcmdi-metrics]] in 2.8.0 and [[https://​github.com/​UV-CDAT/​cdp/​issues/​21|cdp]] in 2.10) 
 + 
 +We check if some of the installed files are missing read access for the //group// or //other//, and we manually change the permissions 
 +<​code>​(cdatm15) bash-4.2$ find cdatm15 \! -perm /g+r,o+r -ls 
 +50333969 ​   4 -rw------- ​  2 jypeter ​ lsce          234 Apr  4 20:35 cdatm15/​lib/​python2.7/​site-packages/​cdp-1.0.3-py2.7.egg-info/​PKG-INFO 
 +50333971 ​   4 -rw------- ​  2 jypeter ​ lsce          291 Apr  4 20:35 cdatm15/​lib/​python2.7/​site-packages/​cdp-1.0.3-py2.7.egg-info/​SOURCES.txt 
 +50333962 ​   4 -rw------- ​  2 jypeter ​ lsce            4 Apr  4 20:35 cdatm15/​lib/​python2.7/​site-packages/​cdp-1.0.3-py2.7.egg-info/​top_level.txt 
 +50333961 ​   4 -rw------- ​  2 jypeter ​ lsce            1 Apr  4 20:35 cdatm15/​lib/​python2.7/​site-packages/​cdp-1.0.3-py2.7.egg-info/​dependency_links.txt 
 +50333960 ​   4 -rw------- ​  2 jypeter ​ lsce            1 Apr  4 20:35 cdatm15/​lib/​python2.7/​site-packages/​cdp-1.0.3-py2.7.egg-info/​not-zip-safe 
 +50333987 ​   8 -rw------- ​  2 jypeter ​ lsce         5149 Apr  4 20:35 cdatm15/​lib/​python2.7/​site-packages/​cdp/​cdp_viewer.pyc 
 +50333986 ​   8 -rw------- ​  2 jypeter ​ lsce         4208 Apr  4 20:35 cdatm15/​lib/​python2.7/​site-packages/​cdp/​cdp_metric.py 
 +50333966 ​   4 -rw------- ​  2 jypeter ​ lsce          150 Apr  4 20:35 cdatm15/​lib/​python2.7/​site-packages/​cdp/​__init__.pyc 
 +50333968 ​   4 -rw------- ​  2 jypeter ​ lsce          201 Apr  4 20:35 cdatm15/​lib/​python2.7/​site-packages/​cdp/​cdp_provenance.py 
 +50333988 ​   8 -rw------- ​  2 jypeter ​ lsce         5365 Apr  4 20:35 cdatm15/​lib/​python2.7/​site-packages/​cdp/​cdp_metric.pyc 
 +50333982 ​   4 -rw------- ​  2 jypeter ​ lsce         1821 Apr  4 20:35 cdatm15/​lib/​python2.7/​site-packages/​cdp/​cdp_parser.py 
 +50333981 ​   4 -rw------- ​  2 jypeter ​ lsce         1773 Apr  4 20:35 cdatm15/​lib/​python2.7/​site-packages/​cdp/​cdp_parameter.py 
 +50333973 ​   4 -rw------- ​  2 jypeter ​ lsce          670 Apr  4 20:35 cdatm15/​lib/​python2.7/​site-packages/​cdp/​cdp_output.py 
 +50333980 ​   4 -rw------- ​  2 jypeter ​ lsce         1642 Apr  4 20:35 cdatm15/​lib/​python2.7/​site-packages/​cdp/​cdp_output.pyc 
 +50333979 ​   4 -rw------- ​  2 jypeter ​ lsce         1474 Apr  4 20:35 cdatm15/​lib/​python2.7/​site-packages/​cdp/​_cache.pyc 
 +50333967 ​   4 -rw------- ​  2 jypeter ​ lsce          187 Apr  4 20:35 cdatm15/​lib/​python2.7/​site-packages/​cdp/​cdp_tool.py 
 +50333989 ​   0 -rw------- ​  2 jypeter ​ lsce            0 Apr  4 20:35 cdatm15/​lib/​python2.7/​site-packages/​cdp/​__init__.py 
 +50333985 ​   4 -rw------- ​  2 jypeter ​ lsce         3843 Apr  4 20:35 cdatm15/​lib/​python2.7/​site-packages/​cdp/​cdp_viewer.py 
 +50333984 ​   4 -rw------- ​  2 jypeter ​ lsce         2436 Apr  4 20:35 cdatm15/​lib/​python2.7/​site-packages/​cdp/​cdp_parameter.pyc 
 +50333970 ​   4 -rw------- ​  2 jypeter ​ lsce          288 Apr  4 20:35 cdatm15/​lib/​python2.7/​site-packages/​cdp/​cdp_io.py 
 +50333974 ​   4 -rw------- ​  2 jypeter ​ lsce          692 Apr  4 20:35 cdatm15/​lib/​python2.7/​site-packages/​cdp/​cdp_tool.pyc 
 +50333978 ​   4 -rw------- ​  2 jypeter ​ lsce          878 Apr  4 20:35 cdatm15/​lib/​python2.7/​site-packages/​cdp/​cdp_io.pyc 
 +50333976 ​   4 -rw------- ​  2 jypeter ​ lsce          734 Apr  4 20:35 cdatm15/​lib/​python2.7/​site-packages/​cdp/​_cache.py 
 +50333983 ​   4 -rw------- ​  2 jypeter ​ lsce         2269 Apr  4 20:35 cdatm15/​lib/​python2.7/​site-packages/​cdp/​cdp_parser.pyc 
 +50333975 ​   4 -rw------- ​  2 jypeter ​ lsce          724 Apr  4 20:35 cdatm15/​lib/​python2.7/​site-packages/​cdp/​cdp_provenance.pyc 
 +(cdatm15) bash-4.2$ chmod -R a+r cdatm15/​lib/​python2.7/​site-packages/​cdp* 
 +(cdatm15) bash-4.2$ find cdatm15 \! -perm /g+r,o+r -ls</​code>​ 
  
 ===== Extra packages list ===== ===== Extra packages list =====
Line 320: Line 387:
   * [[http://​pythonhosted.org/​seawater/​|seawater]]:​ Python re-write of the CSIRO seawater toolbox   * [[http://​pythonhosted.org/​seawater/​|seawater]]:​ Python re-write of the CSIRO seawater toolbox
   * [[https://​pypi.python.org/​pypi/​gsw/​|gsw]]:​ Python implementation of the Thermodynamic Equation Of Seawater   * [[https://​pypi.python.org/​pypi/​gsw/​|gsw]]:​ Python implementation of the Thermodynamic Equation Of Seawater
 +  * [[http://​www.ifremer.fr/​vacumm/​|vacumm]]:​ Validation, Analysis, Comparison - Utilities written in Python to validate and analyze Multi-Model outputs, and compare them to observations
   * [[http://​unidata.github.io/​netcdf4-python/​|netcdf4]]:​ a Python interface to the netCDF C library   * [[http://​unidata.github.io/​netcdf4-python/​|netcdf4]]:​ a Python interface to the netCDF C library
   * [[http://​ferret.pmel.noaa.gov/​Ferret/​documentation/​pyferret|pyferret]]:​ Ferret encapsulated in    * [[http://​ferret.pmel.noaa.gov/​Ferret/​documentation/​pyferret|pyferret]]:​ Ferret encapsulated in 
Line 334: Line 402:
   * [[http://​matplotlib.org/​cmocean/​|cmocean]]:​ beautiful colormaps for oceanography   * [[http://​matplotlib.org/​cmocean/​|cmocean]]:​ beautiful colormaps for oceanography
   * [[http://​scitools.org.uk/​iris/​index.html|iris]]:​ A Python library for Meteorology and Climatology   * [[http://​scitools.org.uk/​iris/​index.html|iris]]:​ A Python library for Meteorology and Climatology
 +  * [[http://​www.gdal.org/​|OSGeo/​GDAL]]:​ Geospatial Data Abstraction Library. GDAL is a translator library for raster and vector geospatial data formats
 +  * [[https://​github.com/​stefraynaud/​spanlib|spanlib]]:​ Spectral Analysis Library
 +  * [[http://​wrf-python.readthedocs.io/​en/​latest/​|wrf-python]]:​ A collection of diagnostic and interpolation routines for use with output from the Weather Research and Forecasting (WRF-ARW) Model
 +  * [[https://​glances.readthedocs.io/​en/​stable/​index.html|glances]]:​ a cross-platform monitoring tool (similar to ''​top''​)
  
 ==== Removed packages ==== ==== Removed packages ====
Line 341: Line 413:
 ===== Environments summary ===== ===== Environments summary =====
  
-After following the steps above, we get the following environments. Use the ''​conda info --envs''​ command to get the up-to-date list of available environments+After following the steps above, we get the following environments. Use the ''​conda info %%--%%envs''​ or the ''​conda env list''​ command to get the up-to-date list of available environments
  
 ^  Environment\\ name  ^  Server ​ ^  ''​conda list'' ​ ^ ^  Environment\\ name  ^  Server ​ ^  ''​conda list'' ​ ^
other/uvcdat/cdat_conda/cdat_2_10.txt · Last modified: 2018/10/03 09:56 by jypeter