This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision Next revision Both sides next revision | ||
other:uvcdat:cdat_conda:cdat_8_2_1 [2022/02/25 10:10] jypeter [Extra packages list] Added suntime |
other:uvcdat:cdat_conda:cdat_8_2_1 [2023/02/01 15:22] jypeter [Extra packages list] Added 'gridded' |
||
---|---|---|---|
Line 259: | Line 259: | ||
dreqPy version 01.00.29 [Version 01.00.29]</code> | dreqPy version 01.00.29 [Version 01.00.29]</code> | ||
- | * [[https://github.com/PBrockmann/ipython_ferretmagic|ipython_ferretmagic]]: IPython notebook extension for ferret | + | * ''ipython_ferretmagic'': more details in the [[#extra_packages_list|Extra packages list section]] |
- | * ''conda activate cdatm19_py3''\\ ''pip install ferretmagic'' | + | |
=== Packages with no dependency problems and were added (or updated) later === | === Packages with no dependency problems and were added (or updated) later === | ||
Line 282: | Line 281: | ||
//Add here packages that would be useful and have not been installed yet, or have some problems that prevent their installation// | //Add here packages that would be useful and have not been installed yet, or have some problems that prevent their installation// | ||
- | |||
- | * [[http://scitools.org.uk/iris/index.html|iris]]: A Python library for Meteorology and Climatology | ||
- | * ''conda install -n cdatxxx -c conda-forge iris'' | ||
* [[http://wrf-python.readthedocs.io/en/latest/|wrf-python]]: A collection of diagnostic and interpolation routines for use with output from the Weather Research and Forecasting (WRF-ARW) Model | * [[http://wrf-python.readthedocs.io/en/latest/|wrf-python]]: A collection of diagnostic and interpolation routines for use with output from the Weather Research and Forecasting (WRF-ARW) Model | ||
Line 322: | Line 318: | ||
* [[http://unidata.github.io/netcdf4-python/|netcdf4]]: a Python interface to the netCDF C library | * [[http://unidata.github.io/netcdf4-python/|netcdf4]]: a Python interface to the netCDF C library | ||
- | * [[https://github.com/PBrockmann/ipython_ferretmagic|ipython_ferretmagic]]: IPython notebook extension for ferret | ||
* [[https://github.com/PCMDI/pcmdi_metrics|PCMDI metrics package]] (PMP): objectively compare results from climate models with observations using well-established statistical tests | * [[https://github.com/PCMDI/pcmdi_metrics|PCMDI metrics package]] (PMP): objectively compare results from climate models with observations using well-established statistical tests | ||
* [[https://xlsxwriter.readthedocs.io/|XlsxWriter]]: a Python module for creating Excel XLSX files | * [[https://xlsxwriter.readthedocs.io/|XlsxWriter]]: a Python module for creating Excel XLSX files | ||
Line 346: | Line 341: | ||
* ''python-cdo'' will install the ''cdo'' package (providing the ''cdo ''executable) as a dependency | * ''python-cdo'' will install the ''cdo'' package (providing the ''cdo ''executable) as a dependency | ||
* see also [[https://code.mpimet.mpg.de/projects/cdo/wiki/Cdo%7Brbpy%7D|Using CDO from python or ruby]] | * see also [[https://code.mpimet.mpg.de/projects/cdo/wiki/Cdo%7Brbpy%7D|Using CDO from python or ruby]] | ||
+ | * [[https://cds.climate.copernicus.eu/api-how-to|cdsapi]]: The Climate Data Store (CDS) Application Program Interface (API) is a service providing programmatic access to CDS data | ||
+ | * CDS = Copernicus [[https://cds.climate.copernicus.eu/|Climate Data Store]] | ||
+ | * Example: [[https://cds.climate.copernicus.eu/cdsapp#!/dataset/reanalysis-era5-pressure-levels?tab=form|ERA5 hourly data on pressure levels from 1959 to present]] | ||
* [[https://github.com/ecmwf/cfgrib|cfgrib]]: Python interface to map GRIB files to the Unidata's Common Data Model v4 following the CF Conventions | * [[https://github.com/ecmwf/cfgrib|cfgrib]]: Python interface to map GRIB files to the Unidata's Common Data Model v4 following the CF Conventions | ||
* see also ''eccodes'' and ''pygrib'' | * see also ''eccodes'' and ''pygrib'' | ||
+ | * [[https://unidata.github.io/cftime/|cftime]]: Python library for decoding time units and variable values in a netCDF file conforming to the Climate and Forecasting (CF) netCDF conventions | ||
+ | * Used with ''xarray'' | ||
* [[https://clustergram.readthedocs.io/|clustergram]]: visualization and diagnostics for cluster analysis | * [[https://clustergram.readthedocs.io/|clustergram]]: visualization and diagnostics for cluster analysis | ||
* [[https://www.fabiocrameri.ch/colourmaps/|cmcrameri]]: Crameri's Scientific colour maps ''[color]'' | * [[https://www.fabiocrameri.ch/colourmaps/|cmcrameri]]: Crameri's Scientific colour maps ''[color]'' | ||
* the colormaps are also available in [[https://jiffyclub.github.io/palettable/scientific/|palettable.scientific]] | * the colormaps are also available in [[https://jiffyclub.github.io/palettable/scientific/|palettable.scientific]] | ||
* [[http://matplotlib.org/cmocean/|cmocean]]: beautiful colormaps for oceanography ''[color]'' | * [[http://matplotlib.org/cmocean/|cmocean]]: beautiful colormaps for oceanography ''[color]'' | ||
+ | * [[https://dash.plotly.com/|dash]] and [[https://github.com/plotly/jupyter-dash|jupyter-dash]]: the original low-code framework for rapidly building data apps in Python, R, Julia, and F# | ||
+ | * see also ''plotly'' | ||
* [[https://dynamictimewarping.github.io/|python-dtw]]: implementation of Dynamic Time Warping-type (DTW) | * [[https://dynamictimewarping.github.io/|python-dtw]]: implementation of Dynamic Time Warping-type (DTW) | ||
* Note: older installations provided [[https://github.com/pierre-rouanet/dtw|dtw]]: DTW (Dynamic Time Warping) python module | * Note: older installations provided [[https://github.com/pierre-rouanet/dtw|dtw]]: DTW (Dynamic Time Warping) python module | ||
Line 357: | Line 359: | ||
* need to install ''eccodes'' and ''python-eccodes'' ([[https://github.com/ecmwf/eccodes-python/issues/56|details]]) | * need to install ''eccodes'' and ''python-eccodes'' ([[https://github.com/ecmwf/eccodes-python/issues/56|details]]) | ||
* see also ''cfgrib'' and ''pygrib'' | * see also ''cfgrib'' and ''pygrib'' | ||
+ | * [[https://docs.esmvaltool.org/en/latest/|ESMValTool]]: Earth System Model Evaluation Tool | ||
+ | * not installed yet (March 2022) because it required download of 302 Mb extra packages and a downgrade of gdal | ||
* [[http://ferret.pmel.noaa.gov/Ferret/documentation/pyferret|pyferret]] and ''ferret_datasets'': Ferret encapsulated in Python | * [[http://ferret.pmel.noaa.gov/Ferret/documentation/pyferret|pyferret]] and ''ferret_datasets'': Ferret encapsulated in Python | ||
+ | * [[https://github.com/PBrockmann/ipython_ferretmagic|ipython_ferretmagic]]: IPython notebook extension for ferret | ||
+ | * Install with: ''pip install ferretmagic'' | ||
* OSGeo/[[http://www.gdal.org/|gdal]]: Geospatial Data Abstraction Library. GDAL is a translator library for raster and vector geospatial data formats | * OSGeo/[[http://www.gdal.org/|gdal]]: Geospatial Data Abstraction Library. GDAL is a translator library for raster and vector geospatial data formats | ||
* [[https://pcjericks.github.io/py-gdalogr-cookbook/|Python GDAL/OGR Cookbook]] | * [[https://pcjericks.github.io/py-gdalogr-cookbook/|Python GDAL/OGR Cookbook]] | ||
* [[https://github.com/TEOS-10/GSW-python|gsw]]: Python implementation of the Thermodynamic Equation Of Seawater | * [[https://github.com/TEOS-10/GSW-python|gsw]]: Python implementation of the Thermodynamic Equation Of Seawater | ||
* see also //seawater// | * see also //seawater// | ||
+ | * [[https://noaa-orr-erd.github.io/gridded/index.html|gridded]]: a single API for accessing / working with gridded model results on multiple grid types | ||
+ | * Supports the [[http://cfconventions.org/|CF]], [[https://ugrid-conventions.github.io/ugrid-conventions/|UGRID]] and [[http://sgrid.github.io/sgrid/|SGRID]] conventions | ||
* [[https://intake.readthedocs.io/|intake]]: a lightweight package for finding, investigating, loading and disseminating data | * [[https://intake.readthedocs.io/|intake]]: a lightweight package for finding, investigating, loading and disseminating data | ||
* [[https://intake-esm.readthedocs.io/|intake-esm]]: data cataloging utility built on top of intake, pandas, and xarray | * [[https://intake-esm.readthedocs.io/|intake-esm]]: data cataloging utility built on top of intake, pandas, and xarray | ||
+ | * [[https://ipyleaflet.readthedocs.io/en/latest/|ipyleaflet]]: interactive maps in the Jupyter notebook | ||
+ | * [[https://ipywidgets.readthedocs.io/|ipywidgets]]: ipywidgets, also known as jupyter-widgets or simply widgets, are interactive HTML widgets for Jupyter notebooks and the IPython kernel | ||
* [[https://scitools-iris.readthedocs.io/en/stable/|iris]]: a powerful, format-agnostic, community-driven Python package for analysing and visualising Earth science data | * [[https://scitools-iris.readthedocs.io/en/stable/|iris]]: a powerful, format-agnostic, community-driven Python package for analysing and visualising Earth science data | ||
* see also ''cartopy'' | * see also ''cartopy'' | ||
* install sample data with ''conda install -c conda-forge iris-sample-data'' | * install sample data with ''conda install -c conda-forge iris-sample-data'' | ||
* [[https://joblib.readthedocs.io/en/latest/|joblib]]: running Python functions as pipeline jobs | * [[https://joblib.readthedocs.io/en/latest/|joblib]]: running Python functions as pipeline jobs | ||
+ | * [[https://jupyterlab.readthedocs.io/|jupyterlab]]: the next-generation web-based user interface for Project Jupyter | ||
+ | * [[https://github.com/plotly/Kaleido|python-kaleido]]: a cross-platform library for generating static images (e.g. png, svg, pdf, etc.) for web-based visualization libraries | ||
+ | * [[https://mpltern.readthedocs.io/|mpltern]]: a Python plotting library based on Matplotlib specifically designed for ternary plots | ||
+ | * [[https://nc-time-axis.readthedocs.io/en/stable/|nc-time-axis]]: a package that enables making plots in matplotlib with axes made up of ''cftime.datetime'' dates with any calendar type | ||
+ | * [[https://gitlab.com/remikz/nccmp|nccmp]]: compare two NetCDF files bitwise, semantically or with a user defined tolerance (absolute or relative percentage) | ||
+ | * can probably also be done with [[https://code.mpimet.mpg.de/projects/cdo/embedded/index.html#x1-580002.1.3|cdo -v diffn file1.nc file2.nc]] | ||
* [[https://opencv.org/|OpenCV]]: OpenCV (Open Source Computer Vision Library) is an open-source library that includes several hundreds of computer vision algorithms. See also [[https://www.geeksforgeeks.org/opencv-python-tutorial/|OpenCV Python Tutorial]] and **scikit-image** | * [[https://opencv.org/|OpenCV]]: OpenCV (Open Source Computer Vision Library) is an open-source library that includes several hundreds of computer vision algorithms. See also [[https://www.geeksforgeeks.org/opencv-python-tutorial/|OpenCV Python Tutorial]] and **scikit-image** | ||
* [[https://jiffyclub.github.io/palettable/|Palettable]]: Color palettes for Python ''[color]'' | * [[https://jiffyclub.github.io/palettable/|Palettable]]: Color palettes for Python ''[color]'' | ||
Line 374: | Line 390: | ||
* [[https://peakutils.readthedocs.io/|PeakUtils]]: utilities related to the detection of peaks on 1D data | * [[https://peakutils.readthedocs.io/|PeakUtils]]: utilities related to the detection of peaks on 1D data | ||
* [[https://python-pillow.org/|pillow]]: the friendly PIL (//Python Imaging Library//) fork | * [[https://python-pillow.org/|pillow]]: the friendly PIL (//Python Imaging Library//) fork | ||
+ | * [[https://plotly.com/python/|plotly]]: Plotly's Python graphing library (sometimes referred to as //plotly.py//) makes interactive, publication-quality graphs | ||
+ | * see also ''python-kaleido'' and ''dash'' | ||
+ | * [[https://www.fatiando.org/pooch/|pooch]]: a friend to fetch your data files (makes it easy to download a file, without messing with ''requests'' and ''urllib'') | ||
* [[https://proplot.readthedocs.io/en/latest/|proplot]]: a lightweight **matplotlib wrapper** for making beautiful, publication-quality graphics | * [[https://proplot.readthedocs.io/en/latest/|proplot]]: a lightweight **matplotlib wrapper** for making beautiful, publication-quality graphics | ||
* [[https://github.com/jswhit/pygrib|pygrib]]: high-level interface to the ECWMF ECCODES C library for reading GRIB files | * [[https://github.com/jswhit/pygrib|pygrib]]: high-level interface to the ECWMF ECCODES C library for reading GRIB files | ||
* see also ''eccodes'' and ''cfgrib'' | * see also ''eccodes'' and ''cfgrib'' | ||
+ | * [[https://pyleoclim-util.readthedocs.io/|pyleoclim]]: a Python package designed for the analysis of paleoclimate data | ||
+ | * **Wait** till it can be installed with ''conda'' ([[https://github.com/LinkedEarth/Pyleoclim_util/discussions/205|Why I'm not installing Pyleoclim yet]]) | ||
+ | * [[https://requests.readthedocs.io/|requests]]: is an elegant and simple HTTP library for Python, built for human beings | ||
+ | * See also ''pooch'' | ||
* [[https://rpy2.github.io/|rpy2]]: an interface to R running embedded in a Python process | * [[https://rpy2.github.io/|rpy2]]: an interface to R running embedded in a Python process | ||
* [[http://scikit-image.org/|scikit-image]]: a collection of algorithms for image processing in Python | * [[http://scikit-image.org/|scikit-image]]: a collection of algorithms for image processing in Python | ||
Line 382: | Line 405: | ||
* [[https://seaborn.pydata.org/|seaborn]]: statistical data visualization | * [[https://seaborn.pydata.org/|seaborn]]: statistical data visualization | ||
* [[http://pythonhosted.org/seawater/|seawater]]: Python re-write of the CSIRO seawater toolbox | * [[http://pythonhosted.org/seawater/|seawater]]: Python re-write of the CSIRO seawater toolbox | ||
- | * see also //gsw// | + | * see also ''gsw'' |
* [[https://www.statsmodels.org/|statsmodels]]: a Python module that provides classes and functions for the estimation of many different statistical models, as well as for conducting statistical tests, and statistical data exploration. | * [[https://www.statsmodels.org/|statsmodels]]: a Python module that provides classes and functions for the estimation of many different statistical models, as well as for conducting statistical tests, and statistical data exploration. | ||
* [[https://github.com/SatAgro/suntime|suntime]]: simple sunset and sunrise time calculation python library | * [[https://github.com/SatAgro/suntime|suntime]]: simple sunset and sunrise time calculation python library | ||
Line 388: | Line 411: | ||
* [[https://www.tensorflow.org/|tensorflow-mkl]]: an end-to-end open source machine learning platform | * [[https://www.tensorflow.org/|tensorflow-mkl]]: an end-to-end open source machine learning platform | ||
* [[https://anaconda.org/anaconda/tensorflow-mkl|tensorflow-mkl]] will install the **CPU**-based (**not GPU**) version | * [[https://anaconda.org/anaconda/tensorflow-mkl|tensorflow-mkl]] will install the **CPU**-based (**not GPU**) version | ||
+ | * [[https://github.com/tqdm|tqdm]]: make your loops show a smart progress meter | ||
+ | * [[https://uxarray.readthedocs.io/|uxarray]]: provide xarray styled functionality for unstructured grid datasets following [[https://ugrid-conventions.github.io/ugrid-conventions/|UGRID Conventions]] | ||
+ | * [[https://docs.xarray.dev/en/stable/|xarray]]: Xarray makes working with labelled multi-dimensional arrays in Python simple, efficient, and fun! | ||
* [[https://xcdat.readthedocs.io/|xcdat]]: Xarray Extended with Climate Data Analysis Tools | * [[https://xcdat.readthedocs.io/|xcdat]]: Xarray Extended with Climate Data Analysis Tools | ||
* [[https://xoa.readthedocs.io/en/latest/|xoa]]: xarray-based ocean analysis library | * [[https://xoa.readthedocs.io/en/latest/|xoa]]: xarray-based ocean analysis library |