User Tools

Site Tools


other:uvcdat:installed

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
other:uvcdat:installed [2014/08/01 15:41]
jypeter Started the 2.0.beta section
other:uvcdat:installed [2017/04/04 08:30] (current)
jypeter [UV-CDAT versions installed by JYP] Added link to "UV-CDAT Build 101"
Line 1: Line 1:
 ====== UV-CDAT versions installed by JYP ====== ====== UV-CDAT versions installed by JYP ======
  
-<note tip> + 
-[[https://​github.com/​UV-CDAT/​uvcdat/​wiki/​Roadmap-to-Release|Official list of available versions]]</​note>+<WRAP center round important 60%> 
 +This page describes versions of UV-CDAT installed by JYP, up to 2.1.0 
 + 
 +For more recent versions, 2.8.0 and later, check the [[.cdat_conda:​index|UV-CDAT conda versions installed by JYP]] page 
 +</​WRAP>​ 
 + 
 +<WRAP center round tip 60%
 +[[https://​github.com/​UV-CDAT/​uvcdat/​wiki/​Roadmap-to-Release|Official list of available versions]] 
 +</WRAP> 
 + 
 +<WRAP center round tip 60%> 
 +Installation tutorial for UV-CDAT up to 2.4.0 
 + 
 +[[https://​docs.google.com/​presentation/​d/​1U8RSmzoIKfQlwrXeJUbFRZPXYv6yxr1OO82QyV1cz2s/​edit#​slide=id.p14|UV-CDAT Build 101]] 
 +</​WRAP>​ 
 + 
  
 ===== Useful links ===== ===== Useful links =====
Line 8: Line 24:
   * [[https://​github.com/​UV-CDAT/​uvcdat|UV-CDAT @ github]]   * [[https://​github.com/​UV-CDAT/​uvcdat|UV-CDAT @ github]]
   * [[https://​github.com/​UV-CDAT/​uvcdat/​issues?​state=open|UV-CDAT issues @ github]]   * [[https://​github.com/​UV-CDAT/​uvcdat/​issues?​state=open|UV-CDAT issues @ github]]
 +
 +===== 2.1.0 =====
 +
 +Official details : 
 +
 +cdat_multi configuration version: 13
 +
 +==== Available configurations ====
 +
 +^  Machine ​ ^  Config ​ ^  Python/​date ​ ^ Notes  ^
 +|  LSCE  |  LSCE_13 ​ |  2.7.8, Jan 22 2015  | **Red Hat Enterprise Linux Server release 6.6 (Santiago)**\\ Used system'​s cmake (2.8.12.2) and the same recompiled Qt (4.8.5) used for uv-cdat 1.5.1 |
 +|  ciclad ​ |  ciclad_13 ​ |  2.7.8, Feb  5 2015  | **Scientific Linux release 6.6 (Carbon)**\\ Used system'​s cmake (2.8.12.2) and the same recompiled Qt (4.8.5) used for uv-cdat 1.5.1 |
 +|  VirtualBox\\ FC20  |  VB_13  |  2.7.8, Feb  2 2015  | **Fedora release 20 (Heisenbug)**\\ Used system'​s cmake (2.8.12.2) and Qt (4.8.6-18.fc20.x86_64) |
 +
 +==== Log files ====
 +
 +^  Machine ​ ^  make  ^  ctest  ^
 +|  LSCE  | {{:​other:​uvcdat:​|txt}} | {{:​other:​uvcdat:​|txt}} |
 +|  ciclad | {{:​other:​uvcdat:​|txt}} | {{:​other:​uvcdat:​|txt}} |
 +|  VirtualBox\\ FC20  | {{:​other:​|txt}} | {{:​other:​|txt}} |
 +
 +=== make summary ===
 +
 +<​code>​
 +              --- WARNING ---
 +
 +2 Packages reported as FAILED, see logs
 +
 +                contrib/​pyclimate
 +                contrib/MSU
 +</​code>​
 +
 +
 +=== ctest summary ===
 +
 +In a new installation,​ test #343 (//​diags_test_01//​) will **fail** the first time **ctest** is called because the test data in the **UVCMETRICS_TEST_DATA_DIRECTORY** directory is not available
 +
 +<​code>​
 +99% tests passed, 1 tests failed out of 343
 +
 +Total Test time (real) = 478.10 sec
 +
 +The following tests FAILED:
 +        343 - diags_test_01 (Failed)
 +Errors while running CTest
 +</​code>​
 +
 +If you run **ctest -D Experimental**,​ the test data is downloaded and all tests pass!
 +
 +<​code>​
 +100% tests passed, 0 tests failed out of 343
 +
 +Total Test time (real) = 697.55 sec
 +</​code>​
 +
 +==== ccmake options ====
 +
 +
 +<​code>​
 +ccmake -D GIT_PROTOCOL=git://​ -DCDAT_BUILD_MODE=DEFAULT -DCDAT_BUILD_CMOR=ON -D CMAKE_INSTALL_PREFIX=$CDAT_INSTALL ​  -D CDAT_BUILD_BASEMAP=ON -D CDAT_BUILD_MATPLOTLIB=ON -D CDAT_BUILD_SCIENTIFICPYTHON=ON -D CDAT_BUILD_SCIKITS=ON -D CDAT_BUILD_SHAPELY=ON -D CDAT_BUILD_JINJA2=ON -D CDAT_BUILD_PYGMENTS=ON -D CDAT_BUILD_PYZMQ=ON -D CDAT_BUILD_SPHINX=ON -D CDAT_BUILD_TORNADO=ON -D UVCMETRICS_TEST_DATA_DIRECTORY=/<​some_scratch_directory>/​uvcmetrics_test_data -D CDAT_BUILD_LIBXML2=OFF -D CDAT_USE_SYSTEM_LIBXML2=ON -D CDAT_BUILD_LIBXSLT=OFF -D CDAT_USE_SYSTEM_LIBXSLT=ON ​  ​$CDAT_MAIN_DIR
 +</​code>​
 +
 +=== BUILD_TESTING ===
 +
 +Note: we have **not** explicitly requested to turn on the testing, because it is supposed to be //ON// by default
 +
 +=== GIT_PROTOCOL ===
 +
 +We have used **-D GIT_PROTOCOL=git:​%%//​%%**. See the [[#​section151|1.5.1 options]] for more details
 +
 +=== CDAT_BUILD_MODE ===
 +
 +We want to get //most of the useful stuff//. Check [[https://​github.com/​UV-CDAT/​uvcdat/​wiki/​Install-from-source-command-line-options|Install from source command line options]] for more details
 +
 +**-DCDAT_BUILD_MODE=DEFAULT**
 +
 +=== CDAT_BUILD_CMOR ===
 +
 +We need to experiment with CMOR...
 +
 +**-DCDAT_BUILD_CMOR=ON**
 +
 +=== Misc options ===
 +
 +^  What do we want?  ^  ccmake option ​ ^
 +| basemap | -D CDAT_BUILD_BASEMAP=ON |
 +| matplotlib | -D CDAT_BUILD_MATPLOTLIB=ON |
 +| [[http://​dirac.cnrs-orleans.fr/​plone/​software/​scientificpython/​|scientificpython]] | -D CDAT_BUILD_SCIENTIFICPYTHON=ON |
 +| sckikits\\ if we want to experiment later with scikit image| -D CDAT_BUILD_SCIKITS=ON |
 +| shapely seems useful for dealing with data on irregular grids | -D CDAT_BUILD_SHAPELY=ON |
 +| ipython notebook\\ some users may want to play with that | -D CDAT_BUILD_JINJA2=ON -D CDAT_BUILD_PYGMENTS=ON -D CDAT_BUILD_PYZMQ=ON -D CDAT_BUILD_SPHINX=ON -D CDAT_BUILD_TORNADO=ON |
 +
 +=== UVCMETRICS_TEST_DATA_DIRECTORY ===
 +
 +**-D UVCMETRICS_TEST_DATA_DIRECTORY=/<​some_scratch_directory>/​uvcmetrics_test_data**
 +
 +The content of this directory is required for ctest **Test #343: diags_test_01** to pass. Strangely, it is only downloaded when you run **ctest -D Experimental**,​ so **ctest** (without //-D Experimental//​) fails test #343 the first time... ​
 +
 +=== LIBXML2 & LIBXSLT ===
 +
 +We have tried to use the system'​s installed //libxml2// and //libxslt// libraries by using the following options:
 +
 +**-D CDAT_BUILD_LIBXML2=OFF -D CDAT_USE_SYSTEM_LIBXML2=ON -D CDAT_BUILD_LIBXSLT=OFF -D CDAT_USE_SYSTEM_LIBXSLT=ON**
 +
 +Unfortunately,​ uvcdat still compiles the new version of the libraries, and then the system'​s cmake gets confused and we get **lots** of warning messages of the following kind each time cmake is called. See [[https://​github.com/​UV-CDAT/​uvcdat/​issues/​444|issue 444]] for more details
 +
 +<​code>​
 +cmake --version
 +cmake: /​home/​share/​unix_files/​cdat/​versions/​cdat_install_uv-2.1.0_x86_64_gcc4_13/​Externals/​lib/​libxml2.so.2:​ no version information available (required by /​usr/​lib64/​libarchive.so.2)
 +cmake: /​home/​share/​unix_files/​cdat/​versions/​cdat_install_uv-2.1.0_x86_64_gcc4_13/​Externals/​lib/​libxml2.so.2:​ no version information available (required by /​usr/​lib64/​libarchive.so.2)
 +cmake: /​home/​share/​unix_files/​cdat/​versions/​cdat_install_uv-2.1.0_x86_64_gcc4_13/​Externals/​lib/​libxml2.so.2:​ no version information available (required by /​usr/​lib64/​libarchive.so.2)
 +cmake: /​home/​share/​unix_files/​cdat/​versions/​cdat_install_uv-2.1.0_x86_64_gcc4_13/​Externals/​lib/​libxml2.so.2:​ no version information available (required by /​usr/​lib64/​libarchive.so.2)
 +cmake version 2.8.12.2
 +</​code>​
 +
 +==== System specific notes ====
 +
 +=== VB_13 installation ===
 +
 +  * During the compilation,​ make fails because of the VTK/​Mesa/​OpenGL/​FedoraCore20 related problem detailed in [[https://​github.com/​UV-CDAT/​uvcdat/​issues/​983|issue 983]]\\ \\ Solution: uncomment the **#define GLX_GLXEXT_LEGACY** line in //​build/​build/​VTK/​Rendering/​OpenGL/​vtkXOpenGLRenderWindow.cxx//​ and restart the compilation
 +
 +  * After resuming the compilation with the above patch, the compilation fails because of a CMOR related make/​Makefile error described in [[https://​github.com/​PCMDI/​cmor/​issues/​14|CMOR issue 14]]\\ \\ Solution: indent lines 156 and 157 with a **Tab** instead of 8 spaces in build/​build/​cmor/​Makefile and restart the compilation
 +
 +==== Disk space ====
 +
 +The following disk space was required for the installation
 +
 +^  Machine ​ ^  -A-\\ \\ cmake compile\\ (1)  ^  -B-\\ \\ cmake install ​ ^  -C-\\ \\ qt compile\\ (1)  ^  -D-\\ \\ qt install ​ ^  -E-\\ \\ cdat src\\ (2?)  ^  -F-\\ \\ cdat build\\ (2)  ^  -G-\\ \\ cdat install\\ (2)  ^  -H-\\ \\ Externals\\ ​ (3)\\  Sub-dir of install ​ ^  -I-\\ \\ Installation\\ space\\ ​ (4)  ^  -J-\\ \\ Final\\ space\\ (5)  ^
 +|  LSCE  |  0 (6)  |  0 (6)  |  1.6G  |  451M  |    |    |    |    |    |    |
 +|  ciclad ​ |  0 (6)  |  0 (6)  |  ?  |  455M  |  578M  |  4.7G  |  1.6G  |  545M  |  7.3  |  2.0  |
 +|  VirtualBox\\ FC20  |  0 (6)  |  0 (6)  |  0 (6)  |  0 (6)  |  565M  |  5.0G  |  1.7G  |  511M  |  7.3  |  1.7  |
 +
 +Notes:
 +  * (1) The compilation directories of cmake and Qt can be removed once the installation of cmake/Qt is finished (ie can be removed before starting with uv-cdat)
 +  * (2) The packages required for the GUI, and Paraview, were not installed and would probably require even more space
 +  * (3) The size of this directory can change depending on the dependencies use from what's already available on the system (xml2 and xslt in this installation) and what we recompile
 +  * (4) Sum of the columns, if we erase the A/C directories:​ B + D + E + F + G
 +  * (5) Sum of the columns, if we erase the B/E/F directories:​ D + G
 +  * (6) We used the version available on the system (that was enough up-to-date)
 +
 +
 +
 +===== 2.0.0 =====
 +
 +Official details : 
 +
 +cdat_multi configuration version: 12
  
 ===== 2.0.beta ===== ===== 2.0.beta =====
Line 18: Line 181:
  
 ^  Machine ​ ^  Config ​ ^  Python/​date ​ ^ Notes  ^ ^  Machine ​ ^  Config ​ ^  Python/​date ​ ^ Notes  ^
 +|  LSCE  |  LSCE_11 ​ |  2.7.7, Aug  1 2014  | Used the same recompiled cmake and Qt as for 1.5.1 |
 +|  ciclad |  ciclad_11-ng ​ |  2.7.7, Aug  4 2014  | Used the same recompiled cmake and Qt as for 1.5.1 |
  
 ==== Log files ==== ==== Log files ====
  
 ^  Machine ​ ^  make  ^  ctest  ^ ^  Machine ​ ^  make  ^  ctest  ^
 +|  LSCE  | {{:​other:​uvcdat:​lsce_cdat_make_uv-2.0.beta_x86_64_gcc4_20140801_1801.txt|txt}} | {{:​other:​uvcdat:​lsce_cdat_ctest_uv-2.0.beta_x86_64_gcc4_20140804_1209.txt|txt}} |
 +|  ciclad-ng ​ | {{:​other:​uvcdat:​ciclad-ng_cdat_make_uv-2.0.beta_x86_64_gcc4_20140804_1725.txt|txt}} | {{:​other:​uvcdat:​ciclad-ng_cdat_ctest_uv-2.0.beta_x86_64_gcc4_20140805_1017.txt|txt}} |
  
 === make summary === === make summary ===
 +
 +<​code>​
 +2 Packages reported as FAILED, see logs
 +
 +                contrib/​pyclimate
 +                contrib/MSU
 +</​code>​
 +
  
 === ctest summary === === ctest summary ===
 +
 +<​code>​
 +53% tests passed, 35 tests failed out of 74
 +
 +Total Test time (real) = 1020.63 sec
 +
 +The following tests FAILED:
 +          2 - cdms_test (Failed)
 +          3 - cdms_verify (Failed)
 +          4 - cdms_load_and_plot_axis_variable (Failed)
 +          5 - run_uvcdat_gui_tests (Failed)
 +          6 - test177_regrid_mask (Failed)
 +          8 - testDoutriaux (Failed)
 +          9 - testMarvel (Failed)
 +         10 - testUnits (Failed)
 +         11 - testRaynaud (Failed)
 +         12 - testDateline (Failed)
 +         14 - testDiag (Failed)
 +         15 - testSo2TasACCESSFails (Failed)
 +         16 - testSo2Tas (Failed)
 +         17 - testWrite (Failed)
 +         18 - testMvCdmsRegrid (Failed)
 +         21 - testConserv (Failed)
 +         22 - testEsmfVsLibcf (Failed)
 +         23 - testEsmfInterface1 (Failed)
 +         28 - testTasRegrid (Failed)
 +         30 - testRegrid2 (Failed)
 +         34 - testEsmf_3x4_6x8_Conserve_Masked (Failed)
 +         36 - testMvGenericRegrid (Failed)
 +         37 - testSalinity (Failed)
 +         38 - testEsmfSalinity (Failed)
 +         39 - testEsmf (Failed)
 +         40 - testBergman (Failed)
 +         41 - testDistSrc (Failed)
 +         43 - vcs_verify_import (Failed)
 +         44 - vcs_verify_init (Failed)
 +         45 - vcs_verify_boxfill_basics (Failed)
 +         46 - vcs_verify_proj_basics (Failed)
 +         47 - vcs_verify_fillarea_basics (Failed)
 +         66 - CDMS_Test_17 (Failed)
 +         68 - CDMS_Test_multiple_formats (Failed)
 +         74 - diags_test_01 (Failed)
 +</​code>​
  
 ==== ccmake options ==== ==== ccmake options ====
Line 50: Line 268:
 The following disk space was required for the installation The following disk space was required for the installation
  
 +==== Extra packages installed ====
  
 +=== Requests: HTTP for Humans ===
 +
 +Web site: http://​docs.python-requests.org/​en/​latest/​
 +
 +Install: ''​pip install requests''​
  
  
Line 58: Line 282:
  
 cdat_multi configuration version: 10 cdat_multi configuration version: 10
 +
 +==== Special warning ====
 +
 +The default backend for matplotlib (Agg) could not be used for interactive graphics and we had to manually update the content of the default matplotlibrc
 +
 +<​code>​
 +<​INSTALL>/​lib/​python2.7/​site-packages/​matplotlib/​mpl-data/​matplotlibrc
 +
 +#​backend ​     : Agg
 +backend ​     : Qt4Agg
 +</​code>​
  
 ==== Available configurations ==== ==== Available configurations ====
other/uvcdat/installed.1406907670.txt.gz · Last modified: 2014/08/01 15:41 by jypeter