Last updated: 2009
The project was completed during March 2009. Its aim was the development of a common and unified verification 'library' including a Conditional Verification tool. This library will be included in the public COSMO software.
A VERSUS tutorial seminar took place in 16-18 February 2009 at Rome. All the participants and WG5 people interested, can ftp all the presentations from the ftp.meteoam.it site. (using username: cosmo and password: Cosmo0)
Note: this priority project was called CV (Common Conditional Verification package & library), but is was renamed to avoid confusion with the CVS Working package.
The development of a already complete Conditional Verification Tool will be the first priority and outcome of this project (see Summary of the joint WG3-5 workshop held on 09/03/2005 in Langen)
The main purpose was the systematic evaluation of model performances in order to reveal, in a way different from the usual classical verification tools. Once delivered and applied routinely, it should provide information straight to the WG[1-3] scientists to provide them hints which could be the causes of model deficiencies that can be seen in the operational verification.
When completed it should be easily possible to turn out a common and unified verification library, useful for all COSMO community for operational and research points of view.
The typical approach to CV could consist of the selection of one or several forecast products and one or several mask variables or conditions, which would be used to define thresholds for the product verification (e.g. verification of T2M only for grid points with zero cloud cover in model and observations). After the selection of the desired conditions, a classical verification tools to turn out statistical indexes can be used.
The more flexible way to perform a selection of forecasts and observations following a certain number of conditions is to use an 'ad hoc database', planned and designed for this purpose, where the mask or filter could be simply or complex SQL statements.
The project has started on January 2006 and finished in March 2009. The work was divided into 10 tasks.
| Task 0 | Delivery of CVS software |
| Task 1 | Database design and implementation (DB) |
| Task 2 | First selection of observation and forecasts data to handle with (Selection) |
| Task 3 | Implementation of procedure to load data into database (simpler version) |
| Task 4 | Creation of a number of guide filters/masks to retrieve data conditionally (Filters 1 and 2) |
| Task 5 | Development of the final filters/mask in SQL language |
| Task 6 | Porting and merging of Common Verification Suite package to perform statistics (Porting CVS WP 5.6.1) |
| Task 7 | Test phase of early results (Test) |
| Task 8 | Delivery of the complete package (Delivery CV) |
| Task 9 | Delivery of the common library for verification |