Open Data Interface, ODI
ESTEC/Contract No. 21964/08/NL/AT
Monthly Progress Report
ODI-MR-13-08/09
Period: 2009-10-01--10-31
Author: Lars Eliasson
1. Progress status
The administrator guide has been updated. See http://www.lund.irf.se/odi/internal/.
An updated version of ODI (0.91) was released. See http://www.lund.irf.se/odi/internal/odi-0.91/.
Version 0.91 uses SAAPS compiled with Java SE 6 and will thus not work with earlier versions of the Java Runtime Environment. The user guides will be updated accordingly.
PM 3 was held at Estec on October 20. See agenda and minutes at http://www.lund.irf.se/odi/internal/.
The ODI dataset table has been updated with two additional columns according to the minutes: numrecs and availability.
The ODI version number should be included in the ODI tables. A solution to store it in the table comment fields has been discussed.
The parser routines have now been split up so that the ODI library files need not to be edited when new parsing routines are added.
ODI 0.91 did not include the possibility of storing additional CDF_EPOCH variables except the default Epoch variable. A solution is to convert additional CDF_EPOCH variables to MySQL DOUBLE using the mapping from ODI data_type table.
DH has split up the directory and data file parser routines.
The directory parser is now able to handle arbitrary directory tree depth instead of a fixed 2 levels.
Treatment of cdf.gz files has now been generalized.
populate.php now accepts a list of dataset names as command line arguments.
DH and HE installed the ODI routines on a live SEDAT server at ESTEC. A couple minor bugs in the SEDAT set up were discovered and corrected along the way. The IDL routines to write out ASCII and cdf files were finished and installed. All functionality has been tested on different databases. DH created an odi version of addds.pl to set up the system dataset directory structures in SEDAT.
DH added the Herschel, Planck and AMPTE datasets. Ingestion of all GOES/SEM datasets has been completed. The SEDAT IDL tools were extended to handle variables with 2 dimensions. DH checked the process of setting up 2D variables and using them with the AMPTE ELX electron flux: creation of the data table columns from the original cdf files, ingestion of the data into the tables, reading from the database and outputting ASCII and cdf files. All appeared to be consistent.
DH discussed with BIRA how to set up an ODI database for use with SPENVIS.
Web page http://www.lund.irf.se/odi
WP 100 Core Database System
A draft of the ECSS-E40 documents (D1) is prepared including e.g. Software System Specification (version 0.1, dated 2008-11-14).
The URD has been updated to version 1.1 (2009-09-22).
The Database Technical Note (D3) has been updated to version 1.0 (2009-09-25).
User manual for the database administrator (D2) has been updated to version 1.2 (2009-10-16).
Database system and source code (S1) has been updated to version 0.91.
WP200 Database
The structure of the database (S2) is basically fixed and was delivered in September.
The Database Technical Note has been updated to version 1.0.
WP300 SAAPS interface
Updated ECSS-E40 document at September 2009 according to the schedule
Software (S3) has been updated to version 0.91.
Technical note (D4a note D1 in SoW) version 1.0 has been written.
WP400 SEDAT interface
Updated ECSS-E40 document at September 2009 according to the schedule
Software (S4) has been updated to version 0.91.
Technical note (D4b note D1 in SoW) version 1.0 has been written.
WP500 SPENVIS interface
Updated ECSS-E40 document September 2009 according to the schedule
Software (S5) has been updated to version 0.91.
Technical note (D4c note D1 in SoW) version 1.0 has been written.
WP600 Maintenance and support
Start October 2009 according to the present schedule.
WP700 Administration/management
Monthly progress reports
Final Report (D5, note D2 in SoW) ready in March 2010 according to the present schedule.
Abstract (D6, note D3 in SoW) ready in March 2010 according to the present schedule.
2. Problem areas/reasons for slippages
The date for delivery of software was delayed, partly due to part-time parental leave.
3. Events anticipated to be accomplished during next reporting period
Software and documentation was delivered at the end of September.
4. Status report on all long lead or critical delivery items
None
5. Action items
The following action item was decided during the PM1:
Action Item PM-1 Hugh Evans shall investigate where the system will be hosted at ESTEC, allocate space, and arrange for the necessary licences and servers to be set up at ESTEC.
The following action item was decided during the PM2:
Action Item PM-2 Check if the software is supposed to be open source.
6. Milestone payment status
Progress payment invoiced was sent September 2009 and payment received.
7. Expected dates for major schedule items
A preliminary date for the next progress meeting is during the ESWW (17 Nov). The maintenance phase will run until March 2010.