Liens from the VIR L1a and L1b data review Sept. 4, 2013, revised Sept. 12, 2013, Sept. 19, 2013, and Oct. 1, 2013.. [Revisions: Liens #1 and #3 have been dropped. Lien 18 has been revised to correct the wavelength range. Lien 26 has been expanded to include documentation of the solar spectrum. Lien #36 has been revised to put the information in the SIS rather than in a separate document. It is expected that revisions to the liens are now complete.] Attending: Mike A'Hearn, Maria-Teresa Capria, Richard Chen, Don Davis, Steve Joy, Joe Mafi, Ralph Milliken, Carol Neese, Eldar Noe Dobrea, Eric Palmer, Carol Polanskey, Faith Vilas, and Marco Giardino. Unless otherwise specified, liens apply to both IR and VIS volumes, and/or to both L1a and L1b volumes. The corrections from Richard Chen's report, as well as the typos and minor corrections, have been included in this document. Richard's comments have an asterisk on the number so those implementing them know whom to go to with any questions. Data directories ================ [1. The label for each L1b qub file should include a keyword indicating which calibration qub file was used for the dark current subtraction. - This lien has been dropped, because the dark current method applied to all the data cubes will be documented in the Calibration Document according to lien #26.] 2. The labels of the L1b qub files refer to the ITF response function file that was used in the processing. The filename differs from that of the response function file in the CALIB directory. Assuming the file in the CALIB directory is the same as the one used to process the L1b's, correct the filename either in the labels or in the CALIB directory so they match. [3. The labels of the L1b qub files list the solar spectrum file used in processing, but the solar spectrum file was not used in processing these files. Remove the keyword referring to the solar spectrum file from the label. - This lien has been dropped, because the solar spectrum was used in the processing in the data files.] 4.* DATA/.../*_HK.LBL Line 324: NAME = "CR ORW" should probably be "CR ROW" Line 174: NAME = "SUB CURRENT MODE" should maybe be "CURRENT SUBMODE" 5.* DATA/20120615_HAMO_2/*/*.LBL MISSION_PHASE_NAME = "VESTA SCIENCE HAMO2 (VH2)" should be MISSION_PHASE_NAME = "VESTA SCIENCE HAMO 2 (VH2)" also fix this in GEOM_INDEX.TAB 6.* These have MISSION_PHASE_NAME = "" 20110929_HAMO/20111011_CYCLE3/VIR_VIS_1B_1_372118861_1.LBL to 20110929_HAMO/20111016_CYCLE4/VIR_VIS_1B_1_372433327_1_QQ.LBL (141 files) 20120615_HAMO_2/20120629_CYCLE2/VIR_VIS_1B_1_394594775_1.LBL to 20120615_HAMO_2/20120629_CYCLE2/VIR_VIS_1B_1_394641808_1_QQ.LBL (57 files) also fix this in GEOM_INDEX.TAB 7.* DATA/.../*.LBL (except _HK) for IR L1b The final OBJECT = HISTORY is two bytes late 8.* DATA/.../*.LBL (not _HK) for VIS L1b The final OBJECT = HISTORY is off by -10, -5, -3, 0, or +2 bytes 9.* DATA/20110503_APPROACH/20110628_OPNAV_011 for VIS L1b This has five stray *.bak files 10.* DATA/ - These have no accompanying label: 20110929_HAMO/20111016_CYCLE4/VIR_VIS_1A_1_372433939_1.QUB 20110929_HAMO/20111016_CYCLE4/VIR_VIS_1A_1_372433939_1_HK.TAB 20120615_HAMO_2/20120629_CYCLE2/VIR_VIS_1A_1_394642155_1.QUB 20120615_HAMO_2/20120629_CYCLE2/VIR_VIS_1A_1_394642155_1_HK.TAB 20120615_HAMO_2/20120709_CYCLE4/VIR_VIS_1A_1_395523036_1.QUB 20120615_HAMO_2/20120709_CYCLE4/VIR_VIS_1A_1_395523036_1_HK.TAB 11.* DATA/ - These have MISSION_PHASE_NAME = "" 20110929_HAMO/20111011_CYCLE3/VIR_VIS_1A_1_372118861_1.LBL to 20110929_HAMO/20111016_CYCLE4/VIR_VIS_1A_1_372433327_1_HK.LBL (94 files) 20120615_HAMO_2/20120629_CYCLE2/VIR_VIS_1A_1_394594775_1 .LBL to 20120615_HAMO_2/20120629_CYCLE2/VIR_VIS_1A_1_394641808_1_HK.LBL (38 files) also fix this in GEOM_INDEX.TAB 12.* DATA/20110811_SURVEY/20110829_CYCLE7/VIR_VIS_1A_1_368017226_1_HK.LBL this file looks accidentally truncated 13.* DATA/20110929_HAMO/20111011_CYCLE3/VIR_VIS_1B_1_372118861_1.LBL to DATA/20110929_HAMO/20111016_CYCLE4/VIR_VIS_1B_1_372433327_1_QQ.LBL, and DATA/20120615_HAMO_2/20120629_CYCLE2/VIR_VIS_1B_1_394594775_1.LBL to DATA/20120615_HAMO_2/20120629_CYCLE2/VIR_VIS_1B_1_394641808_1_QQ.LBL Their DATA_SET_IDs and _NAMEs have "CERES" instead of "VESTA": DATA_SET_NAME = "DAWN VIR CAL (RDR) CERES VISIBLE SPECTRA V1.0" DATA_SET_ID = "DAWN-A-VIR-3-RDR-VIS-CERES-SPECTRA-V1.0" Please fix in INDEX.TAB as well. Calib directories - applies to L1b volumes only ================= 14. Include a solar spectrum that has been convolved with the VIR instrument response and that is accepted by the VIR team, for use in calibrating the data to I/F. 15. Calinfo.txt has DAWN_VIR_IR_RESP_V1.DAT: DAWN-VIR VIS responsivity in (DN*m^2*um*sterad)/(W*s) Should be DAWN-VIR IR instead. Also, are these the right units? 16.* CALIB/CALINFO.TXT all lines are 79 chars, but max is 78 17.* CALIB/DAWN_VIR_VIS_NOMRES_SPECAL_V1.LBL These need values: RECORD_BYTES = FILE_RECORDS = Document directories ==================== SIS - 18. Document in the SIS that the data in the spectral range 2.534 to 3.272 have been set to zero, and the reasons for this. [This lien has been revised to correct the affected wavelength range.] 19. List in the SIS the spectral channels known to have instrumental or processing artifacts. 20. Document explicitly in the SIS the details of how the dark current subtraction was done, including how the dark frame lines were combined to produce the dark current for subtraction. 21. The SIS lists the range of the VIR VIS as 0.25 - 1.0 microns, but there is some question about the short end of the effective range. Determine the correct value for the effective range of the instrument and describe it correctly in the SIS. 22. The SIS refers to the mission and instrument host catalog files by the wrong filenames. Correct the filenames in the SIS rather than the actual names of the files, since they agree with the filenames on the FC and GRaND volumes. 23. Table 10 in the SIS refers to X_TARG.CAT in the catalog directory, but the Vesta target cat file is not in the catalog directory. It is ok to leave out the target cat, but amend the SIS table to say "...if any..." or such language to show that the file might not be present. 24.* DOCUMENT/SIS/DAWN_VIR_SIS_V1_7.PDF p. 41: CORE_ITEM_BYTES and _TYPE are 32 and IEEE_REAL for RDRs Calibration document - 25. The formula for applying the ITF is written as Radiance = Level 1A / ITF * IntegrationTime. Brackets should be added to clarify this, i.e. Radiance = Level 1A / (ITF * IntegrationTime). 26. Document explicitly in the calibration document the details of how the dark current subtraction was done, including how the dark frame lines were combined to produce the dark current for subtraction. Also document how the solar spectrum was used in the processing of the files. The Calibration Document should contain the information necessary for an outside user of the data to replicate the calibration process from L1a to L1b. 27. The L1A qub files have a different number of lines than the corresponding L1B qub files. Determine the reason for this and document it in the calibration document. 28. The calibration qub files have data related to electronic offset, background, etc., but the role of these measurements in the data calibration and processing are not mentioned in the calibration document. If these data are used in the processing, document how they are used. If not, document that they were not. 29. The html version of the calibration document has various problems and errors which probably arose when creating it from the pdf version. These mostly pertain to subscripts and superscripts. Go over the html version carefully in comparison with the pdf version and find and correct them. 30. The calibration document refers to the calibration files as .txt files, but on the CALIB directory they have .tab and .dat extensions. Correct the document to refer to the files with the correct extension. 31. In the introduction, it says the spectral calibration is described in section 2, but it is really in section 3. 32. Under section 8, "Instrument Transfer Function matrix for VIS and IR channels (files DAWN_VIR_VIS_RESP_10.dat and DAWN_VIR_VIS_RESP_10.dat, respectively)." presumeably should say VIR_IR in one of the filenames. 33.* DOCUMENT/CALIBRATION/VIR_CALIBRATION_V2.LBL Line 27 is over 78 chars Tutorials - 34. The ENVI tutorial is good for L1a but must be updated to deal with reading the L1b data. [Ralph will update the document and send to Eldar, and Eldar will add his useful script and make additional updates if needed.] 35. The ISIS "tutorial" contains useful information but is not an effective step-by-step tutorial. Supply a tutorial which provides step-by-step instructions for reading the data correctly into ISIS. [Eric and Faith agreed to take a crack at it.] Other documents - 36. Extract the information about the meaning of the housekeeping parameters from the document Bini et al. (2005) and include in the SIS. [Revision of lien #13 from the previous review.] [This lien revised to put the information in the VIR SIS rather than in a separate document.] Catalog directories =================== 37. Catinfo.txt file for IR L1b refrs to the EDR data set cat. Correct it to refer to the RDR data set cat. 38.* CATALOG/VIR_PERSON.CAT INSTITUTION_NAME = "ISTITUTO NAZIONALE ASTROFISICA". Preferable: INSTITUTION_NAME = "ISTITUTO NAZIONALE DI ASTROFISICA", already defined 39.* CATALOG/VIR_REF.CAT - References AMMANNITOETAL2006 and FILACCHIONEETAL2006 look corrupted. Their second lines in REFERENCE_DESC are the same (including the same errors, no space after the commas) and the names of the articles aren't given. - FILACCHIONEETAL2006 has a non-ASCII character in its REFERENCE_DESC. - DESANCTISETAL2010: no comma after "M. Dami", no "and" before the last author, DOIs typically have a colon and no space - PRETTYMANETAL2003B: "DOI 10.1109/TNS.2003.815156" should be "doi:10.1109/TNS.2003.815156". PRETTYMANETAL2011 has a similar issue - RUSSELLETAL2007: any ETAL should list at least 5 authors. Try this: REFERENCE_DESC = " Russell, C.T., F. Capaccioni, A. Coradini, M.C. De Sanctis, W.C. Feldman, and 11 others, Dawn mission to Vesta and Ceres - Symbiosis between terrestrial observations and robotic exploration, Earth, Moon, and Planets, Vol 101, pp. 65-91, 2007, doi:10.1007/s11038-007-9151-9" Index directories ================= 40.* INDEX/GEOM_INDEX.LBL - Many columns with DATA_TYPE = ASCII_REAL have values of "N/A" in the .TAB. Per the PDS Standards, Section 17.2, this is acceptable, but it would be better to define NOT_APPLICABLE_CONSTANT and use that value. - FILE_RECORDS = 4150 should be 4151 since the header is 1 row. - I suggest simplifying ^HEADER = ("GEOM_INDEX.TAB", 1) ^INDEX_TABLE = ("GEOM_INDEX.TAB", 879) to (like INDEX.LBL): ^HEADER = ("GEOM_INDEX.TAB", 1) ^INDEX_TABLE = ("GEOM_INDEX.TAB", 2) 41.* INDEX/INDEX.TAB Does not list the last file in DATA/, 20120725_TRANSFER_TO_CERES/20120825_RC4/VIR_IR_1A_1_399262951_1_HK.LBL After adding it, please increment FILE_RECORDS and ROWS in INDEX.LBL 42.* INDEX/GEOM_INDEX.LBL for IR L1b - Line 4 is 79 chars long. Max is 78 43.* INDEX/INDEX.LBL for VIS L1b Line 99: START_BYTE = 243 should be 244 to match INDEX.TAB 44.* INDEX/INDEX.TAB for VIS L1b - Line 1, the header line, has 2 too many characters Aareadme ======== 45. No VIR data was taken during the transfer to LAMO or transfer to HAMO2 phases, but the first paragraph of the aareadme says the volumes contain VIR data from all the phases. Remove the phases with no VIR data from this list. 46. Include a listing in the aareadme of each of the types of files included in the data directory, what they contain, and what their filenaming convention is. I.e. raw data qubes and housekeeping for the L1a volumes, and calibrated data cubes, housekeeping, and quality cubes for the L1b volumes. It can be clarified that the housekeeping files on the L1b volumes are the same as those on the L1a volumes, but included for convenience. 47. The aareadme refers to events and activities using DOY, whereas the rest of the volume (filenames and directory names) uses YYYY-MM-DD. Change the aareadme to refer to all dates with YYYY-MM-DD. [Restatement of lien #12 from the previous review.] 48. In the activities listing, most notably for VSS, but a little in the other phases, it is hard to tell what data directory a lot of the activities are in. Revise the table so the user can tell which data directory the different activies are in, or if there is no data from a listed activity, state that in the table. [Restatement of lien #17 from the previous review.] 49. The L1b aareadmes have been created by copying and editing the L1a aareadmes, and there are some parts still remaining that refer to the L1a volumes and things appropriate to them. Edit the aareadmes to correct these. 50. Additional typos in the aareadmes: - "MK's" should be written "MKs". - "data" is a plural term, but is sometimes treated as plural and sometimes as singular - In the description of the INDEX directory, "a list0of geometric parameters...", remove the extra 0. All four volumes are certified.