Verification of the processing steps
The verification of the processing steps is done automatically via the Automated Verification workflows in charge of producing diagnostic plots which permit to verify the results of the associated processing workflow (Figure 6.2).
The verification of the Ingestion workflow (AVPP) consists mostly on the monitoring, per calibration unit, of the number and of some properties of SpectroObservations entering the pipeline after the filters applied in Section 6.2.1 (each SpectroObservation corresponds to a transit and contains 3 spectra of the star, one per CCD). The total number of SpectroObservations with 1D windows is 91 255 288 and with 2D windows is 1 677 114, corresponding to a total number of spectra of 278 797 206.
The verification of the Calibration workflow (AVCAL) mostly consists in counting the calibration stars and the standard stars used in each calibration unit to verify they are in sufficient number. The trending plots of the calibration models obtained are also provided for visual inspection (Figure 6.7).
The verification of the FullExtraction workflow (AVFE, similar to AVEXT) mostly consists of counting the total number and plotting some of the spectra that have been rejected from the data flow because of bad quality (i.e. one of the reasons in Section 6.4.4); The total number of rejected spectra is approximately 29 million, the large majority (25 million) is excluded because of negative flux, due to the fact that the straylight background was overestimated. Automated Verification also counts the number of cosmic rays and saturated samples detected and the number of spectra per various transit properties.
There are various automated diagnostics in charge of the verification of the STAMTA workflow (AVSTA and AVMTA). The good quality of the final results is also an indirect proof of the correct behaviour of the upstream workflows. The STA and MTA results are compared with external radial velocity catalogues obtained with ground-based observations (see Sartoretti et al. 2018).
Ground-based radial velocity catalogues used for validation
The radial velocity catalogues used for validation are listed in Table 6.3, where the stars expected to be stable have been selected.
|Cat Name||nb stars||nb transits||pipeline use|