skip to main content

gaia data release 3 documentation

11.4 Quality assessment and validation

11.4.7 Groups of stars

Author(s): Ulrike Heiter, Antonella Vallenari

Unresolved binaries

Author(s): Ulrike Heiter

In this section we compare products of different Apsis modules derived for unresolved binary stars.

The selection of comparison samples for cross-module validation was based on stars drawn from external catalogues. Below we use these samples to compare some of the products from the modules MSC (Section 11.3.5), GSP-Phot (Section 11.3.3), and GSP-Spec (Section 11.3.4).

Section 11.4.1 presents the main conclusions that can be drawn from the comparisons. The general conclusion is that for known binaries MSC provides reasonable values of Teff and logg for the individual components, while the (system) metallicities seem to be overestimated compared to GSP-Phot and GSP-Spec, at least for systems with sub-solar metallicity.

Two external catalogues of known binary stars were used to generate the samples for the comparisons:

  • A literature compilation mainly consisting of APOGEE dwarfs from El-Badry et al. (2018), hereafter ’APOGEE sample’. The ratio of the G-band fluxes was calculated by Jan Rybizki from the atmospheric parameters of the components using PARSEC isochrones. This catalogue contains 2869 entries, of which 2598 have a non-NaN value for the flux ratio, and 1867 have a flux ratio from 1 to 5, which is the validity range of MSC.

  • A binary catalogue including parameters for individual components, metallicity, reddening and also the flux ratio based on GALAH and Gaia data (Traven et al. 2020a, hereafter ’GALAH sample’). The flux ratio values were taken from the ratio1-50 parameter published by Traven et al. (2020a). This catalogue consists of 12760 sources, of which 11325 have a flux ratio between 1 and 5.

About 2.4 million sources with parameters from MSC, GSP-Phot, and GSP-Spec were cross-matched with the two catalogues of binaries, resulting in 839 and 2504 unique sources for the APOGEE and GALAH samples, respectively, of which 532 and 2362 had a flux ratio from 1 to 5. In the case of GSP-Phot the parameters based on both the MARCS and PHOENIX libraries were used separately. These are found in the table astrophysical_parameters_supp. In the case of GSP-Spec the parameters are those based on the MatisseGauguin algorithm, found in the table astrophysical_parameters.

Figure 11.89: Comparison of Teff in K from MSC and GSP-Phot using results from the MARCS library, for a sample of known APOGEE binary stars with flux ratio from 1 to 5.
Figure 11.90: Comparison of Teff in K from MSC and GSP-Phot using results from the MARCS library, for a sample of known GALAH binary stars with flux ratio from 1 to 5.
Figure 11.91: Comparison of Teff in K from MSC and GSP-Spec, for a sample of known GALAH binary stars with flux ratio from 1 to 5.

The comparison of Teff from MSC and from GSP-Phot is shown in Figure 11.89 for the APOGEE sub-sample with flux ratio from 1 to 5, which is the valid range of MSC, and using the MARCS results from GSP-Phot. The comparisons for the APOGEE sample with any flux ratio and for the PHOENIX results from GSP-Phot show very similar features, and this is also the case for all other comparison diagrams. Therefore all figures of this section are shown for the sub-samples with flux ratio from 1 to 5 and for the GSP-Phot-MARCS results only. The figures are colour-coded by the flux ratio calculated by MSC for each source and used internally in the data processing. This parameter is not published in the Gaia DR3 archive.

The comparison of Teff from MSC and from GSP-Phot for the GALAH sample is shown in Figure 11.90. Keeping in mind that GSP-Phot is analysing a combined spectrum of two stars as if it were a single star, the GSP-Phot Teff can be seen as parametrizing the “average” spectrum. Thus, we would expect that Teff from MSC for the primary (Teff 1) should be larger than Teff from GSP-Phot, while Teff for the secondary (Teff 2) should be smaller, if the two components are different. In the limiting case of two equal components, all three Teff values should be equal to within the typical uncertainties of each algorithm. The comparison of Teff from MSC to those from GSP-Spec for the GALAH sample is shown in Figure 11.91, and the same considerations as for GSP-Phot hold. The figures show the expected trends, but we note that for Teff 1 there are a number of points below the 1-to-1 line.

Figure 11.92: Comparison of logg (g in cm s-2) from MSC and GSP-Phot (MARCS results) for a sample of known GALAH binary stars with flux ratio from 1 to 5.
Figure 11.93: Comparison of logg (g in cm s-2) from MSC and GSP-Spec for a sample of known GALAH binary stars with flux ratio from 1 to 5.

The comparisons of logg from MSC to those from GSP-Phot and GSP-Spec are shown in Figure 11.92 and Figure 11.93, respectively. In the case of logg we notice that MSC often infers higher values of logg for both components than GSP-Phot. On the one hand that makes sense, because both will then be less luminous so that their combined luminosity comes out as observed. On the other hand we also see in the MSC validation that compared to the literature values the logg values tend to be too high (see Section 11.3.5). In the comparison to GSP-Spec the logg values cluster around the 1-to-1 line, although with a spread of roughly 1 dex away from the line in both directions.

Figure 11.94: Comparison of [M/H] (dex) from MSC and from GSP-Phot (a, MARCS results) and from GSP-Spec (b) for a sample of known GALAH binary stars with flux ratio from 1 to 5.

The comparisons of [M/H] from MSC to those from GSP-Phot and GSP-Spec are shown in Figure 11.94. In the comparison with GSP-Phot we see that the MSC inferred [M/H] is roughly compatible with the GSP-Phot values, although the MSC values are on average somewhat higher than the ones from GSP-Phot. We note that biases in the single star inferred values in comparison to MSC inferred values cannot be identified yet, due to MSC’s limited performance. The comparison to GSP-Spec also shows compatible values for [M/H], at least around solar metallicities. GSP-Spec has a number of very metal poor sources (more of these appear in the GALAH sample than in the APOGEE sample), which are absent in MSC, probably due to the [M/H] prior used by MSC (a Gaussian with mean 0 dex and standard deviation 0.2 dex).

Some statistics for the comparisons are given in Table 11.45.

Table 11.45: Statistics for the comparison of parameters from MSC, for each binary component separately, to the same parameter from GSP-Phot using the MARCS library and from GSP-Spec, for the GALAH sample of known binaries, which are shown in Figure 11.90 to Figure 11.94. Differences were calculated in the sense MSC minus other module. The quantities are mean difference (’bias’) and median absolute deviation (’mad’). Units for Teff, logg, and [M/H] are K, log cm s-2, and dex, respectively. N gives the number of sources in each comparison sample.
GSP-Phot GSP-Spec
Parameter bias mad bias mad
N 1269 1646
Teff 1 70 180 130 260
Teff 2 -420 390 -320 450
logg 1 0.3 0.3 0.0 0.3
logg 2 0.4 0.4 0.1 0.4
[M/H] 0.2 0.2 0.5 0.4

Star clusters

Author(s): Antonella Vallenari

In this section, we focus on a sample of star clusters selected from the Cantat-Gaudin et al. (2020) catalogue. We also include a few globular clusters from Gaia Collaboration et al. (2018b). Our selection corresponds to about 130,000 stars. As we focus on star clusters, we can assume they are co-eval populations (i.e., same age, [M/H], about the same extinction, and distance). This assumption allows us to use isochrones as a reference for comparing our parameters. However, we should also warn the reader that in more crowded regions the raw data products do not have the same quality as in non-crowded regions (Gaia Collaboration et al. 2023c), and one should be aware of this limitation when interpreting this validation analysis.

We compare the atmospheric and evolution APs from GSP-Phot (Section 11.3.3), GSP-Spec (Section 11.3.4), and FLAME (Section 11.3.6) to the PARSEC isochrones available from the INAF Padova Observatory website at http://stev.oapd.inaf.it/cgi-bin/cmd. Note that Apsis processed all the stars independently and did not exploit the co-evolution of the stars. When analyzing the GSP-Spec results, we select the stars having flags_gspspec with f1, f2, f4, f5, f8 = 0, where fN indicates the Nth character in flags_gspspec.

In this Section, we present some of the key results concerning the global quality of the classification.

Atmospheric parameters: Teff, logg, [M/H]

We analyse the ’best’ results for GSP-Phot taken from the astrophysical_parameters table. As a consequence, we observe unphysical clusterings of points on the HRD (see Figure 11.95): in particular we see edge effects at the library borders. This is most evident for the OB library. teff_gspphot and logg_gspphot are, however, in general in agreement with our isochrone expectations. The overall median of the distribution of teff_gspphot residuals (to the isochrones) is =34-576+1019 K, with a MAD =450 K. Compared to the isochrones we find that teff_gspphot is overestimated for giants and underestimated for supergiants.

For stars having 3000<Teff<8000K, we compared teff_gspphot_marcs to teff_gspphot_phoenix values (in the astrophysical_parameters_supp table). The comparison is shown in Figure 11.96. We find their mean difference (MARCS-PHOENIX)=-112 K (MAD =145 K), and their median difference =-63 K (with the quartiles, Q1=236 K, Q3=66 K). One can also see the non physical clumping of stars in specific Teff nodes of the grids of both libraries.

teff_gspspec shows good agreement overall with the isochrone predictions, with Δ(Teff)=6.2K (median) or 30 K (mean) and a MAD =169 K.

Overall the median of the distribution of logg_gspphot residuals (to the isochrones) is =0.01-0.22+0.70 dex (MAD=0.22) with a long tail of overestimated logg mainly on the main sequence (see Figure 11.95). We find that logg is underestimated for hot stars and giants, and overestimated for intermediate mass stars.

logg_gspspec shows a bias of -0.3 dex (median; MAD=0.44 dex) when compared to isochrone predictions. logg values for giant stars in the AGB phase have poorer quality.

Only GSP-Spec provides [α/Fe] (alphafe_gspspec) and individual abundance ratios, and most abundances present some correlations with logg.

Figure 11.95: Teff vs. logg diagram (aka Kiel diagram) from teff_gspphot and logg_gspphot. These results are found in both the gaia_source and astrophysical_parameters tables. Top: stars colour coded by the “best” library libname_gspphot. Bottom: the entire sample plotted with the PARSEC isochrones superimposed (Z=0.017; black dots).
Figure 11.96: Comparison of teff_gspphot between the MARCS and PHOENIX libraries, teff_gspphot_marcs vs teff_gspphot_phoenix.

Evolution parameters: MG, , , age

mg_gspphot presents systematics in distant clusters as an effect of the underestimated distances (see Section 11.4.3). In addition MG presents a deviation from the isochrone references at MG 7-7.5 mag in both distant and nearby clusters (see Figure 11.101)

FLAME provides two sets of age and mass estimates: one based on the GSP-Phot results (appearing in the astrophysical_parameters table) and one based on the GSP-Spec ones (appearing in the astrophysical_parameters_supp table. We obtain a sample of about 1 500 stars when selecting stars with both spectroscopic age and mass from FLAME, i.e, mass_flame_spec and age_flame_spec estimates.

mass_flame_spec presents overestimated values for lower main sequence stars (Teff <5000 K) and for AGB stars cooler than 4500 K. For the latter these have been identified as as stars with mass_flame_spec >4 (see Figure 11.97). These can be understood because they are outside of the grid of mass and age used when inferring these values. The user is therefore warned to ignore giant masses if they have values beyond about 2 – 3 . When comparing these values to isochrone predictions, we find a difference Δ=0.33 (mean), σ=1.1, (MAD =0.10), and a median of -0.02, (Q1=-0.08,Q3=0.17) With the same comparison, we find that the reported values have underestimated uncertainties. The mean value of Δ/error=1.37, (σ=13, MAD=1.5; see Figure 11.97).

mass_flame shows an overall difference with isochrone masses of 0.38 (mean), 0.78 (σ), 0.42 (MAD), 0.33 (median). If we restrict ourselves to stars with flags_flame =00, we find a difference of -0.03 (mean), 0.78 (σ), 0.14 (MAD), -0.11 (median). Although, we note that there are artifacts due to coarse fit to isochrones that we mitigated with a selection on flags_flame = 00 or 01 i.e. main sequence stars with masses (see Figure 11.99).

age_flame_spec presents overestimated ages for young stars and underestimated for old stars (see Figure 11.98) We find larger discrepancies for cool main sequence stars w.r.t. literature values (see Figure 11.98) We find an age difference with literature values of Δage = -0.6 Gyr (mean), -0.4 Gyr (median), σ = 0.8 Gyr, MAD 0.3 Gyr. We also find that the uncertainties are underestimated. Δage/error=1.3 (mean), σ = 2.2, MAD = 0.61 Gyr.

age_flame shows an overall difference to the isochrone based ages of 3.0 (mean), MAD=1.4 Gyr, and with flags_flame = 00 and 01 (main sequence stars with masses), the difference with the isochrones is 0.3 (mean), 0.07 (median), MAD=0.38 Gyr (see Figure 11.100).

Figure 11.97: Residuals between FLAME mass derived using the GSP-Spec spectroscopic Teff and isochrones Left: Kiel diagram using isochrone parameters colour coded by the residuals with mass_flame_spec Right: the same residuals as function of mass_flame_spec.
Figure 11.98: Residuals between FLAME age derived using the GSP-Spec spectroscopic Teff and isochrones. Left: Kiel diagram using isochrone parameters colour coded by the residuals with age_flame_spec Right: the same residuals as a function of age_flame_spec The sequences at constant age correspond to single clusters.
Figure 11.99: Comparison of mass_flame with isochrone masses in clusters. Left: Residuals of mass_flame to isochrone masses for the whole sample. Right: the analogous when splitting the sample into flags_flame=00 and 01, i.e. main sequence masses.
Figure 11.100: Age distribution of stars in the reference catalogue (cyan) and age distribution from age_flame (pink) for stars with flags_flame=00 and 01, left and right, respectively.

Extinction parameters: A0, AG

The overall median of the distribution of ag_gspphot residuals compared to the isochrones is =0.13-0.074+0.45 mag with a MAD =0.24. A Teff-AG degeneracy is present in parts of the sky. An example of some of the systematics can be observed in the CMD distribution, where ag_gspphot overestimates AG for giants and underestimates AG for hot supergiants, when we compare it to clusters.

We find that A0 deviates systematically from the expected values with a strong magnitude dependence, esp. at faint magnitudes (G>16, see third panel of Figure 11.101). This analysis is conducted using clusters. However, we also know that in denser regions of the sky the raw data products may suffer from crowding issues, see (Gaia Collaboration et al. 2023c), and the results presented here are not necessarily applicable to all sources.

Figure 11.101: Example of a comparison of parameters to the NGC 1039 PARSEC isochrone (fit; green lines). From left to right, we show the observed CMD, teff_gspphot-mg_gspphot, G-azero_gspphot, and mg_gspphot-GBP-GRP. Red dots shows stars with G<12.