Abstract
Present-day solar imaging spectrometers typically yield a few hundred million spectra in one hour of observing time. This number will increase by an order of magnitude for future instruments with larger 4k × 4k sensors, such as those planned to be used for the upcoming Daniel K. Inouye Solar Telescope. A fast quantitative analysis of such huge data volumes can be done by comparing the observations to an archive of pre-calculated synthetic spectra to infer the thermodynamic properties of the atmosphere. To analyze intensity spectra of the Ca ii IR line at 854 nm in the solar atmosphere, we generated an archive with 2,000,000 spectra under the assumption of non-local thermodynamic equilibrium (NLTE) with the NICOLE code. We tested its performance by inverting 60 spectral scans of Ca ii IR at 854 nm in the magnetically quiet Sun with 700,000 profiles each. Based on the inversion results obtained using the full archive, we constructed a smaller archive by keeping only the 70,000 archive profiles that were actually used. We can reproduce the observed intensity spectra to within a few percent using either the full or the small archive. For spectra with 30 wavelength points, this NLTE inversion approach takes 0.02 (0.35) s per profile to obtain a temperature stratification when using the small (full) archive, i.e., it can invert a single spectral scan in about 4 (68) hr. The code is able to simultaneously deal with an arbitrary number of spectral lines. This makes it a promising tool for deriving thermodynamic properties of the solar atmosphere from current or future solar high-resolution observations of photospheric and chromospheric lines.
1. Introduction
In contrast to night-time observations of stars that lack spatial resolution, observations of the Sun as our closest star provide an unprecedented amount of spatially and temporally resolved information. Acquiring solar data with high spectral resolution adds resolved information in a third dimension, i.e., in height in the solar atmosphere. With spectropolarimetric observations one can derive the properties of solar magnetic fields in addition to thermodynamic quantities that are accessible from plain spectroscopy.
The observational requirements for a full inference of physical parameters in the solar photosphere and chromosphere are to resolve the relevant spatial structures on the solar surface (spatial resolution of about 01), the thermal broadening of spectral lines at temperatures of 6000–20,000 K (spectral resolution of 2–10 pm) and the characteristic timescales of the evolution of the atmosphere (cadence of 1–100 s). Modern solar instrumentation is able to fulfill some or all of these requirements at the same time (e.g., Beck et al. 2005; Cavallini 2006; Gosain et al. 2006; Socas-Navarro et al. 2006; Collados et al. 2007; Scharmer et al. 2008; Tsuneta et al. 2008; Jaeggli et al. 2010; Jess et al. 2010; Puschmann et al. 2012; De Pontieu et al. 2014; Bjørgen et al. 2018). With the rapid technical progress of sensors commonly used in solar instrumentation both in detector size and frame rates, a massive problem has, however, surfaced in recent years: the sheer data volume. At a frame rate of about 10 Hz, imaging spectrometers can record a single spectral scan of a solar spectral line in about 5–10 s (Iglesias et al. 2016). This typically yields data sets with a few hundred million spectra per hour of observations for a 1k × 1k sensor, which requires fast analysis methods for their evaluation in order to keep up with the observations.
The common approach for extracting as much information as possible from observed solar spectra in a quantitative analysis is to subject them to a so-called "inversion." As there is no direct way to convert observed intensity or polarization signals into stratifications of thermodynamic or magnetic properties with height in the solar atmosphere, the inverse problem of finding the solar atmosphere model that best reproduces the observations is solved instead (e.g., del Toro Iniesta & Ruiz Cobo 2016). A variety of inversion codes exist for the solar case. Their main difference is the complexity in dealing with the radiative transfer equation (RTE), ranging from analytical solutions in the Milne-Eddington approximation (Borrero et al. 2011), solving the RTE assuming local thermodynamic equilibrium (LTE; e.g., Ruiz Cobo & del Toro Iniesta 1992), to finally using non-local thermodynamic equilibrium (NLTE; e.g., Socas-Navarro et al. 2015). The main driver for increasing the complexity and realism of the treatment of the RTE is that in the solar chromosphere the assumption of LTE starts to break down because the number of particle collisions is insufficient to distribute the energy accordingly over all available degrees of freedom. This causes the populations of the energy levels involved in a transition to depart from those of the LTE case, changes the ionization degree and the line opacities, and forces the local gas temperature and the radiation field to partially decouple from the Planck function (e.g., Shchukina & Trujillo Bueno 2001; Rutten 2003). This naturally has a strong impact on the analysis of observations that correspond to the radiation field integrated over the atmosphere.
A fast inversion method for chromospheric spectra of Ca ii lines in LTE was introduced in the past (Beck et al. 2013a, 2015). It was successfully applied to observational data with or without an additional approximate NLTE correction (Beck et al. 2013b, 2014; Rezaei & Beck 2015; Choudhary & Beck 2018; Grant et al. 2018; Beck & Choudhary 2019). In the current study, we analyze the performance of a fast NLTE inversion based on an archive of pre-calculated spectra synthesized with the Non-LTE Inversion COde using the Lorien Engine (NICOLE; Socas-Navarro et al. 2015). Section 2 describes the observations used for testing the archive. Section 3 details the NLTE inversion process. The results are given in Section 4 and summarized in Section 5, respectively. We discuss our findings in Section 6. Section 7 provides our conclusions.
2. Observations
The data used here consist of a time series of 396 spectral scans of the Ca ii IR line at 854.2 nm acquired with the Interferometric BiDimensional Spectropolarimeter (IBIS; Cavallini 2006) at the Dunn Solar Telescope on 2015 September 18, from UT 14:10 until 15:25. The Ca ii IR line was scanned on 30 non-equidistant wavelength positions from 853.95 to 854.45 nm (top panel of Figure 1). The cadence was about 10 s because of sequentially scanning the Hα line in between. The spatial sampling was about 0095 pixel−1, with a total circular field of view (FOV) of diameter. The FOV was located at disk center in a quiet-Sun (QS) region devoid of strong magnetic activity.
Figure 1. Matching of spectra. Top panel: FTS reference spectrum (red line), uncorrected average observed spectrum (black line), and original HSRA NLTE spectrum (blue line). Bottom panel: FTS reference spectrum (red line), corrected observed spectrum (black line), and matched HSRA NLTE spectrum (blue line).
Download figure:
Standard image High-resolution imageThe data were reduced with the standard IBIS data reduction pipeline.3 Before the execution of the inversion, three additional steps were applied to the spectra. The effect of the transmission curve of the prefilter (top panel of Figure 1) was removed; the average profile over a 600 × 600 pixel region around the center of the FOV was normalized to the intensity of the reference spectrum from the Fourier Transform Spectrometer atlas (FTS; Kurucz et al. 1984); and finally, a residual trend in the wavelength direction was taken out by division with a straight line to roughly equalize the intensities in the blue and red wings of the spectral line. The application of these three corrections to all observed spectra yielded the corrected average observed profile (black line in bottom panel of Figure 1) that maintains its intensity normalization to the FTS atlas spectrum.
3. NLTE Inversion
The application of the spectral archive assuming NLTE follows to a large extent the description given in Beck et al. (2013a) and Beck et al. (2015) for the LTE version with minor modifications.
3.1. Generation of the Spectral Archive
The NLTE spectral archive was generated by synthesizing spectra from a series of model atmospheres created by perturbing the temperature stratification of the Harvard-Smithsonian Reference Atmosphere (HSRA; Gingerich et al. 1971). The main advantage of using NICOLE over the Stokes Inversion Based on Response functions (SIR; Ruiz Cobo & del Toro Iniesta 1992) LTE code for generating the spectral archive is that with NICOLE the basic chromospheric temperature rise above log does not need to be removed or mitigated before the spectral synthesis because it does not lead to excessive emission as in the LTE case.
For the creation of the NLTE archive, we added the following temperature perturbations to the HSRA model in a similar way as for the LTE case:
- 1.A global temperature offset at all optical depths, from −1000 to +200 K in steps of 20–40 K.
- 2.Localized Gaussian perturbations with the free parameters: amplitude A (10–100 K in 10 K steps), width σ ( in units of log τ in steps of 0.1), and location in log τ (−8 to in steps of 0.1).
The amplitude A of the Gaussian perturbation was defined as 10–100 K at log , but then was scaled up with the location of the Gaussian in optical depth to be larger in the upper atmosphere (see Figure 2 of Beck et al. 2013a). The scaling factor was ≈30 at log , i.e., an initial value of A = 100 K at log converts to A = 3000 K at log .
Unlike the LTE case, we ran the spectral synthesis with both the addition and subtraction of the Gaussian perturbations to the HSRA. In the LTE case, the modified HSRA atmosphere, especially for negative temperature offsets, already corresponds to sort of the lowermost temperature to ever be expected. For the NLTE case, the chromospheric temperature rise in the HSRA of more than 4000 K cannot be removed in a similar way by the global offsets alone. Temperatures are usually limited to above 2000 K in LTE or NLTE inversion codes because otherwise the determination of the equation of state fails when trying to impose hydrostatic equilibrium. At such low temperatures, almost all atoms turn to a neutral state, which implies that the electron density approaches zero. This introduces large errors in the electron pressure to the extreme case of a full degeneracy for a completely neutral gas. The lowest temperature in the HSRA model of about 4000 K thus precludes using global offsets below K. To reduce the chromospheric temperature rise by larger amounts could thus only be done using negative Gaussian temperature perturbations. We iterated the generation and application of the archive to a single randomly picked spectral scan a few times to fine-tune the exact settings of the archive generation until the current result was achieved.
The resulting ~2,000,000 temperature stratifications were then put into hydrostatic equilibrium in NICOLE using the electron pressure of the HSRA of 0.0482 dyn cm−2 at as a boundary condition. The corresponding spectra of the Ca ii IR line at 854.2 nm were then synthesized with a spectral sampling of 2 pm with 500 spectral points over a spectral range from 853.7 to 854.7 nm. The element abundance of Ca was set to 6.3304. Table 1 lists all other transition parameters used. The synthesis takes about 17 ms per profile on a 32-core desktop machine and thus about 9 hr for the full archive. We note that any spectral line that NICOLE can deal with can be synthesized from the archive of temperature stratifications for applications to other lines or combinations of lines, which we plan to explore in future work.
Table 1. Transition Parameters of Ca ii IR Used
Element | Ionization | Excitation Potential | |
---|---|---|---|
Stage | (nm) | (ev) | |
Ca | II | 854.209 | 1.70 |
log(gf) | Transition | Collisions | Damping enhancement |
−0.463 | 2D2.5–2P1.5 | Unsölda | 2.01 |
Note.
aFollowing Unsöld (1955).Download table as: ASCIITypeset image
3.2. Preparation of Archive for Inversion
The spectral synthesis of the archive spectra is done with a fine spectral sampling so that it can be degraded to match different observations with varying spectral resolution. No macro- or microturbulence is used in the synthesis, leading to very narrow absorption profiles (top panel of Figure 1). Both factors imply that the initial spectral archive has to be matched to the actual properties of the observational data, i.e., the spectral sampling and spectral resolution of the instrument used, and any additional broadening of solar origin has to be still accounted for.
To match the archive spectra to the generic properties of the observations, the average observed quiet-Sun profile as described above and the synthetic spectrum corresponding to the unperturbed HSRA model were used. The best implementation for this process is unfortunately to some extent variable and not necessarily fully physically motivated, depending on the characteristics of the observational data. The sort of generic list of steps employs a spectral convolution of the initial HRSA archive spectrum with a Gaussian of some width σ to match the observed line width. Depending on the difference of the line depth in the convolved HSRA archive spectrum and the average observed profile, an additional correction by a constant straylight offset α is usually needed. While the presence of parasitic straylight (Cabrera Solana et al. 2007; Beck et al. 2011) in the real world can only reduce the line depth, matching the convolved HSRA spectrum to the observations may require one to increase the line depth instead, i.e., one has assume a negative straylight contribution if the required broadening σ is large and has reduced the line depth too much.
For the IBIS data used, we were not able to obtain a good match of the degraded HSRA profile to the average observed profile in the line wing and the line core at the same time using only σ and α. We thus used these two parameters to primarily match the line core and added an independent correction by two straight lines to match the line wings. With that approach, the degraded and corrected HSRA archive profile matches the observed average QS profile very closely apart from the first and last two wavelength points (bottom panel of Figure 1). The match implies that the average QS profile would yield the HSRA temperature stratification when inverted, and that averaging the inversion results over a large QS area to first order also has to yield the HSRA stratification again.
To avoid the somewhat arbitrary step of spectrally degrading the archive spectra requires a realistic line width and line depth in the archive spectra already in the spectral synthesis, for which a priori knowledge of solar macro- and especially height-dependent microturbulence would be needed. Treating the collisional broadening with the more advanced approach of Anstee, Barklem & O'Hara (ABO; Anstee and O'Mara 1991, 1995; Barklem et al. 2000) is expected to reduce the mismatch in line width between observed and synthetic spectra, but Barklem and O'Mara (1998) could still not achieve a full match for Ca ii IR spectra. With more realistic line widths in the synthetic spectra, the match to the spectral resolution of the observational data should then also be constrained using measurements or theoretical values for the spectral resolution and the amount of parasitic straylight in the instrument.
When the needed spectral degradation was identified through testing it on the synthetic HSRA spectrum, the same degradation steps were applied to all archive profiles.
For our IBIS data, the spectral re-sampling of the archive from 500 to 30 wavelength points reduced the size of the spectral archive by more than one order of magnitude. The same degraded and re-sampled archive spectra could then be applied to the full time series because the spectral characteristics of the observations did not change significantly during the data acquisition. Application to observational data with fairly different spectral properties or just a different spectral sampling requires generating a new degraded archive version, which is a rather fast process of a few minutes, while the initial archive at full resolution is only synthesized once.
3.3. Inversion Procedure
Prior to the actual inversion, both the observed spectra and the degraded archive are multiplied with the weights in the spectral dimension. We set the weights to the inverse of the average observed profile. This choice increases the contribution of the line core to the value, which is defined in the standard way as the squared difference between the observed and the archive profiles. The inversion procedure then reduces to comparing each observed spectrum to the whole archive, calculating the value, and selecting the archive profile that yields the minimal . The index of the best-fit spectrum in the archive is used to retrieve the corresponding temperature stratification and all other atmospheric thermodynamic parameters. Instead of looking up the best-fit temperature, one can also only store the best-fit index value to reduce memory usage during the inversion process. There is no specific search algorithm that is used inside the archive, as it is to some extent created in a random order. The best-fit solution automatically corresponds to the global minimum of throughout all of the archive. The search for the best match is the primary constraint for the timing that depends most strongly on the size of the spectral archive and the number of wavelength points.
4. Results
4.1. Computational Requirements and Performance
The majority of the inversions were done on a quad-core desktop computer with 32 GB of RAM and 3.5 MHz CPU speed running IDL under Linux. The IBIS data used have a size of 125 MB per spectral scan, the spectral archive at full resolution and the corresponding atmospheric parameters have about 7.4 GB, while the degraded archive spectra are about 900 MB. A single inversion job thus requires about 10 GB of RAM when the atmospheric model is kept in memory to instantly retrieve the best-fit temperature. The IDL implementation of the inversion routine uses matrix operations where possible to make full use of the capabilities of IDL that parallelizes automatically when its external matrix operation routines are called. As long as no other jobs compete for the CPU power, a speed of about 0.3 s per profile resulted for the NLTE archive of 2,000,000 spectra and 30 wavelength points. Tests on a 32-core machine gave about the same speed of 0.3 s per profile for the NLTE archive, with the only advantage being that multiple jobs can be run at the same time at this speed before the CPU power is fully used up. The time per profile when using the much smaller LTE archive of 240,000 spectra scaled almost linearly down with the archive size to 0.03 s. The LTE inversion of all 396 spectral scans was already available prior to the current study and is used for cross-comparisons in the following. Running the LTE version over full-disk Ca ii IR spectra with 100 wavelength points from the Synoptic Optical Long-term Investigations of the Sun (SOLIS; Keller et al. 2003) gave 0.1 s per profile (Beck et al. 2018). All steps after the spectral synthesis are conceptually simple and straightforward. They could be implemented in any other programming language as well. The only step that requires optimization for speed is the search for the minimal across the archive.
The archives are created without a priori knowledge of the observations. They contain an as large as possible variety of different spectra and thermal stratifications, but the full range is not necessarily needed to reproduce the observations. This is especially true for observations in the quiet Sun, where to first order all granules are "similar" to some degree, with a hot center surrounded by cool downflows. It turned out that the archive used in the inversion is rather sparse (Figure 2, see also Beck et al. 2014). For the same IBIS spectral scan, the LTE (NLTE) inversion only picked ≈10,000 (24,000) different profiles. For the NLTE case, the majority of the profiles corresponded to temperature stratifications with positive Gaussian temperature perturbations in the first half of the NLTE archive (lower panel of Figure 2).
Figure 2. Archive usage for the LTE (top row) and NLTE archive (bottom row) in a single spectral scan. The x-axis shows the index inside the archive, and the y-axis shows how often that profile was used. The total number of profiles in one spectral scan is about 700,000.
Download figure:
Standard image High-resolution imageTo confirm the sparse archive used, we ran the NLTE inversion over the first 60 IBIS scans of the time series with an average of 20,000 ± 4000 profiles used. Combining the inversion results of those scans gave a total of about 70,000 unique profiles that were used in one or the other spectral scan. Thus, only a small fraction of the archive profiles is used, which implies that further optimization is easily possible (see Section 4.4 below).
4.2. Impact of Doppler Velocities
The archive spectra are matched to the average observed QS profile, which also sets the wavelength scale and the zero position of the Ca ii IR line core to be used. Additional spectral displacements by Doppler shifts due to motions relative to the solar surface are not explicitly taken into account. It is not possible to include Doppler shifts into the archive because that would increase its size multiple times. Fortunately, line-of-sight (LOS) Doppler velocities have only a small impact on the fit for two main reasons. The typical LOS velocities of a few km s−1, with their maximal value limited by the sound speed of about 6 km s−1, lead to spectral displacements of a few pm, which correspond to about two wavelength points at the finest spectral sampling around the line core used in the observations. In addition, the observed and synthetic spectra are to first order symmetric. This forces the best-fit solution to ignore the Doppler displacement to first order because the mismatches in the blue and red line wings go into opposite directions. If the observed profile is displaced from the location in the archive, the intensity in one wing will be too high, while it will be too low in the opposite wing. Thus, the best match to first order is the same as it is in the absence of Doppler shifts, with minimal deviations in both line wings.
Figure 3 shows 16 randomly picked spectra including their LOS Doppler shifts and their NLTE best-fit solutions. For comparison, we also constructed a set of observed spectra where the line-core velocities were removed. The presence of the Doppler shifts is only clearly visible for a few of the spectra, while the best-fit solution from the archive—without any velocity—matches both the original spectra and those without velocities satisfactorily. Neglecting the LOS Doppler shifts thus has no strong impact on the thermal stratifications retrieved because the inversion matches the line shape, i.e., the intensities in the line wing and line core.
Figure 3. Observed and NLTE best-fit spectra from 16 randomly selected locations. Black lines: observed spectra including actual Doppler shifts. Blue lines: observed spectra without Doppler shifts. Red lines: NLTE best-fit spectrum, derived while ignoring the Doppler shifts. The horizontal dashed lines indicate intensities of 0.2 and 0.8 Ic, respectively.
Download figure:
Standard image High-resolution imageIn principle the LOS velocity can be determined and removed from the observations prior to the inversion, but for the coarse spectral sampling in the line wing in our IBIS data that approach can decrease the quality of the observed spectra. A determination of the LOS velocity from the location of the line core and a derivation using a spectral displacement of the best-fit spectra corresponding to known velocities gave about the same result for the LOS velocities. Such a step could be added to the inversion approach either prior to the inversion or as an intermediate step after one initial inversion, but it is not expected to lead to a significant improvement of the fit. We thus ran the inversion without removing the LOS velocities, but for a few of the figures below we will use the observed data without LOS velocities because at the wavelengths with the steepest spectral intensity gradient in the profile to the blue and red of the line core, the presence of the LOS velocities changes the intensity at a fixed wavelength significantly.
4.3. Fit Quality
4.3.1. Values
For the investigation of the fit quality, we recalculated the difference between the observed and best-fit profiles with equal weight for each wavelength as a better estimate of the general fit quality to the full line profile. Figure 4 shows a two-dimensional (2D) image of the values in the LTE and NLTE inversion for one spectral scan together with the corresponding line-core image. Both the LTE and NLTE inversion have a similar range and spatial structure in with seemingly no direct dependence on the intensity pattern in the line-core image. Most of the locations with high values of are located at places with an intermediate line-core intensity avoiding both the lowest and highest values of the line-core intensity, as indicated by the red and blue contour lines in Figure 4.
Figure 4. Line-core intensity image (left panel) and values across the FOV. The second (third) panel shows the values from the LTE (NLTE) inversion. Red (blue) contour lines indicate low (high) line-core intensities of 0.145 (0.23) Ic.
Download figure:
Standard image High-resolution imageThe histograms of and the scatter plot of in the NLTE versus the LTE inversion in Figure 5 confirm a similar performance of the LTE and NLTE inversion with slightly lower values for the NLTE fit. The shape of the distributions matches the expectations for a least-squares fit, given the number of degrees of freedom and the number of wavelength points (see Grant et al. 2018).
Figure 5. Comparison of in the LTE and NLTE inversion. Top panel: scatter plot of in the NLTE inversion vs. the LTE results. Bottom panel: histograms of the values for the LTE (NLTE) inversion in black (red) lines.
Download figure:
Standard image High-resolution image4.3.2. Intensity at Fixed Wavelengths
Figure 6 shows 2D images of the observed spectra without Doppler shifts and the LTE and NLTE best-fit spectra at three wavelengths in the outer (854.13 nm) and mid (854.19 nm) line wing and the line core (854.21 nm). The line core (top row of Figure 6) is well reproduced by both the LTE and NLTE inversion with no discernible difference between the two inversions. The same holds for the middle line wing in the middle row. The largest differences are seen for the outer line wing, where the LTE inversion especially becomes somewhat coarser in its spatial resolution. This is a consequence of a lack of suited profiles for some spatial locations in the archive, so the fit is forced to use the same profile multiple times over neighboring spatial locations. The NLTE inversion result varies on about the same spatial scale as the observations in the outer line-wing image, but also is off from the observations to some extent. This presumably results from both the Doppler shifts and the general problems of the observed spectra in the outer line wings caused by the coarse spectral sampling and the prefilter transmission curve.
Figure 6. Comparison of 2D images from spectral scan No. 252 at three wavelengths. Left column: observed spectra with Doppler shifts removed. Middle and right columns: best-fit spectra from the LTE and NLTE inversion, respectively. The wavelength is indicated in the upper left corner of the panels in the first column.
Download figure:
Standard image High-resolution imageAll inversion results show a slightly higher spatial contrast than the observations themselves, which is best seen in the line-core images, e.g., at the bright grain at in the top row of Figure 6.
The scatter plots of the best fit versus the observed intensity at the same three wavelengths in Figure 7 confirm the picture from the 2D images. The scatter around a one-to-one relation is smallest for the line core and increases toward the outer wing. The global offset of the points for the middle line wing in the middle row from the line of perfect correlation is due to the removal of the Doppler velocities by shifting the line-core location to a fixed reference position, which also shifts the whole spectral profile.
Figure 7. Scatter plots of the intensity in the observed spectra without Doppler shifts and the best-fit spectra at three wavelengths. Left (right) column: observed vs. best-fit LTE (NLTE) spectra. The red solid line indicates a perfect correlation.
Download figure:
Standard image High-resolution imageThe lack of suitable archive profiles for some locations is easily seen for the outer line wing in the top row of Figure 7. The horizontal "stripes" of identical intensity in the LTE and NLTE inversion for a range of observed intensities show that the same archive profile was used several times. For the LTE inversion it seems that this was due to a lower threshold in the intensity in the archive with no intensities below about 0.51, which implies that most likely the lowermost value of the temperature offset in its generation was not large enough.
Figure 8 shows the standard deviation of the difference between the observed spectra with and without Doppler velocities and the LTE and NLTE best-fit spectra. The average value of the standard deviation is about 0.02 of Ic at all wavelengths. The largest values are found where the absorption profile is steepest and the difference between observed and best-fit spectra is most sensitive to the Doppler shifts. Using the observed spectra without the line-core LOS velocities for the calculation reduces the deviation at the wavelengths in the mid-line wing, by a factor of about 2, to a value similar to those at all other wavelengths. This implies that executing the fit with the Doppler shifts previously removed will not lead to a significantly different or better result.
Figure 8. Standard deviation of the residuals between observed and best-fit spectra σ as a function of wavelength λ. Black (red) solid line: standard deviation of the fit residuals for the LTE (NLTE) inversion. The dashed lines show the same for observed spectra without Doppler shifts. The blue dotted line shows the average intensity spectrum in arbitrary units for reference.
Download figure:
Standard image High-resolution image4.3.3. Individual Spectra
Figures 9 and 10 show the individual observed and best-fit spectra and the resulting temperature stratifications in LTE and NLTE for another set of 16 randomly selected locations. In the spectra, the difference between the LTE and NLTE solutions is usually negligible, implying that both archives have a comparable set of spectra suited for the inversion of the specific observation. The main difference between the LTE and NLTE solutions shows up in the temperature stratifications in Figure 10. While the LTE and NLTE solutions are nearly identical up to log , only the NLTE inversion is able to reproduce the chromospheric temperature rise for higher atmospheric layers, which would lead to extreme emission profiles in the line core if treated in LTE. For cases with temperature enhancements in the low atmosphere, e.g., in the lowermost rightmost panel, the LTE and NLTE results are very similar up to log . We note that for the LTE inversion some of the corrections to the spectra were applied to the archive instead of the observations. This can lead to slightly different LTE and NLTE best-fit spectra even though the thermal stratifications are nearly identical up to log .
Figure 9. Comparison of 16 randomly selected observed spectra including Doppler shifts (black lines) and best-fit spectra for the LTE (blue lines) and NLTE inversion (red lines). The horizontal dashed lines indicate intensities of 0.2 and 0.8 Ic, respectively.
Download figure:
Standard image High-resolution imageFigure 10. Temperature stratifications inferred for the spectra in Figure 9. Blue (red) lines: LTE (NLTE) best-fit temperature.
Download figure:
Standard image High-resolution imageFigure 11 shows the spectra and temperature stratifications for three explicitly selected locations in an intergranular lane, the center of a granule, and a magnetic element. Both the spectra and the stratifications comply with the expected behavior of an increase in the intensity, especially in the very line core, and a corresponding increase in the temperature, with a variation also seen in the slope of the temperature stratification. The LTE inversion can again only provide the corresponding relative difference in temperature without a realistic chromospheric temperature rise.
Figure 11. Spectra (top panel) and temperature stratifications (bottom panel) for three explicitly selected spatial locations. Black lines: intergranular lane. Red lines: center of a granule. Blue lines: magnetic element. The solid and dashed lines in the top panel show the observed and NLTE best-fit spectra. The solid (dotted) lines in the bottom panel show the corresponding temperature stratifications from the NLTE (LTE) inversion.
Download figure:
Standard image High-resolution image4.4. "Small" Archive
The large archive size of 2,000,000 profiles is the major limitation on the speed of the NLTE inversion. However, most of those profiles are not even needed. To maximize the archive usage, we ran the inversion with the full NLTE archive over the first 60 spectral scans and retained only about 70,000 unique archive profiles that were used at any time. This "small" archive was then used to invert spectral scans No. 200–290 that were not used in its creation. We also inverted spectral scans No. 200–210 with the full NLTE archive for comparison.
Figure 12 shows images at a fixed wavelength for the inversion of spectral scan No. 200 with the full and small NLTE archive, respectively, in the same format as in Figure 6. The match of the inversion with the small archive to the observations compares well with that for the full-sized archive. The rms values of the deviations at each wavelength for the small NLTE archive stayed at a few percent similar to those in Figure 8. The inversion with the small archive for this specific spectral scan used 26,320 out of its 70,000 available profiles. The inversion speed improved to about 0.02 s per profile. The full NLTE inversion used 26,523 profiles out of its 2,000,000 profiles, i.e., only about 200 more, implying that the small archive is rather complete. The comparison of the small and full NLTE inversion for scans No. 201–210 gave similar results. Table 2 lists the speeds of the different inversion modes. Tests on a 32-core machine instead of the quad-core desktop computer gave about 10% faster speeds even when running up to six inversion jobs in parallel.
Figure 12. Comparison of 2D images of the full and small NLTE archive inversion at three wavelengths for spectral scan No. 200. Left column: observed spectra with Doppler shifts removed. Middle and right columns: best-fit spectra from the small and full-size NLTE inversions, respectively. The wavelength is indicated in the upper left corner of the panels in the first column.
Download figure:
Standard image High-resolution imageTable 2. Summary of Archive Performance for Spectra with 30 Wavelength Points
Type | Speed | Time/IBIS Scan | Archive Size |
---|---|---|---|
LTE | 0.03 s | 5.8 hr | 240,000 |
NLTE full | 0.35 s | 68 hr | 2,000,000 |
NLTE small | 0.02 s | 3.9 hr | 70,000 |
Download table as: ASCIITypeset image
4.5. 2D and 3D Visualization of Temporal Evolution
Figure 13 shows a still from an animation of both the LTE and NLTE inversion results in a 25 Mm × 25 Mm region at the center of the IBIS FOV for spectral scans No. 200–290 that cover about 15 minutes of observations. The 1D display at the top shows the temperature on a cut through the middle of the region. The 3D displays were generated with the same approach used in Beck et al. (2014) by a ray-tracing through the temperature cube obtained from the inversion for each spectral scan taken at the time ti. The value to display for each ray was set to the largest temperature encountered along the ray. The conversion from to z was done as in the latter publication, assuming the relation between τ and z given in the HSRA model as a first-order estimate. Because of the chromospheric temperature rise in the NLTE inversion results, the relative temperature was used for the NLTE 3D display, otherwise only the top layers of the atmosphere with the highest absolute temperature are seen.
Figure 13. Still from the animation of the inversion results for spectral scans No. 200–290. The video duration is 11 s. Left and middle columns: NLTE/LTE results for a 25 Mm × 25 Mm region at the center of the FOV in (top to bottom) 1D, 2D, and 3D visualizations. Right column, from top to bottom: line-core velocity vLOS, line-core intensity Icore, and continuum intensity Ic. The number of the spectral scan and its time are given in the lower left corner. The white dashed lines in the 3D plots indicate the location of the cut shown in the 1D plot at the top. The 2D and 3D displays of the NLTE results show the relative temperature , while everything else shows absolute temperatures.
(An animation of this figure is available.)
Download figure:
Video Standard image High-resolution imageWhen playing the animation, upward propagating acoustic waves can be identified in the 1D display, but at the 10 s cadence of the observations they often are captured only on a few subsequent steps. The small-scale ( Mm) locations of increased chromospheric temperatures at in the 1D display are usually mapped in the same way in the LTE and NLTE inversion, similar to the locations with reduced chromospheric temperatures in between that extend over larger areas (see, e.g., Rezaei et al. 2008).
The easiest way to identify structures in the LTE 3D display is to compare them to the line-core intensity image on the right side. The structures corresponding to the strongest local brightenings in the latter can then be found in the LTE 3D display, where they reveal their shape throughout the atmosphere, and specifically below the chromospheric layers where the Ca ii IR line core forms. A few of them will correspond to magnetic elements instead of acoustic shocks, but the target region at disk center was magnetically very quiet on the observing day.
It is more difficult to then identify exactly the same structures in the NLTE 3D display because there usually are several more locations with high chromospheric temperatures that stand out. For scan No. 203 shown in Figure 13, the three most prominent bright features in the LTE 3D display at Mm can be located in the NLTE 3D display as well. The majority of the other high-temperature structures in the NLTE 3D display can, conversely, be usually identified in the line-core intensity image as smaller and less bright intensity enhancements that presumably result from acoustic shocks ("bright grains;" see, e.g., Rutten & Uitenbroek 1991; Beck et al. 2008) instead of magnetic elements. Those do not show up as prominently in the LTE 3D display because their temperature in LTE is not so strongly enhanced that they dominate the ray-tracing in the absolute temperature in the same way. For the LTE 3D display, in some cases the photospheric temperatures are the largest values along a given ray. We note that this is not a flaw of the LTE or NLTE inversion results, but a generic problem in how to visualize the corresponding temperature cubes.
In summary, the animation demonstrates that with either the LTE or NLTE inversion results chromospheric structures can be identified and traced in three dimensions throughout the atmosphere, while the application of the inversion to a time series of observations allows one to also trace the temporal evolution in an atmosphere cube.
5. Summary
We generated a large archive of 2,000,000 profiles under the assumption of NLTE for an inversion of solar chromospheric Ca ii spectra. After matching the average observed quiet-Sun profile with the spectral synthesis corresponding to the unperturbed HSRA model, we applied the full archive to 60 spectral scans with 700,000 spectra each. We retained all archive spectra used in those inversions to create a much smaller archive of 70,000 spectra that is optimized for the specific observation target of the quiet Sun at disk center. We find that LOS Doppler velocities have a negligible effect on the temperature stratifications retrieved. Both the full and the small archive have a comparable performance in terms of fit quality and reproduce observed spectra to within a few percent of Ic. The speed improved from about 0.3 s per profile for the full NLTE archive to about 20 ms per profile for the small NLTE archive, which allows one to invert a complete time series with a few hundred million spectra in a few weeks with moderate computing power.
6. Discussion
We find that an archive of about 100,000 pre-calculated NLTE Ca ii IR spectra is sufficient to successfully reproduce chromospheric quiet-Sun observations of high spatial and spectral resolution. The optimal archive size can be reached by an application of a larger archive to only part of the data. The optimized archive allows one to reach speeds of a few tens of milliseconds per profile for inverting solar chromospheric spectra in NLTE.
One advantage of the archive inversion approach is that there is no general restriction on the source of the temperature stratifications and the corresponding spectra. Contrasting our approach with a "manual" generation of the archive, one can also use the results from realistic numerical simulations as input (Riethmüller et al. 2017), or use any other collection of plausible solar model atmospheres. One can also merge spectra from different sources as long as the general properties of the spectra, such as spectral sampling and resolution are, or can be made, compatible.
The inversion approach is capable of dealing with multiple spectral lines at the same time (e.g., Riethmüller and Solanki 2019) because this only requires running the initial spectral synthesis on the same temperature stratifications for all spectral lines wanted. For the case of Ca ii spectra, the most promising improvements would be the inclusion of photospheric line blends (e.g., Felipe et al. 2010; Beck et al. 2013a) or the use of quasi-simultaneous observations of Ca ii and photospheric lines. The main backbone of the archive is in this sense not the spectra, but the corresponding temperature stratifications.
The archive inversion approach is able to provide an automatic analysis of time series of millions of spectra. The manual step of matching the archive to the observations has only to be executed once, while the intensity normalization of the observations to the FTS atlas in the line wing can be done in a fully automatic way. Given the speed of the inversion process, the analysis is thus not limited to individual spectral scans or snapshots, but can be run over series of spectral scans. This allows one to also study the temporal evolution in the solar chromosphere in detail (Beck et al. 2013b).
6.1. Current Limitations
One major limitation of the archive inversion approach is the match of the HSRA spectral synthesis to the average observed quiet-Sun (QS) profile. This prevents a fully independent determination of absolute temperatures. All temperatures are derived in some sense as differences to the HSRA model that is forced to correspond to the average QS spectrum, and hence to first order to the average QS temperature stratification. For the scientific interpretation of the inversion results this presents, however, only a minor drawback. First, the HSRA is assumed to be a valid QS temperature stratification with a small error at least for the optical depth range from up to . Second, for most science targets, no absolute reference temperature values are known from other sources, i.e., potential temperature errors of even a few 100 K are often rather irrelevant as there is nothing to compare the inversion results to. Third, relative temperature differences across the FOV are maintained in the correct way. Finally, the problem of the intensity normalization is common to all inversion codes. Given that the observations are commonly acquired in an arbitrary intensity scale in counts, almost all inversion codes use an internal normalization of synthesized spectra in absolute energy units to some reference value.
The second major limitation of the approach still is its speed, even with all attempts at optimization. At 20 ms per profile, an inversion of the full 1 hr time series of IBIS data used in the current study takes about two months with a single job. As long as enough memory and CPU cores are available, the duration scales linearly with the number of jobs run in parallel. That puts the approach still at the limit of practical application for data from current instruments.
The apparent increase in spatial contrast in the inversion results presumably indicates a problem common to all inversion codes that work on a single-pixel base. The spectrum from a single spatial location is reproduced with a single thermal stratification, ignoring the 3D radiative transfer in the solar atmosphere and the spatial degradation by the Earth's atmosphere and the telescope optics with lateral contributions from adjacent locations. For photospheric spectral lines in LTE with a strong coupling of radiation field and local gas temperature, the single-pixel approximation in the solar atmosphere is valid, but the importance of the lateral radiation increases higher in the atmosphere (Leenaarts et al. 2009). This problem can be overcome by using a spatially coupled inversion approach (van Noort 2012) or applying a deconvolution to the observations before the inversion (Beck et al. 2011), but in general it affects chromospheric spectral lines more than photospheric ones. To accurately model the 3D radiative effects in the solar atmosphere would require using a height- or wavelength-dependent spatial point-spread function (PSF) in addition to the regular PSF for the spatial degradation outside the solar atmosphere.
Finally, the neglect of the LOS Doppler velocities in the inversion is a minor limitation, but they could be taken into account with little additional effort.
6.2. Future Work
We currently foresee a few different avenues for future improvements of the inversion approach.
The current full or small archive is optimized to deal with QS observations at the disk center. It will only be partially suited to inversions of strongly differing solar targets such as active regions with pores and sunspots or any type of observations at large heliocentric angles. Particularly, for a potential application of the NLTE inversion to the full-disk spectra in Ca ii IR provided by SOLIS, a set of a few archives at different heliocentric angles will be needed. Even if in the automatic generation of the archive many different temperature stratifications are created, they do not necessarily resemble stratifications for inclined lines of sight through the solar atmosphere. In regular operations, SOLIS Ca ii IR full-disk data come in at a daily rate of one or two times about 2.7 million spectra for either Stokes I and V or Stokes and V measurements. With moderate computing power, such an amount of data can be handled with the current archives overnight.
An improvement of the inversion speed might be possible by application of a Principal Component Analysis (PCA; e.g., Rees et al. 2000; Eydenberg et al. 2005; Casini et al. 2013) to either the observed or the degraded archive spectra. Keeping only the first few principal components will reduce the dimensionality of the observed and archive spectra, which will speed up the inversion process. SOLIS spectra have about 100 wavelength points, which the PCA could reduce to less than 10 relevant parameters. The inversion process would work in a very similar way, but instead of calculating from the squared difference of observed and archive spectra it would minimize the squared difference of the PCA components.
Finally, neural networks (see, e.g., Carroll & Staude 2001; Socas-Navarro 2005; Carroll & Kopf 2008, and references therein) are able to reach a much faster speed than the one-by-one comparison of each observed profile with each archive spectrum. They also have the capability of additional interpolation between the thermal stratifications contained in the archive (Osborne et al. 2019). Preliminary tests training a neural network on the "small" archive (courtesy of I. Milic) showed a tremendous increase in the inversion speed, but a more detailed discussion of this topic is outside the scope of the current study.
7. Conclusions
An inversion approach for spectra of the chromospheric Ca ii IR line at 854.2 nm based on a spectral archive generated assuming NLTE can successfully reproduce observed spectra to within a few percent of Ic at a speed of down to 0.02 s per profile after optimization. Even large data sets of a few hundred million spectra can be quantitatively analyzed in a reasonable time with modest computing power. The inversion approach is able to deal with simultaneous observations of multiple spectral lines, but retrieves only the temperature stratification in hydrostatic equilibrium.
Following the label for the corresponding LTE version, we will name the new code "Non-Local Thermodynamic Equilibrium CAlcium Inversion using a Spectral ARchive (NLTE-CAISAR)."
We thank the anonymous referee for helpful suggestions and comments. The Dunn Solar Telescope at Sacramento Peak/NM was operated by the National Solar Observatory (NSO). NSO is operated by the Association of Universities for Research in Astronomy (AURA), Inc. under cooperative agreement with the National Science Foundation (NSF). We thank R. Rezaei for the very first version of the NLTE archive. We thank H. Socas-Navarro for his help. C. Kiessner acknowledges support by the National Science Foundation's REU program through Award No. 1659878.