LCF on Larch - EXAFS Region
Hello! I've recently been trying to use Larch instead of Athena for EXAFS analysis, and I mainly do linear combination fitting for my samples. It seems that the XANES fitting is doing just fine requesting a specified region to fit (-25 to +75 eV). When I try to fit in the k-space however, Larch does not request a specific region in k space. I try to input the eV values corresponding to the k value I want to fit, but it is still plotting in mu rather than k . Is there anyway I can change this and/or do it manually on the larch GUI? Any help would be appreciated! Thanks, Garret -- Garret Bland Graduate Student Carnegie Mellon University Civil and Environmental Engineering Porter Hall 207C Pittsburgh, PA, 15213
Hi Garret,
On Thu, Aug 9, 2018 at 12:27 PM Garret Bland
Hello!
I've recently been trying to use Larch instead of Athena for EXAFS analysis, and I mainly do linear combination fitting for my samples. It seems that the XANES fitting is doing just fine requesting a specified region to fit (-25 to +75 eV). When I try to fit in the k-space however, Larch does not request a specific region in k space. I try to input the eV values corresponding to the k value I want to fit, but it is still plotting in mu rather than k . Is there anyway I can change this and/or do it manually on the larch GUI? Any help would be appreciated!
You're right that linear combinations in k-space are not really working in Larch's XAS Viewer, including that the range can only be set in energy. Much of XAS Viewer is fairly new -- I think it is fairly complete, but there are a few missing parts. I don't ever do linear combinations of chi(k) myself and am slightly skeptical that they are robust, so they've haven't surfaced to the top of the ToDo list yet. Any help would be greatly appreciated. --Matt
This is interesting. Could you say more about your skepticism of the robustness of EXAFS LCF, Matt? To be fair, it suffers from many of the same drawbacks of XANES LCF, plus others. But I'm curious about your thoughts on it since yours seems to be what amounts to a "strong opinion" on the subject.
On Aug 9, 2018, at 12:56 PM, Matt Newville
wrote: Hi Garret,
On Thu, Aug 9, 2018 at 12:27 PM Garret Bland
wrote: Hello! I've recently been trying to use Larch instead of Athena for EXAFS analysis, and I mainly do linear combination fitting for my samples. It seems that the XANES fitting is doing just fine requesting a specified region to fit (-25 to +75 eV). When I try to fit in the k-space however, Larch does not request a specific region in k space. I try to input the eV values corresponding to the k value I want to fit, but it is still plotting in mu rather than k . Is there anyway I can change this and/or do it manually on the larch GUI? Any help would be appreciated!
You're right that linear combinations in k-space are not really working in Larch's XAS Viewer, including that the range can only be set in energy. Much of XAS Viewer is fairly new -- I think it is fairly complete, but there are a few missing parts. I don't ever do linear combinations of chi(k) myself and am slightly skeptical that they are robust, so they've haven't surfaced to the top of the ToDo list yet. Any help would be greatly appreciated.
--Matt
_______________________________________________ Ifeffit mailing list Ifeffit@millenia.cars.aps.anl.gov http://millenia.cars.aps.anl.gov/mailman/listinfo/ifeffit Unsubscribe: http://millenia.cars.aps.anl.gov/mailman/options/ifeffit
Hi Mike,
On Thu, Aug 9, 2018 at 10:04 PM Mike Massey
This is interesting. Could you say more about your skepticism of the robustness of EXAFS LCF, Matt?
To be fair, it suffers from many of the same drawbacks of XANES LCF, plus others. But I'm curious about your thoughts on it since yours seems to be what amounts to a "strong opinion" on the subject.
I would not say that no one should ever do linear combination fitting for EXAFS. For sure, linear analysis of XANES is quite robust and verified many times to give good results, at least at level of a few percent. Linear analysis of EXAFS suffers more data processing challenges and conceptual problems that limit its robustness. For sure, there are cases for which it can work well. Longer answer: Any linear analysis (LCF, PCA, MCR-ALS, etc) of XANES works reasonably well (typically to a few percent) because: a) the processing needed is minimal. Data need to have a common energy calibration better than the intrinsic energy resolution -- typically energy calibration of 0.25 eV or better will be OK. Data need to have a consistent normalization of mu(E), typically to a few percent. Variations in these processing steps will have a direct and negative effect on the results. b) conceptually, the assumption is that there exists a nearly 1 to 1 correspondence between "local chemical configuration" and "measured XANES", and that the "local chemical configurations" that are being investigated are discrete and well-defined (ie "iron carbonate") and not continuous. That is, if you determine that your Fe XANES spectra is "50% iron carbonate and 50% iron sulfate" then implicit conclusion is that 50% of the iron atoms are iron carbonate and 50 percent are iron sulfate, not that all irons are 50% carbonate and 50% sulfate. To be clear, linear analysis of XANES does not work well to ppm levels, partly due to the poor experimental contrast (that is, mu(E) tend to all look alike and features are intrinsically broadened to the ~eV level), but also conceptually, because at the ppm level, local chemical configurations are not always limited to 3 to 10 discrete states. Linear Combination EXAFS is more challenging from both the processing and conceptual point of view. For Processing, EXAFS requires more data processing than XANES. The selection of E0 and the background mu0(E) will have an effect on linear analysis of EXAFS if not done consistently. It is not really obvious how E0 or mu0(E) can be selected consistently for very different spectra. Conceptually, EXAFS is much more sensitive to disorder and subtle variations in the bond lengths (thermal or static disorder) and can have significant variation in its sensitivity to second and further neighbors. In that sense, EXAFS is much less discrete and much more continuous in its variability across different kinds of local structures. Again, this is not to say that linear analysis of EXAFS cannot ever work, just that is probably more limited in applicability and absolute accuracy than linear analysis of XANES. Of course, for EXAFS you can also do an actual fit of structural parameters. The information content is somewhat limited so that refining multiple overlapping components may not always be possible, and linear combinations of end-member spectra may look attractive.... Hopefully, anyone who has other insights or experiences will be able to correct any of my misunderstandings. --Matt
Hi Matt, Thanks for your thoughts. In general, I agree with all of your points, but my typical uncertainty estimate for both XANES and EXAFS LCF is much greater than a few percent. Typically I quote 10-15% uncertainty, depending on the analysis. I particularly agree with your point regarding disorder. In my limited experience, anyway, if one attempts an EXAFS LCF of a nanoscale material with a spectrum from a nice, well-ordered bulk crystal, for example, the results are unworkable. Even if it's the right material and the oscillations happen to be in the right places, the amplitudes are all wrong and the fit will be useless. So the EXAFS LCF is probably even more sensitive to choice of fitting components than XANES. As usual, care is warranted, grains of salt and whatnot. Thanks again, Mike
On Aug 12, 2018, at 10:19 PM, Matt Newville
wrote: Hi Mike,
On Thu, Aug 9, 2018 at 10:04 PM Mike Massey
wrote: This is interesting. Could you say more about your skepticism of the robustness of EXAFS LCF, Matt? To be fair, it suffers from many of the same drawbacks of XANES LCF, plus others. But I'm curious about your thoughts on it since yours seems to be what amounts to a "strong opinion" on the subject.
I would not say that no one should ever do linear combination fitting for EXAFS. For sure, linear analysis of XANES is quite robust and verified many times to give good results, at least at level of a few percent. Linear analysis of EXAFS suffers more data processing challenges and conceptual problems that limit its robustness. For sure, there are cases for which it can work well.
Longer answer: Any linear analysis (LCF, PCA, MCR-ALS, etc) of XANES works reasonably well (typically to a few percent) because: a) the processing needed is minimal. Data need to have a common energy calibration better than the intrinsic energy resolution -- typically energy calibration of 0.25 eV or better will be OK. Data need to have a consistent normalization of mu(E), typically to a few percent. Variations in these processing steps will have a direct and negative effect on the results.
b) conceptually, the assumption is that there exists a nearly 1 to 1 correspondence between "local chemical configuration" and "measured XANES", and that the "local chemical configurations" that are being investigated are discrete and well-defined (ie "iron carbonate") and not continuous. That is, if you determine that your Fe XANES spectra is "50% iron carbonate and 50% iron sulfate" then implicit conclusion is that 50% of the iron atoms are iron carbonate and 50 percent are iron sulfate, not that all irons are 50% carbonate and 50% sulfate.
To be clear, linear analysis of XANES does not work well to ppm levels, partly due to the poor experimental contrast (that is, mu(E) tend to all look alike and features are intrinsically broadened to the ~eV level), but also conceptually, because at the ppm level, local chemical configurations are not always limited to 3 to 10 discrete states.
Linear Combination EXAFS is more challenging from both the processing and conceptual point of view.
For Processing, EXAFS requires more data processing than XANES. The selection of E0 and the background mu0(E) will have an effect on linear analysis of EXAFS if not done consistently. It is not really obvious how E0 or mu0(E) can be selected consistently for very different spectra.
Conceptually, EXAFS is much more sensitive to disorder and subtle variations in the bond lengths (thermal or static disorder) and can have significant variation in its sensitivity to second and further neighbors. In that sense, EXAFS is much less discrete and much more continuous in its variability across different kinds of local structures.
Again, this is not to say that linear analysis of EXAFS cannot ever work, just that is probably more limited in applicability and absolute accuracy than linear analysis of XANES. Of course, for EXAFS you can also do an actual fit of structural parameters. The information content is somewhat limited so that refining multiple overlapping components may not always be possible, and linear combinations of end-member spectra may look attractive....
Hopefully, anyone who has other insights or experiences will be able to correct any of my misunderstandings.
--Matt
_______________________________________________ Ifeffit mailing list Ifeffit@millenia.cars.aps.anl.gov http://millenia.cars.aps.anl.gov/mailman/listinfo/ifeffit Unsubscribe: http://millenia.cars.aps.anl.gov/mailman/options/ifeffit
Matt,
Glad to read your impressions of EXAFS LCF. I've had reasonable success
with LCF using EXAFS spectra generated by ab initio molecular dynamics
(AIMD) to figure out the local structure of dopants whose preferred
coordination is symmetrically dissimilar from the crystals they inhabit,
i.e. for which there are no good experimental standards. This can be pretty
tough to do accurately with shell-by-shell fitting.
As you point out, disorder is a huge hurdle (in both LCF and shell-by-shell
EXAFS analysis). We assume that a good AIMD model will simulate thermal
disorder pretty well, but there are likely differences in configurational
disorder between a periodic infinite structure and the real material due to
defects. Fortunately, defects can be explicitly accounted for in a
simulation, assuming you have the computational capability to screen a set
of defect configurations.
Background subtraction should ideally be done using the same procedure for
all data. Theoretical data could be used to refine a background subtraction
procedure; spline fit parameters such as Rbkg or clamping may be tweaked to
improve agreement between a simulated chi(k) and a measured standard over a
reasonable k-range.
Simulating spectra with a range of binding energy offsets can explicitly
address the problem of E0 choice, but it can also be used as a fudge factor
for strain. In my LCFs, dE0 is the only parameter besides the fractions of
the chosen phases.
To address the above problems, benchmarking is key. Quantitative agreement
should be sought between simulated spectra and experimental standards to
ensure the theory is sound and the chi(k) extraction is reasonable.
However, there are probably still systematic sources of error which are
larger than the uncertainties Athena's LCF tool will report; I agree with
Mike's practical estimate of 10% or so.
I discuss these issues in somewhat greater detail in my recent (open
access!) article that demonstrates how LCF using AIMD-simulated spectra
yields answers that shell-by-shell fitting struggles with due to multiple
overlapping components: https://pubs.acs.org/doi/10.1021/acs.est.8b00297
Martin
On Sun, Aug 12, 2018 at 10:19 PM, Matt Newville
Hi Mike,
On Thu, Aug 9, 2018 at 10:04 PM Mike Massey
wrote: This is interesting. Could you say more about your skepticism of the robustness of EXAFS LCF, Matt?
To be fair, it suffers from many of the same drawbacks of XANES LCF, plus others. But I'm curious about your thoughts on it since yours seems to be what amounts to a "strong opinion" on the subject.
I would not say that no one should ever do linear combination fitting for EXAFS. For sure, linear analysis of XANES is quite robust and verified many times to give good results, at least at level of a few percent. Linear analysis of EXAFS suffers more data processing challenges and conceptual problems that limit its robustness. For sure, there are cases for which it can work well.
Longer answer: Any linear analysis (LCF, PCA, MCR-ALS, etc) of XANES works reasonably well (typically to a few percent) because: a) the processing needed is minimal. Data need to have a common energy calibration better than the intrinsic energy resolution -- typically energy calibration of 0.25 eV or better will be OK. Data need to have a consistent normalization of mu(E), typically to a few percent. Variations in these processing steps will have a direct and negative effect on the results.
b) conceptually, the assumption is that there exists a nearly 1 to 1 correspondence between "local chemical configuration" and "measured XANES", and that the "local chemical configurations" that are being investigated are discrete and well-defined (ie "iron carbonate") and not continuous. That is, if you determine that your Fe XANES spectra is "50% iron carbonate and 50% iron sulfate" then implicit conclusion is that 50% of the iron atoms are iron carbonate and 50 percent are iron sulfate, not that all irons are 50% carbonate and 50% sulfate.
To be clear, linear analysis of XANES does not work well to ppm levels, partly due to the poor experimental contrast (that is, mu(E) tend to all look alike and features are intrinsically broadened to the ~eV level), but also conceptually, because at the ppm level, local chemical configurations are not always limited to 3 to 10 discrete states.
Linear Combination EXAFS is more challenging from both the processing and conceptual point of view.
For Processing, EXAFS requires more data processing than XANES. The selection of E0 and the background mu0(E) will have an effect on linear analysis of EXAFS if not done consistently. It is not really obvious how E0 or mu0(E) can be selected consistently for very different spectra.
Conceptually, EXAFS is much more sensitive to disorder and subtle variations in the bond lengths (thermal or static disorder) and can have significant variation in its sensitivity to second and further neighbors. In that sense, EXAFS is much less discrete and much more continuous in its variability across different kinds of local structures.
Again, this is not to say that linear analysis of EXAFS cannot ever work, just that is probably more limited in applicability and absolute accuracy than linear analysis of XANES. Of course, for EXAFS you can also do an actual fit of structural parameters. The information content is somewhat limited so that refining multiple overlapping components may not always be possible, and linear combinations of end-member spectra may look attractive....
Hopefully, anyone who has other insights or experiences will be able to correct any of my misunderstandings.
--Matt
_______________________________________________ Ifeffit mailing list Ifeffit@millenia.cars.aps.anl.gov http://millenia.cars.aps.anl.gov/mailman/listinfo/ifeffit Unsubscribe: http://millenia.cars.aps.anl.gov/mailman/options/ifeffit
Hi Martin and Mike,
Thanks -- I'll take a closer look at your paper on this! I think we all
basically agree that linear analysis of EXAFS can work, but also that
compared to linear analysis of XANES, linear analysis of EXAFS has a few
more caveats and issues that need to be addressed for each case.
On Mon, Aug 13, 2018 at 8:26 PM Martin McBriarty
Matt,
Glad to read your impressions of EXAFS LCF. I've had reasonable success with LCF using EXAFS spectra generated by ab initio molecular dynamics (AIMD) to figure out the local structure of dopants whose preferred coordination is symmetrically dissimilar from the crystals they inhabit, i.e. for which there are no good experimental standards. This can be pretty tough to do accurately with shell-by-shell fitting.
As you point out, disorder is a huge hurdle (in both LCF and shell-by-shell EXAFS analysis). We assume that a good AIMD model will simulate thermal disorder pretty well, but there are likely differences in configurational disorder between a periodic infinite structure and the real material due to defects. Fortunately, defects can be explicitly accounted for in a simulation, assuming you have the computational capability to screen a set of defect configurations.
Background subtraction should ideally be done using the same procedure for all data. Theoretical data could be used to refine a background subtraction procedure; spline fit parameters such as Rbkg or clamping may be tweaked to improve agreement between a simulated chi(k) and a measured standard over a reasonable k-range.
Simulating spectra with a range of binding energy offsets can explicitly address the problem of E0 choice, but it can also be used as a fudge factor for strain. In my LCFs, dE0 is the only parameter besides the fractions of the chosen phases.
To address the above problems, benchmarking is key. Quantitative agreement should be sought between simulated spectra and experimental standards to ensure the theory is sound and the chi(k) extraction is reasonable. However, there are probably still systematic sources of error which are larger than the uncertainties Athena's LCF tool will report; I agree with Mike's practical estimate of 10% or so.
I discuss these issues in somewhat greater detail in my recent (open access!) article that demonstrates how LCF using AIMD-simulated spectra yields answers that shell-by-shell fitting struggles with due to multiple overlapping components: https://pubs.acs.org/doi/10.1021/acs.est.8b00297
Martin
On Sun, Aug 12, 2018 at 10:19 PM, Matt Newville < newville@cars.uchicago.edu> wrote:
Hi Mike,
On Thu, Aug 9, 2018 at 10:04 PM Mike Massey
wrote: This is interesting. Could you say more about your skepticism of the robustness of EXAFS LCF, Matt?
To be fair, it suffers from many of the same drawbacks of XANES LCF, plus others. But I'm curious about your thoughts on it since yours seems to be what amounts to a "strong opinion" on the subject.
I would not say that no one should ever do linear combination fitting for EXAFS. For sure, linear analysis of XANES is quite robust and verified many times to give good results, at least at level of a few percent. Linear analysis of EXAFS suffers more data processing challenges and conceptual problems that limit its robustness. For sure, there are cases for which it can work well.
Longer answer: Any linear analysis (LCF, PCA, MCR-ALS, etc) of XANES works reasonably well (typically to a few percent) because: a) the processing needed is minimal. Data need to have a common energy calibration better than the intrinsic energy resolution -- typically energy calibration of 0.25 eV or better will be OK. Data need to have a consistent normalization of mu(E), typically to a few percent. Variations in these processing steps will have a direct and negative effect on the results.
b) conceptually, the assumption is that there exists a nearly 1 to 1 correspondence between "local chemical configuration" and "measured XANES", and that the "local chemical configurations" that are being investigated are discrete and well-defined (ie "iron carbonate") and not continuous. That is, if you determine that your Fe XANES spectra is "50% iron carbonate and 50% iron sulfate" then implicit conclusion is that 50% of the iron atoms are iron carbonate and 50 percent are iron sulfate, not that all irons are 50% carbonate and 50% sulfate.
To be clear, linear analysis of XANES does not work well to ppm levels, partly due to the poor experimental contrast (that is, mu(E) tend to all look alike and features are intrinsically broadened to the ~eV level), but also conceptually, because at the ppm level, local chemical configurations are not always limited to 3 to 10 discrete states.
Linear Combination EXAFS is more challenging from both the processing and conceptual point of view.
For Processing, EXAFS requires more data processing than XANES. The selection of E0 and the background mu0(E) will have an effect on linear analysis of EXAFS if not done consistently. It is not really obvious how E0 or mu0(E) can be selected consistently for very different spectra.
Conceptually, EXAFS is much more sensitive to disorder and subtle variations in the bond lengths (thermal or static disorder) and can have significant variation in its sensitivity to second and further neighbors. In that sense, EXAFS is much less discrete and much more continuous in its variability across different kinds of local structures.
Again, this is not to say that linear analysis of EXAFS cannot ever work, just that is probably more limited in applicability and absolute accuracy than linear analysis of XANES. Of course, for EXAFS you can also do an actual fit of structural parameters. The information content is somewhat limited so that refining multiple overlapping components may not always be possible, and linear combinations of end-member spectra may look attractive....
Hopefully, anyone who has other insights or experiences will be able to correct any of my misunderstandings.
--Matt
_______________________________________________ Ifeffit mailing list Ifeffit@millenia.cars.aps.anl.gov http://millenia.cars.aps.anl.gov/mailman/listinfo/ifeffit Unsubscribe: http://millenia.cars.aps.anl.gov/mailman/options/ifeffit
_______________________________________________ Ifeffit mailing list Ifeffit@millenia.cars.aps.anl.gov http://millenia.cars.aps.anl.gov/mailman/listinfo/ifeffit Unsubscribe: http://millenia.cars.aps.anl.gov/mailman/options/ifeffit
-- --Matt Newville <newville at cars.uchicago.edu> 630-252-0431
Thanks for the reply Matt! I mostly do linear combinations in the XANES
region as well, but with Hg, I also do first derivative of XANES and EXAFS
regions to confirm my fits.
Garret
On Thu, Aug 9, 2018 at 3:57 PM Matt Newville
Hi Garret,
On Thu, Aug 9, 2018 at 12:27 PM Garret Bland
wrote: Hello!
I've recently been trying to use Larch instead of Athena for EXAFS analysis, and I mainly do linear combination fitting for my samples. It seems that the XANES fitting is doing just fine requesting a specified region to fit (-25 to +75 eV). When I try to fit in the k-space however, Larch does not request a specific region in k space. I try to input the eV values corresponding to the k value I want to fit, but it is still plotting in mu rather than k . Is there anyway I can change this and/or do it manually on the larch GUI? Any help would be appreciated!
You're right that linear combinations in k-space are not really working in Larch's XAS Viewer, including that the range can only be set in energy. Much of XAS Viewer is fairly new -- I think it is fairly complete, but there are a few missing parts. I don't ever do linear combinations of chi(k) myself and am slightly skeptical that they are robust, so they've haven't surfaced to the top of the ToDo list yet. Any help would be greatly appreciated.
--Matt
_______________________________________________ Ifeffit mailing list Ifeffit@millenia.cars.aps.anl.gov http://millenia.cars.aps.anl.gov/mailman/listinfo/ifeffit Unsubscribe: http://millenia.cars.aps.anl.gov/mailman/options/ifeffit
-- Garret Bland Graduate Student Carnegie Mellon University Civil and Environmental Engineering Porter Hall 207C Pittsburgh, PA, 15213
participants (4)
-
Garret Bland
-
Martin McBriarty
-
Matt Newville
-
Mike Massey