Day 3 Thursday 25 June 2026

Day 3 focused on the practical application of simulation-based inference (SBI) and machine learning to bridge the gap between complex astrophysical simulations and observational data. The sessions spanned a wide range of scales, from the global cosmological constraints of weak lensing and galaxy populations to the detailed physical conditions of the interstellar medium. A recurring theme was the optimization of these models, specifically through techniques to reduce computational costs, handle model misspecification, and leverage data-driven embeddings.

Computational efficiency and multifidelity modelingMitigating model misspecification and systematic uncertaintiesData-driven embeddings and transformer-based alignmentParameter estimation for galaxy and ISM physicsScaling SBI for next-generation cosmological surveys
32 slides

Galaxy Evolution Meets Cosmological Inference

2026-06-25T10:09:06
Hiranya Peiris — Institute of Astronomy, University of Cambridge

The speaker presents pop-cosmos, a simulation-based inference framework designed to model the joint distribution of galaxy properties to reduce systematic uncertainties in next-generation cosmological surveys. By learning the relationship between multiwavelength photometry and physical properties, the framework improves photometric redshift calibration, mitigates intrinsic alignment contamination, and enhances Type Ia supernova standardization.

  • Cosmological surveys like LSST, Euclid, and Roman are increasingly limited by systematic uncertainties related to galaxy population modeling.
  • The pop-cosmos framework uses a generative model to learn the high-dimensional distribution of galaxy properties (redshift, mass, star formation, etc.) from deep photometric data.
  • The model provides more accurate redshift distributions for weak lensing tomography compared to standard calibration techniques.
  • Physically-motivated sample selection using pop-cosmos allows for the mitigation of intrinsic alignment by targeting specific galaxy types, reducing data loss from 40% to 10%.
  • The framework improves Type Ia supernova standardization by using host galaxy property inference to reduce mass bias from ~7% to <1%.
  • The system is scaling to process billions of galaxies, utilizing significant GPU resources (e.g., 620,000 GPU-hours) for Bayesian inference.
Cosmological InferenceGalaxy EvolutionSimulation-Based InferenceWeak LensingPhotometric Redshifts
Abstract (conference schedule)

Next-generation cosmological surveys — LSST, Euclid, Roman — will be limited not by statistical power but by systematic uncertainties rooted in our understanding of galaxy populations. Photometric redshift calibration, intrinsic alignments, and baryonic effects on the matter power spectrum are all manifestations of the same underlying problem: cosmological inference requires an accurate model of the galaxy population and its evolution. I will present pop-cosmos, a simulation-based inference framework that learns the joint distribution of galaxy properties — redshift, stellar mass, star formation history, dust, metallicity, and black hole activity — from deep multiwavelength photometric data. The resulting generative model simultaneously delivers calibrated redshift distributions for weak lensing tomography, enables physically-motivated sample selection that mitigates intrinsic alignment contamination and unlocks multi-tracer clustering analyses, and provides improved Type Ia supernova standardisation through host galaxy property inference. It also reveals the astrophysical processes — including black-hole-driven feedback and the cessation of star formation — that shape the very populations we use as cosmological tracers. I will show applications spanning the Kilo-Degree Survey, DESI, the Zwicky Transient Facility, and COSMOS-Web, illustrating how a unified model of galaxy evolution connects to the next generation of cosmological constraints.

Questions for the speaker (3)
  1. How does the pop-cosmos framework handle the trade-off between model complexity and the risk of overfitting when learning the joint distribution of galaxy properties from the COSMOS-Web training set?
  2. Regarding the reduction of intrinsic alignment contamination, what specific physical properties are being used to define the 'clean' sample, and how was the 10% cut threshold determined to be sufficient?
  3. You mentioned that the model's abundances are not yet accurate when extrapolating to the brighter magnitude regimes of the Gamma survey; what specific modifications to the generative prior are needed to correct these abundance discrepancies?
7 slides

Minimum Distance Summaries for Robust Neural Posterior Estimation

2026-06-25T10:45:52
Sherman Khoo — University of Bristol

The speaker presents a plug-in method to improve the robustness of Neural Posterior Estimation (NPE) against model misspecification at test time. By using Maximum Mean Discrepancy (MMD) to find a minimum-distance summary statistic, the method adapts to misspecified observations without requiring the retraining of the pretrained NPE.

  • Model misspecification in simulation-based inference (SBI) often degrades the reliability of neural amortized estimators due to extrapolation issues.
  • Existing robust SBI methods often require retraining the entire inference network, which is computationally expensive and breaks modularity.
  • The proposed method introduces a 'decoder mean embedding' learned offline via regression to map summary statistics to a high-dimensional feature space.
  • At test time, a robust summary statistic (s*) is found by minimizing the MMD between the observed data and the decoder distribution.
  • The use of random Fourier features allows for efficient implementation of the MMD distance calculation.
  • Empirical results demonstrate that the method corrects posterior bias caused by contaminated data, shifting the posterior back toward the true parameters.
Simulation-based inferenceNeural Posterior EstimationModel MisspecificationMaximum Mean DiscrepancyTest-time adaptation
Abstract (conference schedule)

Simulation-based inference (SBI) enables amortized Bayesian inference by first training a neural posterior estimator (NPE) on prior-simulator pairs, typically through low-dimensional summary statistics, which can then be cheaply reused for fast inference by querying it on new test observations. Because NPE is estimated under the training data distribution, it is susceptible to misspecification when observations deviate from the training distribution. Many robust SBI approaches address this by modifying NPE training or introducing error models, coupling robustness to the inference network and compromising amortization and modularity. We introduce minimum-distance summaries, a plug-in robust NPE method that adapts queried test-time summaries independently of the pretrained NPE. Leveraging the maximum mean discrepancy (MMD) as a distance between observed data and a summary-conditional predictive distribution, the adapted summary inherits strong robustness properties from the MMD. We demonstrate that the algorithm can be implemented efficiently with random Fourier feature approximations, yielding a lightweight, model-free test-time adaptation procedure. We provide theoretical guarantees for the robustness of our algorithm and empirically evaluate it on a range of synthetic and real-world tasks, demonstrating substantial robustness gains with minimal additional overhead.

Questions for the speaker (3)
  1. How does the choice of kernel for the MMD affect the balance between outlier robustness and the ability to capture higher-order moments of the distribution?
  2. In the test-time optimization to find s*, what is the typical computational overhead compared to a standard NPE query, and how does it scale with the dimensionality of the summary space?
  3. You mentioned the method works even when the functional form of the model is completely different; what are the theoretical limits of this adaptation before the decoder mean embedding becomes an invalid reference?
15 slides

Field-level cosmology with <100 simulations using multifidelity SBI: a proof-of-concept for KiDS-legacy weak lensing

2026-06-25T11:00:50
Alex Saoulis — UCL

This talk presents a multifidelity simulation-based inference (SBI) framework designed to extract cosmological information from weak lensing shear fields while minimizing the need for expensive high-fidelity simulations. By pre-training neural compression and density estimation models on cheap log-normal simulations and fine-tuning them on a small set of N-body simulations, the author demonstrates that accurate and well-calibrated posteriors can be achieved with significantly fewer high-fidelity samples.

  • Addressed the tension between the need for large training sets in SBI and the high computational cost of physically realistic N-body simulations.
  • Implemented a transfer learning approach where models are pre-trained on low-fidelity log-normal GLASS simulations and fine-tuned on high-fidelity N-body simulations.
  • Utilized a hybrid compression strategy that first learns summaries from two-point power spectra and then combines them with field-level summaries from a CNN.
  • Demonstrated that multifidelity Neural Posterior Estimation (NPE) can achieve informative results with as few as 60-100 high-fidelity simulations, an order-of-magnitude reduction compared to naive SBI.
  • Showed that ensemble learning further reduces calibration error and improves the precision of cosmological constraints.
  • Applied the method to Neural Likelihood Estimation (NLE), enabling the use of varying priors (e.g., $\Lambda$CDM vs $w$CDM) during inference.
Simulation-Based InferenceWeak LensingMultifidelity LearningNeural Posterior EstimationCosmology
Abstract (conference schedule)

The weak lensing shear field encodes substantially more cosmological information than standard summary statistics such as the power spectrum. Field-level inference can fully exploit this information, but physical realism at the field-level requires very high fidelity simulations. This poses a major challenge for SBI: extracting maximal information with deep-learning-based neural compression requires many training simulations, but achieving physical realism at the field level makes each simulation extremely costly. We demonstrate that multifidelity SBI can alleviate this tension by dramatically reducing the number of high-fidelity simulations needed for accurate cosmological inference. We pre-train neural compression models on KiDS-legacy-like shear mocks using fast log-normal GLASS simulations and fine-tune them on a small set of high-fidelity $N$-body simulations. We show that as few as 60-100 high-fidelity simulations are sufficient to obtain informative and well-calibrated cosmological posteriors, enabling an order-of-magnitude reduction in simulation cost for accurate field-level inference in a realistic setting.

Questions for the speaker (3)
  1. In the hybrid compression stage, what is the rationale for freezing the power spectrum summaries before learning the field-level summaries, and would joint training yield better results?
  2. You mentioned that NLE calibration error was too high without transfer learning; does the multifidelity approach specifically resolve a failure mode of the likelihood estimator that is not present in NPE?
  3. How does the performance of the multifidelity approach degrade if there is a significant mismatch in the parameter space or physics between the log-normal pre-training set and the N-body fine-tuning set?
21 slides

Connecting Stars and Gas: a data driven approach to modeling gas emission based on stellar continuum using DESI

2026-06-25T11:51:38
Eduardo Albuquerque Hartmann — IAC

The speaker presents a purely empirical, data-driven approach to modeling galaxy emission lines using DESI DR1 data, bypassing traditional photoionization codes like Cloudy. By training two transformers to align the embedding spaces of stellar continuum and emission line regions, the model can reconstruct emission lines and predict galaxy properties based solely on the stellar continuum.

  • Developed a foundation model inspired by AstroCLIP, using two transformers to align embeddings of the continuum-dominated and emission-line regions of galaxy spectra.
  • Demonstrated the ability to reconstruct emission lines (e.g., H-alpha, H-beta, [OIII], [NII]) using only continuum embeddings via a Gaussian Mixture Density Network.
  • Compared results against the Bagpipes spectral fitting code, finding the empirical approach to be a fast and reliable alternative for star-forming galaxies.
  • Used the aligned embedding space for downstream tasks, including predicting equivalent widths (EW), SDSS magnitudes, and stellar mass.
  • Successfully reconstructed BPT diagrams from predicted equivalent widths, showing a strong correlation with observed data.
  • Noted decreased performance for composite galaxies due to non-stellar ionization sources not captured in the continuum embeddings.
Deep LearningGalaxy SpectraDESIEmission LinesFoundation Models
Abstract (conference schedule)

Recent and upcoming large-scale spectroscopic surveys such as DESI, WEAVE, and 4MOST are providing an unprecedented view of galaxies across a wide redshift range. This vast amount of data poses a challenge for analysis with traditional tools. At the same time, it coincides with a revolution in machine learning, particularly deep learning and foundation models, which are uniquely capable of absorbing this wealth of information. In this context, we have leveraged data from DESI DR1 to develop a foundation model that encodes fundamental information from the stellar populations and gas emission in galaxies. We demonstrate that the resulting aligned embedding space can be used to robustly and efficiently obtain properties such as color, emission-line equivalent widths, and even fundamental galaxy properties such as mass and age. More importantly, it can be used to reconstruct emission lines using continuum input alone, providing a fast, reliable, and purely empirical alternative to codes such as Cloudy, thereby establishing a powerful connection between stellar and gas physics. Finally, we show how this approach is being integrated into an SBI pipeline to infer star formation histories and galaxy properties, enabling deeper insights into galaxy evolution.

Questions for the speaker (3)
  1. Given that composite galaxies perform worse due to non-stellar ionization sources, how could the model be adapted to account for AGN contributions without relying on the very models you aim to bypass?
  2. In the comparison with Bagpipes, you noted a bias in the latter's predictions; what specific physical assumptions in Bagpipes' Cloudy-based modeling might be causing this discrepancy compared to your empirical approach?
  3. You mentioned using a Sequential Neural Posterior Estimator for predicting equivalent widths; why was this specific architecture chosen over a standard regression network for this downstream task?
18 slides

Mapping Nebular Structure and ISM Conditions with SBI

2026-06-25T12:42:17
Caterina Bracci — UniFI / INAF / ESO

The speaker presents two machine learning frameworks to analyze the ionized interstellar medium (ISM) in local galaxies. The first uses a neural network trained on synthetic spectra to classify nebular regions in integral field data cubes, while the second employs simulation-based inference (SBI) to constrain physical parameters like metallicity and ionization.

  • Developed a neural network to classify nebular regions (HII regions, planetary nebulae, supernova remnants, and diffuse gas) using mock spectra that simulate realistic observational noise and extinction.
  • Applied the classification network to MUSE observations of the galaxy NGC 33, successfully identifying regions consistent with existing literature.
  • Implemented an SBI framework using Cloudy photoionization models to retrieve posterior distributions for metallicity, ionization parameter (log U), and N/O abundance ratio.
  • Compared SBI results with Nested Sampling, finding consistent parameter recovery but noting that SBI posterior spreads reach a plateau at high signal-to-noise ratios.
  • Identified a bimodal degeneracy in metallicity posteriors, which the speaker attributes to the inclusion of the N/O ratio as a free parameter rather than tying it to a fixed prescription.
  • Proposed moving toward a multi-cloud modeling framework to better reproduce observed emission lines compared to single-cloud models.
Interstellar Medium (ISM)Simulation-Based Inference (SBI)Photoionisation ModelsNeural NetworksIntegral Field Spectroscopy
Abstract (conference schedule)

Inferring the physical conditions of the ionised interstellar medium (ISM) from nebular emission lines is central to understanding star formation and chemical enrichment in galaxies. Yet, it remains a challenging inverse problem, especially as modern spectroscopic surveys deliver data at unprecedented scale and complexity. Hence, I present two frameworks that leverage machine learning and physically motivated forward simulations to analyse spectroscopic observations of the ionised ISM in local galaxies. First, I show how we use synthetic spectra generated with photoionisation models under realistic observational conditions to train a neural network to identify different nebular regions and separate them from the surrounding diffuse ionised gas in integral field data cubes. By training directly on simulated data, the model learns robust spectral features beyond simple line-ratio thresholds. Consequently, the model defines physically meaningful nebular boundaries that account for line-of-sight superpositions. Additionally, we apply interpretability methods to identify which spectral features drive the network’s classification, allowing us to both verify that the model relies on physically meaningful emission lines and explore potential new diagnostics. Building on a similar forward-modelling method, I then present a simulation-based inference framework to constrain ISM physical conditions, delivering full posterior distributions for metallicity, ionisation parameter, and relative abundances without requiring an explicit likelihood. The retrieved posterior distributions are consistent with results from traditional Bayesian approaches, such as Nested Sampling, while the increased inference speed enables efficient analysis of modern spectroscopic surveys. Together, these machine learning techniques offer a promising route to extract detailed ISM physics from modern IFS campaigns probing the star formation and feedback scales in the local Universe.

Questions for the speaker (3)
  1. Regarding the plateau in posterior spread observed for SBI at high signal-to-noise ratios compared to Nested Sampling, do you suspect this is an artifact of the training set density or a fundamental difference in how the two methods handle the likelihood surface?
  2. You mentioned that tying the N/O ratio to a specific prescription removes the bimodal degeneracy in metallicity; what physical justification exists for choosing one specific prescription over another when analyzing diverse HII regions?
  3. When transitioning to a multi-cloud framework, how do you plan to handle the increased dimensionality of the parameter space within the SBI framework to avoid prohibitive computational costs?