Day 2 Wednesday 24 June 2026

The second day of SBI4GALEV focused on scaling simulation-based inference to meet the demands of high-dimensional astronomical data and computationally expensive forward models. Presentations spanned a wide range of applications, from galaxy clustering and SED fitting to gravitational wave analysis for LISA, with a strong emphasis on reducing the simulation bottleneck. A significant portion of the day was dedicated to the emergence of diffusion models as flexible alternatives to normalizing flows for posterior estimation and data inpainting. The day concluded with a call for community standardization through a proposed SBI data challenge and the introduction of the Synference framework.

Overcoming the simulation bottleneck via emulators and multi-fidelity modelsApplication of diffusion and score-based models for flexible inferenceRobustness to model misspecification and data contaminationScaling inference for next-generation large-scale surveysIntegration of hydrodynamic simulations and baryonic feedback
22 slides

Addressing the Simulation Bottleneck in Simulation-Based Inference

2026-06-24T10:01:50
Maximilian von Wietersheim

This pedagogical talk explores strategies to overcome the high computational cost of generating simulations for Simulation-Based Inference (SBI) in cosmology and astrophysics. The speaker discusses methods to reduce the number of required simulations, lower the cost per simulation, and maximize the information extracted from each run, illustrating these concepts through a case study on galaxy-scale strong lensing.

  • Sequential and active learning can reduce the number of simulations needed by focusing on high-posterior regions of the parameter space.
  • Multi-fidelity SBI and transfer learning allow the use of cheap, low-fidelity models (e.g., analytic or log-normal) to inform high-fidelity N-body or hydro simulations.
  • Emulators can bypass expensive computations, though they introduce risks of out-of-distribution errors and up-front training costs.
  • JIT-compilation and GPU migration (e.g., using JAX) significantly speed up forward models and facilitate differentiable compression.
  • Neural compression and hybrid statistics (combining neural embeddings with power spectra) improve the information gain per simulation.
  • Application to strong lensing demonstrates that SBI can handle 'dirty' images (e.g., from ALMA) without traditional cleaning by focusing on substructure response.
Simulation-Based Inference (SBI)Active LearningMulti-fidelity ModelingStrong Gravitational LensingNeural CompressionCosmology
Abstract (conference schedule)

The application of Simulation-Based Inference (SBI) in galaxy evolution and cosmology provides a powerful implicit-likelihood framework to connect fundamental physics with complex observational data from telescopes such as Euclid, the Rubin Observatory, DESI, and JWST. However, the field faces a critical computational bottleneck: the massive simulation budget required to forward-model multi-scale phenomena, from the detailed sub-grid baryonic physics of galaxy formation to large-scale dark matter structure. This discussion session will synthesise recent advancements designed to dismantle these limitations. Drawing on successes from recent massive survey pipelines and proof-of-concept studies (e.g., emulation of the galaxy-halo connection or rapid spectro-photometric SED fitting), we will explore how novel sequential and active learning approaches iteratively target high-dimensional parameter spaces, reducing simulation budgets by orders of magnitude. We will also discuss strategies for maximising the utility of existing simulation suites, such as utilising multi-fidelity transfer learning, or reducing the need for data compression by deploying highly expressive neural density estimators. Furthermore, we will examine the critical role of neural emulators in bypassing expensive hydrodynamical runs altogether, alongside the practical trade-offs of migrating legacy CPU-based astrophysical codes to highly parallelised GPU architectures and differentiable programming frameworks. Ultimately, this session aims to collate the diverse computational tools currently at the community’s disposal, establishing community best practices and identifying which combinations of these approaches will most effectively drive the next generation of cutting-edge SBI analyses.

Questions for the speaker (3)
  1. How do you rigorously quantify and propagate the errors introduced by using low-fidelity models or emulators within the SBI framework to ensure they do not bias the final posteriors?
  2. For non-differentiable physics such as radiative transfer or nebular models, what specific surrogate architectures or 'learning around' techniques do you propose to maintain a differentiable pipeline?
  3. In your strong lensing work, how does the performance of the physically-informed 'Lensformer' layer compare to a standard CNN when marginalizing over nuisance parameters and systematics?
25 slides

OASIS: A Robust Framework for Population Inference in Astronomy

2026-06-24T10:20:18
Arya Farahi

The speaker introduces OASIS, a modular inference framework based on generalized Bayes that addresses the limitations of ratio-based estimators, such as sensitivity to misspecification and data contamination. By utilizing a flexible loss function—specifically Maximum Mean Discrepancy (MMD)—OASIS provides theoretical guarantees for identifiability and robustness against outliers and non-Gaussian noise in astronomical datasets.

  • Ratio-based estimators often fail under real-world observational conditions like heteroscedastic noise and data contamination.
  • OASIS uses a generalized Bayes framework to construct a pseudo-posterior based on a user-defined loss function and a temperature parameter for uncertainty control.
  • Maximum Mean Discrepancy (MMD) is highlighted as an effective loss function for its robustness to outliers and ability to handle measurement noise.
  • The method demonstrates superior performance over traditional Bayesian methods in linear regression with contamination and non-Gaussian density estimation.
  • The framework is applicable to high-dimensional data, such as image deconvolution, though it may require specific loss functions for tasks like cluster abundance analysis.
  • OASIS is developed as part of the Cosmic AI institute to provide transparent and theoretically grounded uncertainty quantification.
Generalized BayesMaximum Mean Discrepancy (MMD)Population InferenceRobust StatisticsAstronomy
Abstract (conference schedule)

We introduce OASIS a scalable simulation-based inference framework designed for complex scientific simulators like those in the DREAMS cosmology project, a suite of thousands of state-of-the-art hydrodynamic and cosmological simulations aimed at understanding dark matter and galaxy formation by systematically varying astrophysical and cosmological parameters. OASIS explicitly embeds the noise model into the simulator and performs inference directly at the level of observed-data distributions. The method constructs a pseudo-posterior by utilizing maximum mean discrepancy (MMD) loss between the empirical distributions of the observed data and forward-simulated observations. We demonstrate application of this method in several parametric and non-parametric settings. Our SBI method builds inference around a lightweight projection of the data via a surrogate regression. Candidate parameters are evaluated by simulating small batches and assigning weights based on residual discrepancies with the projected data. The resulting self-normalized pseudo-posterior is computationally efficient, highly parallelizable, and requires only the fitted regression summaries, making it well suited to workflows that must repeatedly interrogate large simulation suites. We demonstrate the practical value of this approach in cosmological parameter calibration tasks using DREAMS data, where traditional likelihood-based techniques are impractical due to the simulator complexity and size. As the DREAMS papers have shown, statistical characterization of dark matter speed distributions and halo structural properties across large ensembles is crucial for interpreting astrophysical measurements and experimental constraints. Our lightweight SBI framework enables such calibration with significantly reduced computational overhead while offering insight into when low-dimensional projections suffice versus when richer summaries are needed to capture the underlying astrophysical variability.

Questions for the speaker (3)
  1. How should a user practically determine the optimal temperature parameter to ensure that the resulting uncertainty quantification aligns with frequentist coverage?
  2. Given that MMD has a computational complexity of O(n^2), what strategies or approximations are recommended when scaling OASIS to catalogues with billions of data points?
  3. In the cluster cosmology example, you noted that MMD underperformed because it lacks a notion of abundance; what specific modifications to the loss function would be required to capture abundance while maintaining robustness?
18 slides

GalSBI: Forward Modelling Galaxy Clustering and Population

2026-06-24T10:38:38
Silvan Fischbacher

The speaker presents an extension to the GalSBI forward modeling framework that incorporates realistic galaxy clustering by integrating halo catalogs from Pinocchio with a galaxy population model. By utilizing entropic optimal transport for efficient sub-halo matching, the model generates realistic image simulations and galaxy distributions that match observed data from the Dark Energy Survey (DES) and Hyper Suprime-Cam (HSC).

  • Introduced realistic galaxy positions into the GalSBI framework to enable studies of galaxy clustering and galaxy-galaxy lensing.
  • Implemented an efficient Sub-Halo Abundance Matching (SHAM) process using entropic optimal transport between halo mass functions and luminosity functions.
  • Utilized Pinocchio for halo catalogs and added sub-halos via merger history information to improve spatial accuracy.
  • Updated the emulator framework to use direct image simulation for galaxy detection to avoid biases caused by local blending in high-density regions.
  • Demonstrated that including clustering produces 'spiky' redshift distributions consistent with COSMOS data, unlike the smooth distributions of non-clustered models.
  • Validated the model against DES and HSC data, showing strong agreement in angular power spectra and photometric/morphological measurements.
Forward ModelingGalaxy ClusteringSub-Halo Abundance Matching (SHAM)CosmologyOptimal Transport
Abstract (conference schedule)

Accurate modelling of galaxy populations is critical for unlocking the full potential of cosmological large-scale structure surveys, from quantifying selection effects to image-based calibration and photometric redshift estimation. In this talk, I will present GalSBI, an open-source framework for constructing highly realistic synthetic galaxy catalogs, constrained end-to-end with simulation-based inference. GalSBI combines parametric descriptions of luminosity functions, morphologies, and spectral energy distributions with SHAM-OT — a novel subhalo abundance matching scheme based on optimal transport — to jointly model the photometric and spatial properties of observed galaxy populations. Model parameters are inferred via an iterative Approximate Bayesian Computation scheme by comparing HSC and DES imaging data to forward-modelled image simulations incorporating instrumental, observational, and source-extraction effects, including PSF and background variations and source blending. The resulting framework simultaneously reproduces observed magnitudes, colors, sizes, redshift distributions, and clustering statistics with high fidelity. By linking intrinsic galaxy populations to realistic image-level observables within a unified inference framework, GalSBI provides a scalable foundation for precision cosmology in current and next-generation surveys.

Questions for the speaker (3)
  1. Why was entropic optimal transport chosen over classic SHAM, and how does the resulting scattering in the galaxy-halo connection compare to traditional stochastic models?
  2. How does the transition probability between red and blue galaxies in a given halo mass range affect the overall amplitude of the angular power spectrum?
  3. To what extent does the reliance on Pinocchio's halo distributions limit the model's ability to capture non-linear clustering at very small scales?
3 slides

Continuous Representation of Hydrodynamic Simulations for Robust SBI

2026-06-24T12:00:21
Ming-Shau Liu

A generative model that maps cheap gravity-only (dark-matter) simulations to full hydrodynamic baryon fields, conditioned on cosmology and a learned low-dimensional “baryonic feedback” latent space (z_bar). Built on a stochastic flow-matching UNet with a ResNet encoder, it captures how different simulation suites (IllustrisTNG, SIMBA, EAGLE, Astrid, Magneticum) implement feedback differently, and enables reconstruction, interpolation and emulation of baryonic fields at a tiny fraction of the cost of running hydrodynamic simulations — working towards simulation-robust SBI and inferring baryonic feedback directly from observations.

  • Goal: infer cosmology (Ω_m, σ_8) and baryonic feedback by comparing observations, hydrodynamic simulations (stars, gas, black holes) and gravity-only dark-matter simulations.
  • Different hydrodynamic suites implement feedback very differently, producing distinct baryon distributions for the same underlying gravity — motivating one model that captures the spread.
  • Core model learns P(δ_baryons | δ_dm, C, z_bar): a stochastic flow-matching UNet plus ResNet encoder mapping dark-matter fields to baryon fields, conditioned on cosmology and an ~8-dimensional baryonic-feedback latent z_bar.
  • The latent space organises cleanly by simulation suite (t-SNE) and its axes correlate with physical feedback parameters (wind energy, thermal energy per SNII, mass loading of galactic winds, energy per star-formation rate).
  • Three demonstrated capabilities: reconstruction of unseen Magneticum maps (stars, gas, gas temperature, gas pressure), interpolation across simulations in z_bar space, and emulation of feedback variations — at ~5 GPU-minutes versus ~6000 CPU-hours for a full hydro run.
  • Generates 3-channel observation mocks (δ_gas, n_e, T) with sample variance and mean fields (targeting Fast Radio Burst dispersion and tSZ science) and up-scales a 25 Mpc model to reconstruct 50 Mpc boxes, validated with power spectra.
  • Future work: a 3D field model, a prior on z_bar for simulation-robust inference (CAMELS shows this is hard), and inferring baryonic feedback (z_bar) directly from observations.
Simulation-Based InferenceGenerative Models / Flow MatchingBaryonic FeedbackHydrodynamic SimulationsCosmology
Abstract (conference schedule)

Accurate modeling of baryonic physics remains a major challenge for precision cosmology due to our incomplete understanding of complex subgrid processes, like star formation and feedback from supernovae and active galactic nuclei below ~10 Mpc scales. This uncertainty leads to different hydrodynamical simulation suites to implement fundamentally different prescriptions for these unresolved physics. Current simulation-based inference approaches rely therefore on discrete sets of simulators, each encoding specific physical assumptions, making it difficult to robustly quantify theoretical uncertainties and learn about the underlying physics from observations. We introduce a machine learning framework that learns continuous representations of baryonic feedback across multiple simulation suites, to enable interpolation between different physical implementations while providing robust uncertainty quantification. Our approach addresses the key challenge of marginalizing over theoretical uncertainties represented by various simulators while simultaneously constraining the underlying baryonic physics from observations. We frame this as learning a shared continuous latent representation of the physics implemented across different simulators, allowing us to both marginalize over and constrain a continuous baryonic parameter space. Using the CAMELS simulation suite, we demonstrate our method on several baryonic fields including stellar mass, gas density, temperature, and pressure fields. This framework provides a path toward more robust cosmological inference by properly accounting for theoretical uncertainties in baryonic modeling while extracting maximum information about the underlying physical processes from current and future surveys.

Questions for the speaker (3)
  1. How well does the learned z_bar latent space generalise to feedback implementations not seen in training (e.g. CROCODILE, Obsidian), and does interpolation stay physical between widely separated suites?
  2. Since the latent axes correlate with feedback parameters like wind energy and mass loading, can z_bar be calibrated to physical units, or does it only provide a relative ordering across simulation suites?
  3. For the simulation-robust inference goal, how would a prior on z_bar be constructed from real observations, given that CAMELS shows cross-simulation inference is unreliable?
20 slides

Implementing 3D Intrinsic Alignment Models in Projected Simulations

2026-06-24T12:15:10
Leonor Simões

This talk examines the practical challenges of implementing 3D intrinsic alignment (IA) models, specifically NLA and TATT, within cosmological simulations. The speaker demonstrates that while TATT offers more physical detail, its quadratic terms lead to significant power blow-ups at small scales and problematic resolution dependencies when implemented at the field level.

  • Intrinsic alignment (IA) is a major systematic in weak lensing surveys that must be modeled to avoid mimicking or canceling lensing signatures.
  • The Non-Linear Alignment (NLA) model is linear and commutes with projection, making it stable and effective for red elliptical galaxies.
  • The Tidal Alignment and Tidal Torquing (TATT) model includes density weighting and tidal torquing to better capture spiral galaxy alignments.
  • Field-level implementation of TATT shows a power spectrum blow-up of roughly two orders of magnitude at small scales compared to CCL predictions.
  • Smoothing the initial density field to fix TATT's small-scale issues introduces a monotonic loss of power across all scales due to quadratic term coupling.
  • Projecting 3D models into 2D naively results in a loss of quadratic information, effectively reducing TATT to an NLA-like model.
  • Proposed future work involves using 3D halo catalogues to infuse small-scale IA predictions into projected shells.
Intrinsic AlignmentWeak LensingCosmological SimulationsNLA ModelTATT Model
Abstract (conference schedule)

Intrinsic alignments (IA) are one of the dominant astrophysical systematics for weak lensing surveys. However, higher-order IA models such as tidal alignment and tidal torquing (TATT) are formulated in three dimensions, whereas many simulations and analyses operate on projected two-dimensional quantities. This mismatch raises both practical and conceptual questions about how such models should be applied when only projected information is available. In this work, I present a field-level implementation of the TATT model applied directly to large-volume N-body simulations, with particular attention to projection effects and ensuring consistency between the three-dimensional model and its projected statistical observables. I quantify the impact of applying the alignment model before versus after projection, and examine how this choice affects the recovered power spectrum. By comparing the full three-dimensional implementation to projected reconstructions, I show that simplified pipelines can introduce biases in both the amplitude and scale dependence of intrinsic alignment signals. I highlight practical numerical and projection-related challenges that arise when modeling IA at the field level, which are important considerations for forward-modelling and likelihood-free inference methods applied to weak lensing and galaxy evolution.

Questions for the speaker (3)
  1. Given that smoothing the density field propagates power loss to large scales via quadratic coupling, are there alternative filtering methods that could isolate small-scale noise without affecting the large-scale TATT signal?
  2. In the comparison between the full 3D model projected to 2D and the adapted 2D model, what specific components of the tidal tensor are most critical to preserve to avoid the 'floor' effect where TATT reverts to NLA?
  3. How do you plan to handle the potential misalignment between subhalos and central halos when using halo catalogues to improve small-scale IA predictions?
10 slides

Diffusion Models for Simulation-Based Inference

2026-06-24T12:49:58
Giuseppe Viterbo

This talk provides an introduction to diffusion models as generative tools for simulation-based inference (SBI), contrasting them with normalizing flows. The speaker explains the mechanics of the noising and denoising processes and demonstrates how score-based modeling allows for flexible post-training constraints and compositional inference.

  • Diffusion models learn a score function (a vector field) to map noise back to a target distribution, such as a posterior in SBI.
  • Unlike continuous normalizing flows, diffusion models are less computationally expensive during training because they avoid integrating ODEs.
  • The inclusion of noise during the inference phase helps produce 'crispier' samples compared to the blurrier results often seen in normalizing flows.
  • A key advantage of score-based models is the ability to inject additional constraints or change priors after training by adding new vector fields to the learned score.
  • Compositional amortized inference (partial pooling) allows combining score estimates from multiple observations to constrain global parameters.
  • The speaker applies these techniques to galactic dynamics, specifically combining data from multiple stellar streams to constrain the Milky Way's mass distribution.
Diffusion ModelsSimulation-Based InferenceScore MatchingBayesian InferenceGalactic Dynamics
Abstract (conference schedule)

I would like to present a hierarchical simulation-based inference (SBI) framework via compositional score modeling to reconstruct the Milky Way potential using stellar streams observations. Traditional SBI approaches often struggle with scalable aggregation of multiple observations, especially when inference targets include both global physical parameters (e.g., host-galaxy potential, ) and local nuisance parameters (e.g., progenitor or orbital parameters). Compositional score modeling offers a principled mechanism to approximate the score (gradient of the log posterior) of a high-dimensional target posterior by combining learned individual posterior scores associated with each observation, enabling scalable and sample-efficient inference without explicit likelihood evaluations.

Questions for the speaker (3)
  1. When adding a custom constraint as a vector field to the learned score, how do you ensure the resulting combined field remains stable and converges to a valid distribution?
  2. In the context of partial pooling for stellar streams, how does the model handle inconsistencies or conflicting information between the score estimates of different streams?
  3. You mentioned that diffusion models are less computationally expensive to train than continuous normalizing flows; how do they compare in terms of total wall-clock time for inference (sampling)?
22 slides

Comparing Bayesian Inference Methods in Astronomy: HMC, Nested Sampling, and SBI

2026-06-24T14:46:13
Johannes Buchner

The talk provides a comparative overview of Hamiltonian Monte Carlo (HMC), Nested Sampling, and Simulation-Based Inference (SBI) for astronomical data analysis. The speaker discusses the theoretical strengths and practical limitations of each method, illustrating them with applications in X-ray spectral analysis and galaxy demographics.

  • HMC and NUTS are highly efficient for high-dimensional, differentiable posteriors but struggle with multi-modal distributions.
  • Nested Sampling is preferred for Bayesian model comparison (evidence calculation) and handling multi-modal posteriors or non-differentiable likelihoods.
  • Simulation-Based Inference (SBI) is powerful for homogeneous data but faces challenges with missing data and high-dimensional data spaces.
  • HMC diagnostics, such as divergences, can effectively signal poorly specified models.
  • The speaker proposes a 'plug-in likelihood' approach using Gaussian Mixture Models (GMM) for direct demographic inference of AGN populations to avoid the error propagation of individual source fitting.
Bayesian InferenceHamiltonian Monte CarloNested SamplingSimulation-Based InferenceActive Galactic Nuclei (AGN)X-ray Astronomy
Abstract (conference schedule)

How black holes accrete to super-massive monsters in centres of nuclear galaxies and in this luminous process impact galaxies is a key open question in galaxy evolution. The puzzle has remained in many pieces: Selection effects confuse, and most studies focus on two or three parameters. Yet, these indicate a multi-variate, probabilistic link between AGN accretion, obscuration, and the host galaxy's mass, star-formation, and morphology. A new window to cleanly select statistical samples to investigate these inter-dependencies opened with eROSITA. We aim to develop a scalable analysis of the X-ray to IR SED for millions of sources, to decode which host galaxies preferentially undergo a quasar phase and experience its energy release. Starting from the known evolving galaxy population, we trigger AGN with parametric probabilistic distributions and generate X-ray survey samples. To generate galaxy-AGN fluxes with realistic errors, we use the new GRAHSP SED fitting engine, validated to retrieve host galaxy mass even in bright AGN. To feasibly compute survey likelihoods we introduce a new machine-learning-based survey likelihood, supported by an explicit generative model and advances in deep neural network models. The likelihood allows building extensible models. In our application, we explore the mass and star-formation-dependence of AGN triggering, jointly with the geometry of the AGN accretion engine.

Questions for the speaker (3)
  1. Regarding the GMM plug-in likelihood approach for demographics, how does the choice of the number of mixture components affect the accuracy of the recovered posterior distributions?
  2. You mentioned that HMC performs better when the model is a good fit; could you elaborate on the theoretical reason why model misspecification specifically degrades HMC performance more than other MCMC methods?
  3. In the context of SBI for X-ray data, what specific strategies would you suggest for conditioning the neural network on instrument response matrices that vary by focal plane location?
15 slides

Test-time inference for Prior Change via Density Ratio Estimation

2026-06-24T15:20:39
Yichen Zang

The talk presents a method for adapting amortized posterior estimators based on diffusion models when the prior distribution changes, avoiding the need for expensive simulator re-sampling or model retraining. By estimating a guidance term using Density Ratio Estimation (DRE) and importance weighting, the speaker demonstrates an unbiased way to update the score network to reflect a new prior.

  • Amortized posterior estimation using diffusion models typically bakes the prior into the training process, making the model stale if the prior changes.
  • The proposed solution estimates a guidance term—the gradient of the log ratio between the new and old noise distributions—to adapt the existing score network.
  • To avoid new simulator calls, the method uses importance weighting to transform expectations over the new prior into expectations over the old training samples.
  • Numerical experiments show the method outperforms the 'PriorGuide' baseline, particularly in out-of-distribution (OOD) settings where the new prior is not fully supported by the old one.
  • The approach was applied to a real-world sequential Bayesian updating task using TESS exoplanet light curves, performing up to eight sequential updates.
Diffusion ModelsAmortized Posterior EstimationDensity Ratio EstimationBayesian InferenceExoplanet Light Curves
Abstract (conference schedule)

Simulation-Based Inference (SBI) is a cornerstone for parameter inference in scientific disciplines where simulators involve intractable likelihoods. While amortized generative models enable rapid posterior estimation, they are typically constrained by the specific priors used during training, which limits their flexibility when prior knowledge evolves. To overcome this dependency, PriorGuide has been proposed as an inference-time guidance method that attempts to adapt to new priors via reverse transition kernel approximations, making it suffer from systematic bias. Moreover, we find that PriorGuide can exhibit severe numerical instability (e.g., NaNs) in out-of-distribution (OOD) scenarios. To address these challenges, we propose a ratio-estimation-based test-time guidance framework. By leveraging an auxiliary neural ratio estimator (NRE) to learn a score guidance term, our method aims to decouple the inference process from the training prior. Preliminary results suggest that our approach improves robustness to OOD shifts and produces samples that align well with target posteriors. This framework shows promise as a tool for prior shift and sensitivity analysis, potentially allowing researchers to explore various prior updates with greater flexibility.

Questions for the speaker (3)
  1. How does the importance weighting approach handle cases where the ratio between the target prior and the training prior has extremely high variance?
  2. In the sequential updating application with TESS data, how does the accumulation of estimation errors in the guidance term affect the posterior accuracy over eight iterations?
  3. You mentioned that the diffusion process's gradual addition of noise helps with support issues in OOD settings; can you quantify how much the noise scale influences the robustness of the guidance term estimation?
24 slides

Diffusion based SED fitting

2026-06-24T15:20:39
Grégoire Aufort

The talk presents a novel approach to Spectral Energy Distribution (SED) fitting for galaxies by framing Bayesian inference as an inpainting problem using conditional score-based diffusion models. This method allows for flexible handling of missing photometric bands and the integration of ancillary data, such as spectroscopic redshifts, without requiring separate models for every combination of available data.

  • Traditional Neural Posterior Estimation (NPE) struggles with variable input dimensions caused by varying survey footprints and missing data bands.
  • The proposed method targets the joint distribution of parameters and data, treating inference as an inpainting task where observed values are fixed and missing values are sampled.
  • A diffusion model architecture is employed, utilizing CNNs for magnitudes and parameters to learn the score function of the joint distribution.
  • The model was trained using FSPS (Flexible Stellar Population Synthesis) and validated against the COSMOS2020 catalog.
  • Results demonstrate that the model can recover posterior distributions and perform posterior predictive checks effectively, even with significantly reduced sets of photometric bands.
  • The approach naturally supports conditioning on known parameters, such as spectroscopic redshifts, by masking them in the joint vector.
SED fittingSimulation Based InferenceDiffusion ModelsGalaxy EvolutionBayesian Inference
Abstract (conference schedule)

We present a simulation-based inference (SBI) framework for galaxy SED fitting based on conditional diffusion models, and, to our knowledge, the first application of diffusion-based SBI to this problem. Instead of learning a direct map from photometry to physical parameters, we model the joint distribution of observables and latent quantities, (p(\mathrm{mags}, \theta)), and cast inference as an inpainting task. In this formulation, any subset of entries can be treated as known and the remaining ones are sampled from the posterior, enabling a single trained model to perform both parameter inference and photometric reconstruction. This approach provides two practical advantages for SED fitting. First, it naturally supports conditioning on externally measured physical quantities (e.g. spectroscopic redshift) by simply marking them as observed variables in the joint state. Second, it handles missing photometric bands at inference time without retraining, imputation heuristics, or Monte Carlo resampling over missing data configurations. The same model can therefore accommodate heterogeneous observational coverage and variable data quality in a unified probabilistic framework. We demonstrate posterior inference for galaxy physical parameters together with inpainting of masked magnitudes, and show how posterior uncertainties broaden as photometric information is removed while remaining informative through learned cross-band and parameter-photometry correlations. The method yields full posterior samples, supports flexible conditioning, and is computationally efficient at inference once trained. More broadly, this work illustrates how diffusion models can serve as general-purpose SBI engines for high-dimensional astrophysical inverse problems with incomplete observations.

Questions for the speaker (3)
  1. How does the choice of thresholding magnitudes at the instrument limit affect the training stability and the resulting distribution of the forward model?
  2. Given that the training set only samples a fraction of possible mask combinations, how does the model's performance degrade when encountering a specific combination of missing bands not well-represented in the training data?
  3. How does the computational cost of sampling from the diffusion model (requiring hundreds of network calls) compare to traditional MCMC or standard NPE methods for large-scale catalogs?
17 slides

SBI for LISA

2026-06-24T15:52:30
Philippa Cole

This talk explores the application of Simulation-Based Inference (SBI) to the data analysis challenges of the future Laser Interferometer Space Antenna (LISA), focusing specifically on Extreme Mass Ratio Inspirals (EMRIs). The speaker proposes a sequential SBI pipeline to navigate the vast, multimodal parameter spaces of EMRI signals, which are often swamped by noise and overlapping sources.

  • LISA faces a 'global fit' problem where thousands of overlapping signals and non-Gaussian noise must be modeled simultaneously.
  • EMRIs are particularly challenging due to their rich dynamics, eccentric orbits, and long durations in the frequency band.
  • Traditional MCMC methods struggle with EMRI parameter estimation because the likelihood surface is extremely multimodal and the prior space is vast.
  • A sequential SBI approach using Truncated Marginal Neural Ratio Estimation (TMNRE) was implemented to iteratively narrow the prior space.
  • Results show that SBI can efficiently localize true parameter values across six rounds of 150k simulations, outperforming MCMC given the same number of waveform evaluations.
  • Despite progress, the resulting posteriors are still roughly 100 times wider than the theoretical precision achievable with 'cheating' MCMC runs.
Gravitational WavesLISASimulation-Based InferenceExtreme Mass Ratio Inspirals (EMRIs)Neural Ratio Estimation
Abstract (conference schedule)

One of the biggest challenges facing the next generation of gravitational wave physics is tackling the LISA data analysis problem. There are expected to be thousands of overlapping sources buried in non-stationary, non-Gaussian noise, all of which need to be detected and analysed precisely so that parameter measurement errors do not cascade. Excellent progress has been made with traditional likelihood-based methods so far, but there is scope for tackling this challenge with SBI methods in a complementary way. I will present results from recent work using SBI to analyse a particularly troublesome class of binary black holes that we hope to observe with LISA: extreme mass ratio inspirals. I will reflect on the successes and limitations of this approach, as well as fruitful directions for improvements.

Questions for the speaker (3)
  1. You mentioned that the current posteriors are still a factor of 100 too wide; do you believe this is a limitation of the TMNRE architecture or a result of the simple outward truncation method used for the priors?
  2. Given that the initial phase parameter returned the prior, to what extent did the data compression used for the neural network remove the phase information necessary for inference?
  3. How do you plan to scale this sequential SBI approach to handle the 'global fit' problem where multiple overlapping sources must be extracted simultaneously rather than in isolation?
22 slides

Simulation-Based Inference (SBI) Data Challenge for Galaxy Evolution

2026-06-24T17:06:54
Luca

The speaker proposes a community-driven data challenge to benchmark simulation-based inference (SBI) methods against traditional SED fitting for recovering galaxy physical properties. The initiative aims to build trust in SBI by testing its calibration accuracy, robustness to model mis-specification, and scalability across diverse, multi-modal datasets.

  • Goal to establish a common benchmark to compare different SBI methods and traditional inference tools like Prospector and Cigale.
  • Focus on whether population-aware SBI can improve single-object estimation and uncover new physical relationships.
  • Proposed structure involves a series of tasks with increasing complexity, moving from simple Gaussian noise to realistic simulated images and spectra.
  • Implementation utilizes a Hugging Face backend for data hosting, a submission portal, and a Python package for standardized metric evaluation.
  • Evaluation metrics include per-galaxy accuracy (bias, scatter), posterior calibration (coverage tests), population-level statistics (SMF, SFRD), and operational efficiency (inference time).
  • The challenge encourages community contributions of diverse forward-model datasets to test generalization across different simulators.
Simulation-Based InferenceGalaxy EvolutionSED FittingBenchmarkingAstrophysics
Abstract (conference schedule)

Simulation-based inference (SBI) is rapidly becoming a practical tool for galaxy-evolution problems, but its application raises recurring questions about robustness, model misspecification, scalability, and fair comparison across methods. This is exactly the sort of challenges and solutions this meeting aims to surface through discussion and practical sessions. In this discussion session, Chris Lovell and I will present a proposal for a community data challenge for SBI in galaxy evolution, and we will actively solicit input from participants to define a benchmark that is scientifically meaningful, technically tractable, and future-proof for Stage-IV data regimes. The core motivation is simple: we want to stress-test SBI pipelines beyond “in-model” validation by including deviations that mimic reality, like incomplete or wrong forward models, un-modelled selection effects, and domain shifts between simulations and data. We propose an open conversation around key design choices for the challenge, which includes: - What data products? photometry, spectroscopy, or both—and if spectroscopic, 1D spectra or IFU-like data? - What galaxy population model and volume? how complex should the simulator be, and what “truth” should be hidden vs disclosed? - What metrics define success? posterior calibration/coverage, parameter recovery under misspecification, posterior predictive checks, out-of-distribution detection, and others. - Speed vs robustness: should we explicitly reward amortized/fast inference, or prioritize reliability and robust uncertainty quantification? - Scalability: can the method realistically scale to Stage-IV data volumes and systematics? - Publication model: a coordinated paper series per method vs a single benchmark paper that collect the results from the various groups. - Timeline: how much time should we give to researchers before collecting the results?

Questions for the speaker (3)
  1. How will the challenge specifically handle the trade-off between using purely synthetic data for ground-truth validation and using empirical data to ensure real-world applicability?
  2. What specific metrics or penalties will be used to evaluate 'robustness to model mis-specification' when a method performs well on some simulators but fails on others?
  3. Given the variety of hardware used by participants, how do you plan to standardize the 'operational metrics' for inference time and computational cost to ensure a fair comparison?
47 slides

Synference Tutorial

2026-06-24T17:41:18
Thomas Harvey

This talk introduces Synference, a Python framework for galaxy photometry inference using Simulation-Based Inference (SBI). The tool leverages the Synthesizer package to generate large synthetic libraries for training neural posterior estimators, offering a faster alternative to traditional nested sampling for estimating galaxy properties.

  • Traditional SED fitting tools like Bagpipes are often too slow to scale for upcoming large surveys (Euclid, Roman, Rubin).
  • Synference uses SBI to learn the posterior distribution from a large grid of simulated photometry generated by Synthesizer.
  • The framework supports various SBI backends, including Masked Autoregressive Flows and Mixture Density Networks.
  • A diffusion-model-based tool called Scintillate is used to learn and simulate realistic flux uncertainties for better model conditioning.
  • The tool is model-agnostic and can integrate other forward models, such as hydrodynamical simulations from the SPHINX project.
  • Demonstrated applications include rapid redshift estimation and pixel-by-pixel resolved parameter mapping for individual galaxies.
Simulation-Based InferenceSED FittingGalaxy EvolutionPhotometrySynthesizer
Abstract (conference schedule)

Understanding galaxy formation and evolution is moving from a data-limited science to a methodology limited science with the advent of new, large photometric and spectroscopic surveys which will observe billions of galaxies over the next decade. Understanding the physics driving these systems often relies on SED fitting, which is a generally a complex, high-dimensional infernce problem with fundamental degeneacies between key parameters of interest. Fitting such models with traditional Bayesian techniques can take minutes to hours per galaxy per core, which is entirely unfeasible for ongoing and future surveys such as those of Euclid, Roman and LSST. This talk will explore Synference, a new Python framework aiming to accelerate the use of SBI approaches to SED fitting, which has been shown to produce comparable posterior constraints 1000-10,000x faster than traditional techniques. I will demonstrate the capabilities and results obtainable with Synfernce when applied to JWST and Euclid photometry. I will discuss other applications of Synference enabled by the flexibility and speed of SBI, including resolved, pixel-by-pixel SED fitting, model comparison and selection, and the application of Synference for constraints from spectroscopic confirmation.

Questions for the speaker (3)
  1. How does the performance of the diffusion model for flux uncertainty prediction compare to traditional noise models in terms of posterior calibration?
  2. Given the observed correlations between tau and peak age in the small-sample demo, what is the minimum simulation library size required to break these degeneracies for a full 6D parameter space?
  3. What are the specific computational bottlenecks in the current SBI sampling implementation that you expect to resolve with GPU batching?