TY - JOUR

T1 - Unbiased estimation using a class of diffusion processes

AU - Ruzayqat, Hamza Mahmoud

AU - Beskos, Alexandros

AU - Crisan, Dan

AU - Jasra, Ajay

AU - Kantas, Nikolas

N1 - KAUST Repository Item: Exported on 2022-10-24
Acknowledged KAUST grant number(s): BAS/1/1681-01-01
Acknowledgements: AJ & HR were supported by KAUST baseline funding BAS/1/1681-01-01.

PY - 2022/9/24

Y1 - 2022/9/24

N2 - We study the problem of unbiased estimation of expectations with respect to (w.r.t.) π a given, general probability measure on (Rd,B(Rd)) that is absolutely continuous with respect to a standard Gaussian measure. We focus on simulation associated to a particular class of diffusion processes, sometimes termed the Schrödinger-Föllmer Sampler, which is a simulation technique that approximates the law of a particular diffusion bridge process {Xt}t∈[0,1] on Rd, d∈N0. This latter process is constructed such that, starting at X0=0, one has X1∼π. Typically, the drift of the diffusion is intractable and, even if it were not, exact sampling of the associated diffusion is not possible. As a result, [10,16] consider a stochastic Euler-Maruyama scheme that allows the development of biased estimators for expectations w.r.t. π. We show that for this methodology to achieve a mean square error of O(ϵ2), for arbitrary ϵ>0, the associated cost is O(ϵ−5). We then introduce an alternative approach that provides unbiased estimates of expectations w.r.t. π, that is, it does not suffer from the time discretization bias or the bias related with the approximation of the drift function. We prove that to achieve a mean square error of O(ϵ2), the associated cost (which is random) is, with high probability, O(ϵ−2|log(ϵ)|2+δ), for any δ>0. We implement our method on several examples including Bayesian inverse problems.

AB - We study the problem of unbiased estimation of expectations with respect to (w.r.t.) π a given, general probability measure on (Rd,B(Rd)) that is absolutely continuous with respect to a standard Gaussian measure. We focus on simulation associated to a particular class of diffusion processes, sometimes termed the Schrödinger-Föllmer Sampler, which is a simulation technique that approximates the law of a particular diffusion bridge process {Xt}t∈[0,1] on Rd, d∈N0. This latter process is constructed such that, starting at X0=0, one has X1∼π. Typically, the drift of the diffusion is intractable and, even if it were not, exact sampling of the associated diffusion is not possible. As a result, [10,16] consider a stochastic Euler-Maruyama scheme that allows the development of biased estimators for expectations w.r.t. π. We show that for this methodology to achieve a mean square error of O(ϵ2), for arbitrary ϵ>0, the associated cost is O(ϵ−5). We then introduce an alternative approach that provides unbiased estimates of expectations w.r.t. π, that is, it does not suffer from the time discretization bias or the bias related with the approximation of the drift function. We prove that to achieve a mean square error of O(ϵ2), the associated cost (which is random) is, with high probability, O(ϵ−2|log(ϵ)|2+δ), for any δ>0. We implement our method on several examples including Bayesian inverse problems.

UR - http://hdl.handle.net/10754/685063

UR - https://linkinghub.elsevier.com/retrieve/pii/S0021999122007069

UR - http://www.scopus.com/inward/record.url?scp=85139877136&partnerID=8YFLogxK

U2 - 10.1016/j.jcp.2022.111643

DO - 10.1016/j.jcp.2022.111643

M3 - Article

SN - 1090-2716

VL - 472

SP - 111643

JO - Journal of Computational Physics

JF - Journal of Computational Physics

ER -