TY - GEN
T1 - In Situ Visualization of WRF Data Using Universal Data Junction
AU - Esposito, Aniello
AU - Holst, Glendon
N1 - KAUST Repository Item: Exported on 2021-12-14
Acknowledgements: This work is part of the HPE/Cray center of excellence collaboration at KAUST. UDJ development has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 773897. We want to thank Hari Dasari colleagues for helping with the test case as well as Tim Dykes and Utz Uwe Haus from the HPE EMEA research lab for support with UDJ.
PY - 2021/11/13
Y1 - 2021/11/13
N2 - An in situ co-processing visualization pipeline based on the Universal Data Junction (UDJ) library and Inshimtu is presented and used for processing data from Weather Research and Forecasting (WRF) simulations. For the common case of analyzing just a number of fields during simulation, UDJ transfers and redistributes the data in approximately 6 % of the time needed by WRF for a MPI-IO output of all variables upon which a previous method with Inshimtu is based. The relative cost of transport and redistribution compared to IO remains approximately constant up to the highest considered node count without obvious impediments to scale further.
AB - An in situ co-processing visualization pipeline based on the Universal Data Junction (UDJ) library and Inshimtu is presented and used for processing data from Weather Research and Forecasting (WRF) simulations. For the common case of analyzing just a number of fields during simulation, UDJ transfers and redistributes the data in approximately 6 % of the time needed by WRF for a MPI-IO output of all variables upon which a previous method with Inshimtu is based. The relative cost of transport and redistribution compared to IO remains approximately constant up to the highest considered node count without obvious impediments to scale further.
UR - http://hdl.handle.net/10754/673905
UR - https://link.springer.com/10.1007/978-3-030-90539-2_32
UR - http://www.scopus.com/inward/record.url?scp=85119879531&partnerID=8YFLogxK
U2 - 10.1007/978-3-030-90539-2_32
DO - 10.1007/978-3-030-90539-2_32
M3 - Conference contribution
SN - 9783030905385
SP - 475
EP - 483
BT - Lecture Notes in Computer Science
PB - Springer International Publishing
ER -