loading system configuration loading override configuration from /users/willend/mxtest/mctest/../mccodelib/mcxtrace-test/McXtrace_DUAL_A100_DMSC/mccode_config.json INFO: Using directory: "1" INFO: Using existing c-file: ./Test_Mirror_toroid.c INFO: Using existing binary: ./Test_Mirror_toroid.out WARNING: Ignoring invalid parameter: "Test_Mirror_toroid.instr" INFO: === -------------------------------------------------------------------------- WARNING: No preset parameters were found for the device that Open MPI detected: Local host: r6n22 Device name: mlx5_0 Device vendor ID: 0x02c9 Device vendor part ID: 4123 Default device parameters will be used, which may result in lower performance. You can edit any of the files specified by the btl_openib_device_param_files MCA parameter to set values for your device. NOTE: You can turn off this warning by setting the MCA parameter btl_openib_warn_no_device_params_found to 0. -------------------------------------------------------------------------- Simulation 'Test_Mirror_toroid' (/users/willend/xTESTS/2022-12-01/McXtrace_DUAL_A100_DMSC_5e7/Test_Mirror_toroid/Test_Mirror_toroid.instr): running on 2 nodes (master is 'r6n22.esss.dk', MPI version 3.1). Have found 2 GPU devices on rank 1. Will use device 1. Have found 2 GPU devices on rank 0. Will use device 0. [Test_Mirror_toroid] Initialize [Test_Mirror_toroid] Initialize *** TRACE end *** Save [Test_Mirror_toroid] Detector: psd0_I=9.94717e-08 psd0_ERR=1.40674e-11 psd0_N=5e+07 "psd0.dat" Detector: psd1_I=9.94717e-08 psd1_ERR=1.40674e-11 psd1_N=5e+07 "psd1.dat" Detector: psd2_I=9.94717e-08 psd2_ERR=1.40674e-11 psd2_N=5e+07 "psd2.dat" Detector: psd3_I=7.22404e-08 psd3_ERR=1.19882e-11 psd3_N=3.6312e+07 "psd3.dat" Finally [Test_Mirror_toroid: 1]. Time: 0 [s] Finally [Test_Mirror_toroid: 1]. Time: 1 [s] [r6n22.esss.dk:3413354] 1 more process has sent help message help-mpi-btl-openib.txt / no device params found [r6n22.esss.dk:3413354] Set MCA parameter "orte_base_help_aggregate" to 0 to see all help / error messages INFO: Placing instr file copy /users/willend/xTESTS/2022-12-01/McXtrace_DUAL_A100_DMSC_5e7/Test_Mirror_toroid/Test_Mirror_toroid.instr in dataset 1