loading system configuration
loading override configuration from /users/willend/mxtest/mctest/../mccodelib/mcxtrace-test/McXtrace_DUAL_A100_DMSC/mccode_config.json
INFO: Using directory: "1"
INFO: Using existing c-file: ./Test_Air.c
INFO: Using existing binary: ./Test_Air.out
WARNING: Ignoring invalid parameter: "Test_Air.instr"
INFO: ===
--------------------------------------------------------------------------
WARNING: No preset parameters were found for the device that Open MPI
detected:

  Local host:            r6n22
  Device name:           mlx5_0
  Device vendor ID:      0x02c9
  Device vendor part ID: 4123

Default device parameters will be used, which may result in lower
performance.  You can edit any of the files specified by the
btl_openib_device_param_files MCA parameter to set values for your
device.

NOTE: You can turn off this warning by setting the MCA parameter
      btl_openib_warn_no_device_params_found to 0.
--------------------------------------------------------------------------
Simulation 'Test_Air' (/users/willend/xTESTS/2022-12-01/McXtrace_DUAL_A100_DMSC_5e7/Test_Air/Test_Air.instr): running on 2 nodes (master is 'r6n22.esss.dk', MPI version 3.1).
Have found 2 GPU devices on rank 0. Will use device 0.
Have found 2 GPU devices on rank 1. Will use device 1.
[Test_Air] Initialize
[Test_Air] Initialize
*** TRACE end *** 

Save [Test_Air]
Detector: psd0_I=4.97359e-07 psd0_ERR=7.03371e-11 psd0_N=5e+07 "psd0.dat"
Detector: div0_I=4.97359e-07 div0_ERR=7.03371e-11 div0_N=5e+07 "div0.dat"
Detector: fpi_I=4.97091e-07 fpi_ERR=9.94146e-11 fpi_N=5e+07 "fpi.dat"
Detector: fpi_scat_I=7.946e-15 fpi_scat_ERR=1.76775e-18 fpi_scat_N=2.49982e+07 "fpi_sc.dat"
Detector: fpi_noscat_I=4.97091e-07 fpi_noscat_ERR=9.94146e-11 fpi_noscat_N=2.50018e+07 "fpi_no.dat"
Detector: psd1_I=4.89182e-11 psd1_ERR=9.86125e-13 psd1_N=2.4992e+07 "psd1.dat"
Detector: div1_I=4.89179e-11 div1_ERR=9.86125e-13 div1_N=2.33765e+07 "div1.dat"
Detector: psd2_I=4.89102e-11 psd2_ERR=9.86146e-13 psd2_N=21051 "psd2.dat"
Detector: div2_I=4.89102e-11 div2_ERR=9.86146e-13 div2_N=21051 "div2.dat"

Finally [Test_Air: 1]. Time: 2 [s] 

Finally [Test_Air: 1]. Time: 2 [s] 
[r6n22.esss.dk:3411490] 1 more process has sent help message help-mpi-btl-openib.txt / no device params found
[r6n22.esss.dk:3411490] Set MCA parameter "orte_base_help_aggregate" to 0 to see all help / error messages
INFO: Placing instr file copy /users/willend/xTESTS/2022-12-01/McXtrace_DUAL_A100_DMSC_5e7/Test_Air/Test_Air.instr in dataset 1