loading system configuration
loading override configuration from /users/willend/mxtest/mctest/../mccodelib/mcxtrace-test/McXtrace_DUAL_A100_DMSC/mccode_config.json
INFO: Using directory: "3"
INFO: Using existing c-file: ./Test_ML_elliptic.c
INFO: Using existing binary: ./Test_ML_elliptic.out
WARNING: Ignoring invalid parameter: "Test_ML_elliptic.instr"
INFO: ===
--------------------------------------------------------------------------
WARNING: No preset parameters were found for the device that Open MPI
detected:

  Local host:            r6n22
  Device name:           mlx5_0
  Device vendor ID:      0x02c9
  Device vendor part ID: 4123

Default device parameters will be used, which may result in lower
performance.  You can edit any of the files specified by the
btl_openib_device_param_files MCA parameter to set values for your
device.

NOTE: You can turn off this warning by setting the MCA parameter
      btl_openib_warn_no_device_params_found to 0.
--------------------------------------------------------------------------
Simulation 'Test_ML_elliptic' (/users/willend/xTESTS/2022-12-01/McXtrace_DUAL_A100_DMSC_5e7/Test_ML_elliptic/Test_ML_elliptic.instr): running on 2 nodes (master is 'r6n22.esss.dk', MPI version 3.1).
Have found 2 GPU devices on rank 1. Will use device 1.
Have found 2 GPU devices on rank 0. Will use device 0.
[Test_ML_elliptic] Initialize
[Test_ML_elliptic] Initialize
Opening input file '/users/willend/McXtrace/mcxtrace/3.x-dev/tools/Python/mxrun/../mccodelib/../../../data/Ref_W_B4C.txt' (Table_Read_Offset)
INFO (reflectivity-lib)  reflectivity parameterization type: 'q'
INFO (reflectivity-lib)  reflectivity parameterization type: 'q'
*** TRACE end *** 

Save [Test_ML_elliptic]
Detector: psd0_I=1.59144e-06 psd0_ERR=2.25064e-10 psd0_N=5e+07 "psd0.dat"
Detector: emon0_I=1.59144e-06 emon0_ERR=2.25064e-10 emon0_N=5e+07 "emon0.dat"
Detector: psd1_I=9.2326e-08 psd1_ERR=4.94873e-11 psd1_N=5e+07 "psd1.dat"
Detector: emon1_I=9.2326e-08 emon1_ERR=4.94873e-11 emon1_N=5e+07 "emon1.dat"
Detector: psdd_I=9.2326e-08 psdd_ERR=4.94873e-11 psdd_N=5e+07 "psdd.dat"
Detector: emond_I=9.2326e-08 emond_ERR=4.94873e-11 emond_N=5e+07 "emond.dat"
Detector: emonsingle_I=5.22367e-12 emonsingle_ERR=1.16655e-14 emonsingle_N=251218 "emonsingle.dat"
Detector: psd6_I=9.2326e-08 psd6_ERR=4.94873e-11 psd6_N=5e+07 "psd6.dat"

Finally [Test_ML_elliptic: 3]. Time: 1 [s] 
Detector: emon6_I=9.2326e-08 emon6_ERR=4.94873e-11 emon6_N=5e+07 "emon6.dat"

Finally [Test_ML_elliptic: 3]. Time: 1 [s] 
[r6n22.esss.dk:3413132] 1 more process has sent help message help-mpi-btl-openib.txt / no device params found
[r6n22.esss.dk:3413132] Set MCA parameter "orte_base_help_aggregate" to 0 to see all help / error messages
INFO: Placing instr file copy /users/willend/xTESTS/2022-12-01/McXtrace_DUAL_A100_DMSC_5e7/Test_ML_elliptic/Test_ML_elliptic.instr in dataset 3