loading system configuration
loading override configuration from /users/willend/mxtest/mctest/../mccodelib/mcxtrace-test/McXtrace_DUAL_A100_DMSC/mccode_config.json
INFO: Using directory: "2"
INFO: Using existing c-file: ./MAXIV_Bloch.c
INFO: Using existing binary: ./MAXIV_Bloch.out
INFO: ===
--------------------------------------------------------------------------
WARNING: No preset parameters were found for the device that Open MPI
detected:

  Local host:            r6n22
  Device name:           mlx5_0
  Device vendor ID:      0x02c9
  Device vendor part ID: 4123

Default device parameters will be used, which may result in lower
performance.  You can edit any of the files specified by the
btl_openib_device_param_files MCA parameter to set values for your
device.

NOTE: You can turn off this warning by setting the MCA parameter
      btl_openib_warn_no_device_params_found to 0.
--------------------------------------------------------------------------
Simulation 'MAXIV_Bloch' (/users/willend/xTESTS/2022-12-01/McXtrace_DUAL_A100_DMSC_5e7/MAXIV_Bloch/MAXIV_Bloch.instr): running on 2 nodes (master is 'r6n22.esss.dk', MPI version 3.1).
Have found 2 GPU devices on rank 0. Will use device 0.
Have found 2 GPU devices on rank 1. Will use device 1.
No grating mode is given. The cPGM mode will be used.
No grating mode is given. The cPGM mode will be used.
[MAXIV_Bloch] Initialize
[MAXIV_Bloch] Initialize
Opening input file '/users/willend/McXtrace/mcxtrace/3.x-dev/tools/Python/mxrun/../mccodelib/../../../data/Be.txt' (Table_Read_Offset)
INFO (reflectivity-lib): Datafile type not explicit in reflectivity file. Inferring type COATING from datafile.
INFO (reflectivity-lib): Datafile type not explicit in reflectivity file. Inferring type COATING from datafile.
*** TRACE end *** 

Save [MAXIV_Bloch]
Detector: Source_E_monitor_I=1.62403e-13 Source_E_monitor_ERR=2.29672e-17 Source_E_monitor_N=5e+07 "source_E_monitor.dat"
Detector: Source_psd_monitor_I=1.62403e-13 Source_psd_monitor_ERR=2.29672e-17 Source_psd_monitor_N=5e+07 "Source_psd_monitor.dat"
Detector: M1_E_monitor_I=1.62403e-13 M1_E_monitor_ERR=2.29672e-17 M1_E_monitor_N=5e+07 "M1_E_monitor.dat"
Detector: M1_psd_monitor_I=1.62403e-13 M1_psd_monitor_ERR=2.29672e-17 M1_psd_monitor_N=5e+07 "M1_psd_monitor.dat"
Detector: postPgmfpi_I=4.54474e-21 postPgmfpi_ERR=4.0376e-23 postPgmfpi_N=5e+07 "postpgm.dat"
Detector: vbanana_I=4.54474e-21 vbanana_ERR=4.0376e-23 vbanana_N=5e+07 "vbanana.th_E"
Detector: psd2m_I=4.54474e-21 psd2m_ERR=4.0376e-23 psd2m_N=5e+07 "psd2m.dat"
Detector: Monochromator_E_monitor_I=0 Monochromator_E_monitor_ERR=0 Monochromator_E_monitor_N=0 "AfterMonochromator_E_monitor.dat"
Detector: Monochromator_psd_monitor_I=0 Monochromator_psd_monitor_ERR=0 Monochromator_psd_monitor_N=0 "AfterMonochromator_psd_monitor.dat"
Detector: m3Psd_I=4.54474e-21 m3Psd_ERR=4.0376e-23 m3Psd_N=5e+07 "m3psd.dat"
Detector: M3_E_monitor_I=1.62242e-21 M3_E_monitor_ERR=1.89224e-23 M3_E_monitor_N=5e+07 "M3_E_monitor.dat"
Detector: M3_psd_monitor_I=1.62242e-21 M3_psd_monitor_ERR=1.89224e-23 M3_psd_monitor_N=5e+07 "M3_psd_monitor.dat"
Detector: bef_slit_I=1.62242e-21 bef_slit_ERR=1.89224e-23 bef_slit_N=5e+07 "bef_slit.dat"
Detector: aft_slit_I=1.62242e-21 aft_slit_ERR=1.89224e-23 aft_slit_N=5e+07 "aft_slit.dat"
Detector: M4Before_psd_monitor_I=1.62242e-21 M4Before_psd_monitor_ERR=1.89224e-23 M4Before_psd_monitor_N=5e+07 "M4Before_psd_monitor.dat"
Detector: M4Before_e_monitor_I=1.62242e-21 M4Before_e_monitor_ERR=1.89224e-23 M4Before_e_monitor_N=5e+07 "M4Before_e_monitor.dat"
Detector: M4_psd_monitor_I=1.62242e-21 M4_psd_monitor_ERR=1.89224e-23 M4_psd_monitor_N=5e+07 "M4_psd_monitor.dat"
Detector: M4_e_monitor_I=1.62242e-21 M4_e_monitor_ERR=1.89224e-23 M4_e_monitor_N=5e+07 "M4_e_monitor.dat"

Finally [MAXIV_Bloch: 2]. Time: 2 [s] 

Finally [MAXIV_Bloch: 2]. Time: 2 [s] 
[r6n22.esss.dk:3409135] 1 more process has sent help message help-mpi-btl-openib.txt / no device params found
[r6n22.esss.dk:3409135] Set MCA parameter "orte_base_help_aggregate" to 0 to see all help / error messages
INFO: Placing instr file copy /users/willend/xTESTS/2022-12-01/McXtrace_DUAL_A100_DMSC_5e7/MAXIV_Bloch/MAXIV_Bloch.instr in dataset 2