loading system configuration
loading override configuration from /zhome/89/0/38697/mxtest/mctest/../mccodelib/mcxtrace-test/McXtrace_CPU_MPICC_KISS/mccode_config.json
INFO: Using directory: "1"
INFO: Using existing c-file: ./SAXS_saxlab.c
INFO: Using existing binary: ./SAXS_saxlab.out
INFO: ===
INFO: Using system default number of mpirun -np processes
--------------------------------------------------------------------------
By default, for Open MPI 4.0 and later, infiniband ports on a device
are not used by default.  The intent is to use UCX for these devices.
You can override this policy by setting the btl_openib_allow_ib MCA parameter
to true.

  Local host:              n-62-29-34
  Local adapter:           mlx4_0
  Local port:              1

--------------------------------------------------------------------------
--------------------------------------------------------------------------
WARNING: There was an error initializing an OpenFabrics device.

  Local host:   n-62-29-34
  Local device: mlx4_0
--------------------------------------------------------------------------
Simulation 'SAXS_saxlab' (/zhome/89/0/38697/xTESTS/2022-12-01/McXtrace_CPU_MPICC_KISS_5e7/SAXS_saxlab/SAXS_saxlab.instr): running on 10 nodes (master is 'n-62-29-34', MPI version 3.1).
[SAXS_saxlab] Initialize
[SAXS_saxlab] Initialize
[SAXS_saxlab] Initialize
Opening input file '/zhome/89/0/38697/McXtrace/mcxtrace/3.x-dev/tools/Python/mxrun/../mccodelib/../../../data/Ref_W_B4C.txt' (Table_Read_Offset)
[SAXS_saxlab] Initialize
[SAXS_saxlab] Initialize
[SAXS_saxlab] Initialize
[SAXS_saxlab] Initialize
[SAXS_saxlab] Initialize
[SAXS_saxlab] Initialize
[SAXS_saxlab] Initialize
[n-62-29-34:19410] 9 more processes have sent help message help-mpi-btl-openib.txt / ib port not selected
[n-62-29-34:19410] Set MCA parameter "orte_base_help_aggregate" to 0 to see all help / error messages
[n-62-29-34:19410] 9 more processes have sent help message help-mpi-btl-openib.txt / error in device init

Trace ETA 15 [s] % 68 
Trace ETA 16 [s] % 68 
Trace ETA 16 [s] % 68 
Trace ETA 16 [s] % 68 
Trace ETA 16 [s] % 68 
Trace ETA 16 [s] % 68 
Trace ETA 16 [s] % 68 
Trace ETA 15 [s] % 68 
Trace ETA 16 [s] % 67 
Trace ETA 15 [s] % 68 70 70 70 70 70 70 70 70 70 70 80 80 80 80 80 80 80 80 80 80 90 90 90 90 90 90 90 90 90 90 *** TRACE end *** 

Save [SAXS_saxlab]
Detector: energy_BEF_I=1e+15 energy_BEF_ERR=1.41421e+11 energy_BEF_N=5e+07 "energyBEF.dat"
Detector: psd1_I=1.31125e+07 psd1_ERR=8506.95 psd1_N=4.05056e+06 "psd1.dat"
Detector: psdin1_I=1.30884e+07 psdin1_ERR=8500.15 psdin1_N=4.04218e+06 "psdin1.dat"
Detector: psdin2_I=1.30884e+07 psdin2_ERR=8500.15 psdin2_N=4.04218e+06 "psdin2.dat"
Detector: psdin3_I=1.29737e+07 psdin3_ERR=8465.81 psdin3_N=4.0044e+06 "psdin3.dat"

Finally [SAXS_saxlab: 1]. Time: 17 [s] 


Finally [SAXS_saxlab: 1]. Time: 17 [s] 
Finally [SAXS_saxlab: 1]. Time: 17 [s] 

Finally [SAXS_saxlab: 1]. Time: 17 [s] 

Detector: detector_I=1.29737e+07 detector_ERR=8465.81 detector_N=4.0044e+06 "detector.dat"
Finally [SAXS_saxlab: 1]. Time: 17 [s] 

Finally [SAXS_saxlab: 1]. Time: 17 [s] 


Finally [SAXS_saxlab: 1]. Time: 17 [s] 
Finally [SAXS_saxlab: 1]. Time: 17 [s] 

Finally [SAXS_saxlab: 1]. Time: 17 [s] 

Finally [SAXS_saxlab: 1]. Time: 18 [s] 
INFO: Placing instr file copy /zhome/89/0/38697/xTESTS/2022-12-01/McXtrace_CPU_MPICC_KISS_5e7/SAXS_saxlab/SAXS_saxlab.instr in dataset 1