loading system configuration
loading override configuration from /zhome/89/0/38697/mxtest/mctest/../mccodelib/mcxtrace-test/McXtrace_CPU_MPICC_KISS/mccode_config.json
INFO: Using directory: "1"
INFO: Using existing c-file: ./Test_undulator.c
INFO: Using existing binary: ./Test_undulator.out
WARNING: Ignoring invalid parameter: "Test_undulator.instr"
INFO: ===
INFO: Using system default number of mpirun -np processes
--------------------------------------------------------------------------
By default, for Open MPI 4.0 and later, infiniband ports on a device
are not used by default.  The intent is to use UCX for these devices.
You can override this policy by setting the btl_openib_allow_ib MCA parameter
to true.

  Local host:              n-62-29-18
  Local adapter:           mlx4_0
  Local port:              1

--------------------------------------------------------------------------
--------------------------------------------------------------------------
WARNING: There was an error initializing an OpenFabrics device.

  Local host:   n-62-29-18
  Local device: mlx4_0
--------------------------------------------------------------------------
Simulation 'Test_undulator' (/zhome/89/0/38697/xTESTS/2022-08-01/McXtrace_CPU_MPICC_KISS_5e7/Test_undulator/Test_undulator.instr): running on 10 nodes (master is 'n-62-29-18', MPI version 3.1).
Test_undulator: energy interval: [ 0.585616 +- 0.205205 ] = [ 0.380411 : 0.790822 ]
[Test_undulator] Initialize
Test_undulator: energy interval: [ 0.585616 +- 0.205205 ] = [ 0.380411 : 0.790822 ]
[Test_undulator] Initialize
Test_undulator: energy interval: [ 0.585616 +- 0.205205 ] = [ 0.380411 : 0.790822 ]
[Test_undulator] Initialize
Test_undulator: energy interval: [ 0.585616 +- 0.205205 ] = [ 0.380411 : 0.790822 ]
[Test_undulator] Initialize
Test_undulator: energy interval: [ 0.585616 +- 0.205205 ] = [ 0.380411 : 0.790822 ]
[Test_undulator] Initialize
Test_undulator: energy interval: [ 0.585616 +- 0.205205 ] = [ 0.380411 : 0.790822 ]
[Test_undulator] Initialize
Test_undulator: energy interval: [ 0.585616 +- 0.205205 ] = [ 0.380411 : 0.790822 ]
[Test_undulator] Initialize
Test_undulator: energy interval: [ 0.585616 +- 0.205205 ] = [ 0.380411 : 0.790822 ]
[Test_undulator] Initialize
Test_undulator: energy interval: [ 0.585616 +- 0.205205 ] = [ 0.380411 : 0.790822 ]
[Test_undulator] Initialize
Test_undulator: energy interval: [ 0.585616 +- 0.205205 ] = [ 0.380411 : 0.790822 ]
[Test_undulator] Initialize
[n-62-29-18:21627] 9 more processes have sent help message help-mpi-btl-openib.txt / ib port not selected
[n-62-29-18:21627] Set MCA parameter "orte_base_help_aggregate" to 0 to see all help / error messages
[n-62-29-18:21627] 9 more processes have sent help message help-mpi-btl-openib.txt / error in device init

Trace ETA 47 [s] % 23 
Trace ETA 45 [s] % 24 
Trace ETA 46 [s] % 23 
Trace ETA 46 [s] % 23 
Trace ETA 45 [s] % 23 
Trace ETA 45 [s] % 24 
Trace ETA 47 [s] % 23 
Trace ETA 47 [s] % 23 
Trace ETA 46 [s] % 23 
Trace ETA 45 [s] % 24 30 30 30 30 30 30 30 30 30 30 40 40 40 40 40 40 40 40 40 40 50 50 50 50 50 50 50 50 50 50 60 60 60 60 60 60 60 60 60 60 70 70 70 70 70 70 70 70 70 70 80 80 80 80 80 80 80 80 80 80 90 90 90 90 90 90 90 90 90 90 *** TRACE end *** 

Save [Test_undulator]
Detector: e_monitor_I=2.33126e+16 e_monitor_ERR=3.81188e+13 e_monitor_N=5e+07 "emon0.dat"
Detector: psd_monitor_I=5.70399e+15 psd_monitor_ERR=2.15002e+13 psd_monitor_N=7.99258e+06 "psd0.dat"
Detector: e_monitor1_I=1.92654e+14 e_monitor1_ERR=4.68283e+12 e_monitor1_N=165825 "emon1.dat"

Finally [Test_undulator: 1]. Time: 46 [s] 

Finally [Test_undulator: 1]. Time: 46 [s] 


Finally [Test_undulator: 1]. Time: 46 [s] 
Detector: psd_monitor1_I=1.92654e+14 psd_monitor1_ERR=4.68283e+12 psd_monitor1_N=165825 "psd1.dat"

Finally [Test_undulator: 1]. Time: 46 [s] 
Finally [Test_undulator: 1]. Time: 46 [s] 

Finally [Test_undulator: 1]. Time: 46 [s] 

Finally [Test_undulator: 1]. Time: 46 [s] 


Finally [Test_undulator: 1]. Time: 46 [s] 
Finally [Test_undulator: 1]. Time: 46 [s] 

Finally [Test_undulator: 1]. Time: 46 [s] 
INFO: Placing instr file copy /zhome/89/0/38697/xTESTS/2022-08-01/McXtrace_CPU_MPICC_KISS_5e7/Test_undulator/Test_undulator.instr in dataset 1