loading system configuration loading override configuration from /zhome/89/0/38697/mxtest/mctest/../mccodelib/mcxtrace-test/McXtrace_CPU_MPICC_KISS/mccode_config.json INFO: Using directory: "1" INFO: Using existing c-file: ./Test_BM.c INFO: Using existing binary: ./Test_BM.out WARNING: Ignoring invalid parameter: "Test_BM.instr" INFO: === INFO: Using system default number of mpirun -np processes -------------------------------------------------------------------------- By default, for Open MPI 4.0 and later, infiniband ports on a device are not used by default. The intent is to use UCX for these devices. You can override this policy by setting the btl_openib_allow_ib MCA parameter to true. Local host: n-62-29-18 Local adapter: mlx4_0 Local port: 1 -------------------------------------------------------------------------- -------------------------------------------------------------------------- WARNING: There was an error initializing an OpenFabrics device. Local host: n-62-29-18 Local device: mlx4_0 -------------------------------------------------------------------------- Simulation 'Test_BM' (/zhome/89/0/38697/xTESTS/2022-08-01/McXtrace_CPU_MPICC_KISS_5e7/Test_BM/Test_BM.instr): running on 10 nodes (master is 'n-62-29-18', MPI version 3.1). [Test_BM] Initialize [Test_BM] Initialize [Test_BM] Initialize Warning (bm0): Bending_magnet is an experimental component - testing is ongoing Warning (w1): Wiggler is an experimental component - testing is ongoing Warning (bm0): Bending_magnet is an experimental component - testing is ongoing Warning (w1): Wiggler is an experimental component - testing is ongoing Warning (bm0): Bending_magnet is an experimental component - testing is ongoing Warning (w1): Wiggler is an experimental component - testing is ongoing [Test_BM] Initialize Warning (bm0): Bending_magnet is an experimental component - testing is ongoing Warning (w1): Wiggler is an experimental component - testing is ongoing [Test_BM] Initialize Warning (bm0): Bending_magnet is an experimental component - testing is ongoing Warning (w1): Wiggler is an experimental component - testing is ongoing [Test_BM] Initialize Warning (bm0): Bending_magnet is an experimental component - testing is ongoing Warning (w1): Wiggler is an experimental component - testing is ongoing [Test_BM] Initialize [Test_BM] Initialize Warning (bm0): Bending_magnet is an experimental component - testing is ongoing Warning (w1): Wiggler is an experimental component - testing is ongoing Warning (bm0): Bending_magnet is an experimental component - testing is ongoing Warning (w1): Wiggler is an experimental component - testing is ongoing [Test_BM] Initialize Warning (bm0): Bending_magnet is an experimental component - testing is ongoing Warning (w1): Wiggler is an experimental component - testing is ongoing [Test_BM] Initialize Warning (bm0): Bending_magnet is an experimental component - testing is ongoing Warning (w1): Wiggler is an experimental component - testing is ongoing [n-62-29-18:17938] 9 more processes have sent help message help-mpi-btl-openib.txt / ib port not selected [n-62-29-18:17938] Set MCA parameter "orte_base_help_aggregate" to 0 to see all help / error messages [n-62-29-18:17938] 9 more processes have sent help message help-mpi-btl-openib.txt / error in device init Trace ETA 13 [s] % 78 Trace ETA 12 [s] % 91 Trace ETA 13 [s] % 79 Trace ETA 12 [s] % 91 Trace ETA 14 [s] % 78 Trace ETA 12 [s] % 90 Trace ETA 12 [s] % 91 Trace ETA 12 [s] % 91 Trace ETA 13 [s] % 78 Trace ETA 12 [s] % 91 80 80 80 80 90 90 90 90 *** TRACE end *** Save [Test_BM] Detector: psd0_I=2.93139e+13 psd0_ERR=4.14744e+09 psd0_N=4.99909e+07 "psd0.dat" Detector: emon_I=2.93139e+13 emon_ERR=4.14744e+09 emon_N=4.99909e+07 "emon0.dat" Detector: psd1_I=2.92729e+13 psd1_ERR=4.14453e+09 psd1_N=4.99209e+07 "psd1.dat" Detector: psd2_I=2.91242e+13 psd2_ERR=4.134e+09 psd2_N=4.96675e+07 "psd2.dat" Detector: psd3_I=2.87895e+13 psd3_ERR=4.11017e+09 psd3_N=4.90965e+07 "psd3.dat" Detector: psd4_I=2.82236e+13 psd4_ERR=4.06958e+09 psd4_N=4.81316e+07 "psd4.dat" Finally [Test_BM: 1]. Time: 14 [s] Finally [Test_BM: 1]. Time: 14 [s] Finally [Test_BM: 1]. Time: 14 [s] Detector: psd5_I=2.74295e+13 psd5_ERR=4.01192e+09 psd5_N=4.67773e+07 "psd5.dat" Finally [Test_BM: 1]. Time: 14 [s] Finally [Test_BM: 1]. Time: 14 [s] Finally [Test_BM: 1]. Time: 14 [s] Finally [Test_BM: 1]. Time: 14 [s] Finally [Test_BM: 1]. Time: 14 [s] Finally [Test_BM: 1]. Time: 14 [s] Finally [Test_BM: 1]. Time: 14 [s] INFO: Placing instr file copy /zhome/89/0/38697/xTESTS/2022-08-01/McXtrace_CPU_MPICC_KISS_5e7/Test_BM/Test_BM.instr in dataset 1