loading system configuration loading override configuration from /zhome/89/0/38697/mxtest/mctest/../mccodelib/mcxtrace-test/McXtrace_CPU_MPICC_KISS/mccode_config.json INFO: Using directory: "8" INFO: Using existing c-file: ./Test_Sources.c INFO: Using existing binary: ./Test_Sources.out WARNING: Ignoring invalid parameter: "Test_Sources.instr" INFO: === INFO: Using system default number of mpirun -np processes -------------------------------------------------------------------------- By default, for Open MPI 4.0 and later, infiniband ports on a device are not used by default. The intent is to use UCX for these devices. You can override this policy by setting the btl_openib_allow_ib MCA parameter to true. Local host: n-62-29-18 Local adapter: mlx4_0 Local port: 1 -------------------------------------------------------------------------- -------------------------------------------------------------------------- WARNING: There was an error initializing an OpenFabrics device. Local host: n-62-29-18 Local device: mlx4_0 -------------------------------------------------------------------------- Simulation 'Test_Sources' (/zhome/89/0/38697/xTESTS/2022-08-01/McXtrace_CPU_MPICC_KISS_5e7/Test_Sources/Test_Sources.instr): running on 10 nodes (master is 'n-62-29-18', MPI version 3.1). [Test_Sources] Initialize [Test_Sources] Initialize [Test_Sources] Initialize [Test_Sources] Initialize [Test_Sources] Initialize [Test_Sources] Initialize [Test_Sources] Initialize [Test_Sources] Initialize [Test_Sources] Initialize [Test_Sources] Initialize *** TRACE end *** Save [Test_Sources] Detector: lmon_I=0.993562 lmon_ERR=0.000140965 lmon_N=4.96781e+07 "lmon.dat" Detector: emon_I=0.999866 emon_ERR=0.000141412 emon_N=4.99933e+07 "emon.dat" Finally [Test_Sources: 8]. Time: 4 [s] Finally [Test_Sources: 8]. Time: 4 [s] Finally [Test_Sources: 8]. Time: 4 [s] Detector: psd_I=1 psd_ERR=0.000141421 psd_N=5e+07 "psdmon.dat" Finally [Test_Sources: 8]. Time: 4 [s] Finally [Test_Sources: 8]. Time: 4 [s] Finally [Test_Sources: 8]. Time: 4 [s] Finally [Test_Sources: 8]. Time: 4 [s] Finally [Test_Sources: 8]. Time: 4 [s] Finally [Test_Sources: 8]. Time: 4 [s] Finally [Test_Sources: 8]. Time: 4 [s] [n-62-29-18:20838] 9 more processes have sent help message help-mpi-btl-openib.txt / ib port not selected [n-62-29-18:20838] Set MCA parameter "orte_base_help_aggregate" to 0 to see all help / error messages [n-62-29-18:20838] 9 more processes have sent help message help-mpi-btl-openib.txt / error in device init INFO: Placing instr file copy /zhome/89/0/38697/xTESTS/2022-08-01/McXtrace_CPU_MPICC_KISS_5e7/Test_Sources/Test_Sources.instr in dataset 8