loading system configuration loading override configuration from /zhome/89/0/38697/mxtest/mctest/../mccodelib/mcxtrace-test/McXtrace-1.x_CPU_MPICC/mccode_config.json INFO: Using directory: "5" INFO: Using existing c-file: ./Test_Filter.c INFO: Using existing binary: ./Test_Filter.out INFO: === INFO: Using system default number of mpirun -np processes -------------------------------------------------------------------------- By default, for Open MPI 4.0 and later, infiniband ports on a device are not used by default. The intent is to use UCX for these devices. You can override this policy by setting the btl_openib_allow_ib MCA parameter to true. Local host: n-62-29-31 Local adapter: mlx4_0 Local port: 1 -------------------------------------------------------------------------- -------------------------------------------------------------------------- WARNING: There was an error initializing an OpenFabrics device. Local host: n-62-29-31 Local device: mlx4_0 -------------------------------------------------------------------------- Simulation 'Test_Filter' (/zhome/89/0/38697/xTESTS/2022-12-01/McXtrace-1.x_CPU_MPICC_1e7/Test_Filter/Test_Filter.instr): running on 10 nodes (master is 'n-62-29-31', MPI version 3.1). [Test_Filter] Initialize [Test_Filter] Initialize [Test_Filter] Initialize Opening input file '/zhome/89/0/38697/McXtrace/mcxtrace/1.x-dev/tools/Python/mxrun/../mccodelib/../../../data/Glass.dat' (Table_Read_Offset) [Test_Filter] Initialize [Test_Filter] Initialize [Test_Filter] Initialize [Test_Filter] Initialize [Test_Filter] Initialize [Test_Filter] Initialize [Test_Filter] Initialize filter: Rebinning material data (Glass.dat) for faster tracing...done filter2: Rebinning material data (Glass.dat) for faster tracing...done filter: Rebinning material data (Glass.dat) for faster tracing...done filter2: Rebinning material data (Glass.dat) for faster tracing...done filter: Rebinning material data (Glass.dat) for faster tracing...done filter: Rebinning material data (Glass.dat) for faster tracing...done filter: Rebinning material data (Glass.dat) for faster tracing...done filter2: Rebinning material data (Glass.dat) for faster tracing...done filter2: Rebinning material data (Glass.dat) for faster tracing...done filter2: Rebinning material data (Glass.dat) for faster tracing...done filter: Rebinning material data (Glass.dat) for faster tracing...done filter: Rebinning material data (Glass.dat) for faster tracing...done filter2: Rebinning material data (Glass.dat) for faster tracing...done filter2: Rebinning material data (Glass.dat) for faster tracing...done filter: Rebinning material data (Glass.dat) for faster tracing...done filter: Rebinning material data (Glass.dat) for faster tracing...done filter2: Rebinning material data (Glass.dat) for faster tracing...done filter2: Rebinning material data (Glass.dat) for faster tracing...done filter: Rebinning material data (Glass.dat) for faster tracing...done filter2: Rebinning material data (Glass.dat) for faster tracing...done Finally [Test_Filter: 5]. Time: 1 [s] Finally [Test_Filter: 5]. Time: 1 [s] Finally [Test_Filter: 5]. Time: 1 [s] Finally [Test_Filter: 5]. Time: 2 [s] Finally [Test_Filter: 5]. Time: 2 [s] Finally [Test_Filter: 5]. Time: 2 [s] Finally [Test_Filter: 5]. Time: 2 [s] Save [Test_Filter] Finally [Test_Filter: 5]. Time: 2 [s] Detector: l_mon0_I=0.000794121 l_mon0_ERR=2.51123e-07 l_mon0_N=1e+07 "l_mon0.dat" Finally [Test_Filter: 5]. Time: 2 [s] Detector: l_mon1_I=1.64637e-06 l_mon1_ERR=1.66019e-09 l_mon1_N=9.99581e+06 "l_mon1.dat" Finally [Test_Filter: 5]. Time: 2 [s] [n-62-29-31:07283] 9 more processes have sent help message help-mpi-btl-openib.txt / ib port not selected [n-62-29-31:07283] Set MCA parameter "orte_base_help_aggregate" to 0 to see all help / error messages [n-62-29-31:07283] 9 more processes have sent help message help-mpi-btl-openib.txt / error in device init INFO: Placing instr file copy /zhome/89/0/38697/xTESTS/2022-12-01/McXtrace-1.x_CPU_MPICC_1e7/Test_Filter/Test_Filter.instr in dataset 5