INFO: Using directory: "1"
INFO: Using existing c-file: ./Test_Mask.c
INFO: Using existing binary: ./Test_Mask.out
WARNING: Ignoring invalid parameter: "Test_Mask.instr"
INFO: ===
INFO: Using system default number of mpirun -np processes
--------------------------------------------------------------------------
By default, for Open MPI 4.0 and later, infiniband ports on a device
are not used by default.  The intent is to use UCX for these devices.
You can override this policy by setting the btl_openib_allow_ib MCA parameter
to true.

  Local host:              n-62-29-18
  Local adapter:           mlx4_0
  Local port:              1

--------------------------------------------------------------------------
--------------------------------------------------------------------------
WARNING: There was an error initializing an OpenFabrics device.

  Local host:   n-62-29-18
  Local device: mlx4_0
--------------------------------------------------------------------------
Simulation 'Test_Mask' (/zhome/89/0/38697/xTESTS/2022-02-01/McXtrace_CPU_MPICC_KISS_5e7/Test_Mask/Test_Mask.instr): running on 10 nodes (master is 'n-62-29-18', MPI version 3.1).
[Test_Mask] Initialize
[Test_Mask] Initialize
[Test_Mask] Initialize
[Test_Mask] Initialize
Opening input file '/zhome/89/0/38697/McXtrace/mcxtrace/3.x-dev/tools/Python/mxrun/../mccodelib/../../../data/Test_Mask_input_file.mask' (Table_Read_Offset)
[Test_Mask] Initialize
[Test_Mask] Initialize
[Test_Mask] Initialize
[Test_Mask] Initialize
[Test_Mask] Initialize
[Test_Mask] Initialize
*** TRACE end *** 

Save [Test_Mask]
Detector: psd0_I=0.894379 psd0_ERR=0.000133744 psd0_N=4.47189e+07 "psd0.dat"


Finally [Test_Mask: 1]. Time: 4 [s] 

Finally [Test_Mask: 1]. Time: 4 [s] 
Detector: psd1_I=0.223617 psd1_ERR=5.79196e-05 psd1_N=4.47189e+07 "psd1.dat"
Finally [Test_Mask: 1]. Time: 4 [s] 

Finally [Test_Mask: 1]. Time: 4 [s] 

Finally [Test_Mask: 1]. Time: 4 [s] 

Finally [Test_Mask: 1]. Time: 4 [s] 

Finally [Test_Mask: 1]. Time: 4 [s] 


Finally [Test_Mask: 1]. Time: 4 [s] 
Finally [Test_Mask: 1]. Time: 4 [s] 

Finally [Test_Mask: 1]. Time: 4 [s] 
[n-62-29-18:14332] 9 more processes have sent help message help-mpi-btl-openib.txt / ib port not selected
[n-62-29-18:14332] Set MCA parameter "orte_base_help_aggregate" to 0 to see all help / error messages
[n-62-29-18:14332] 9 more processes have sent help message help-mpi-btl-openib.txt / error in device init
INFO: Placing instr file copy /zhome/89/0/38697/xTESTS/2022-02-01/McXtrace_CPU_MPICC_KISS_5e7/Test_Mask/Test_Mask.instr in dataset 1
loading system configuration
loading override configuration from /zhome/89/0/38697/mxtest/mctest/../mccodelib/mcxtrace-test/McXtrace_CPU_MPICC_KISS/mccode_config.json