loading system configuration loading override configuration from /zhome/89/0/38697/mxtest/mctest/../mccodelib/mcxtrace-test/McXtrace_CPU_MPICC_KISS/mccode_config.json INFO: Using directory: "1" INFO: Using existing c-file: ./Test_MCPL_input.c INFO: Using existing binary: ./Test_MCPL_input.out INFO: === INFO: Using system default number of mpirun -np processes -------------------------------------------------------------------------- By default, for Open MPI 4.0 and later, infiniband ports on a device are not used by default. The intent is to use UCX for these devices. You can override this policy by setting the btl_openib_allow_ib MCA parameter to true. Local host: n-62-29-34 Local adapter: mlx4_0 Local port: 1 -------------------------------------------------------------------------- -------------------------------------------------------------------------- WARNING: There was an error initializing an OpenFabrics device. Local host: n-62-29-34 Local device: mlx4_0 -------------------------------------------------------------------------- Simulation 'Test_MCPL_input' (/zhome/89/0/38697/xTESTS/2022-12-01/McXtrace_CPU_MPICC_KISS_5e7/Test_MCPL_input/Test_MCPL_input.instr): running on 10 nodes (master is 'n-62-29-34', MPI version 3.1). INFO (Test_MCPL_input) Using the input file: /zhome/89/0/38697/McXtrace/mcxtrace/3.x-dev/tools/Python/mxrun/../mccodelib/../../../libs/mcpl/voutput.mcpl INFO (Test_MCPL_input) Using the input file: /zhome/89/0/38697/McXtrace/mcxtrace/3.x-dev/tools/Python/mxrun/../mccodelib/../../../libs/mcpl/voutput.mcpl [Test_MCPL_input] Initialize [Test_MCPL_input] Initialize MCPL ERROR: Unable to open file! MCPL ERROR: Unable to open file! INFO (Test_MCPL_input) Using the input file: /zhome/89/0/38697/McXtrace/mcxtrace/3.x-dev/tools/Python/mxrun/../mccodelib/../../../libs/mcpl/voutput.mcpl [Test_MCPL_input] Initialize MCPL ERROR: Unable to open file! INFO (Test_MCPL_input) Using the input file: /zhome/89/0/38697/McXtrace/mcxtrace/3.x-dev/tools/Python/mxrun/../mccodelib/../../../libs/mcpl/voutput.mcpl [Test_MCPL_input] Initialize MCPL ERROR: Unable to open file! INFO (Test_MCPL_input) Using the input file: /zhome/89/0/38697/McXtrace/mcxtrace/3.x-dev/tools/Python/mxrun/../mccodelib/../../../libs/mcpl/voutput.mcpl [Test_MCPL_input] Initialize INFO (Test_MCPL_input) Using the input file: /zhome/89/0/38697/McXtrace/mcxtrace/3.x-dev/tools/Python/mxrun/../mccodelib/../../../libs/mcpl/voutput.mcpl INFO (Test_MCPL_input) Using the input file: /zhome/89/0/38697/McXtrace/mcxtrace/3.x-dev/tools/Python/mxrun/../mccodelib/../../../libs/mcpl/voutput.mcpl [Test_MCPL_input] Initialize [Test_MCPL_input] Initialize MCPL ERROR: Unable to open file! -------------------------------------------------------------------------- Primary job terminated normally, but 1 process returned a non-zero exit code. Per user-direction, the job has been aborted. -------------------------------------------------------------------------- MCPL ERROR: Unable to open file! INFO (Test_MCPL_input) Using the input file: /zhome/89/0/38697/McXtrace/mcxtrace/3.x-dev/tools/Python/mxrun/../mccodelib/../../../libs/mcpl/voutput.mcpl MCPL ERROR: Unable to open file! [Test_MCPL_input] Initialize MCPL ERROR: Unable to open file! -------------------------------------------------------------------------- mpirun detected that one or more processes exited with non-zero status, thus causing the job to be terminated. The first process to do so was: Process name: [[44043,1],2] Exit code: 1 -------------------------------------------------------------------------- [n-62-29-34:22711] 9 more processes have sent help message help-mpi-btl-openib.txt / ib port not selected [n-62-29-34:22711] Set MCA parameter "orte_base_help_aggregate" to 0 to see all help / error messages [n-62-29-34:22711] 9 more processes have sent help message help-mpi-btl-openib.txt / error in device init