INFO: Using directory: "1"
INFO: Using existing c-file: ./Test_Air.c
INFO: Using existing binary: ./Test_Air.out
WARNING: Ignoring invalid parameter: "Test_Air.instr"
INFO: ===
INFO: Using system default number of mpirun -np processes
--------------------------------------------------------------------------
By default, for Open MPI 4.0 and later, infiniband ports on a device
are not used by default.  The intent is to use UCX for these devices.
You can override this policy by setting the btl_openib_allow_ib MCA parameter
to true.

  Local host:              n-62-29-30
  Local adapter:           mlx4_0
  Local port:              1

--------------------------------------------------------------------------
--------------------------------------------------------------------------
WARNING: There was an error initializing an OpenFabrics device.

  Local host:   n-62-29-30
  Local device: mlx4_0
--------------------------------------------------------------------------
Simulation 'Test_Air' (/zhome/89/0/38697/xTESTS/2022-02-01/McXtrace-1.x_CPU_MPICC_5e7/Test_Air/Test_Air.instr): running on 10 nodes (master is 'n-62-29-30', MPI version 3.1).
[Test_Air] Initialize
[Test_Air] Initialize
[Test_Air] Initialize
[Test_Air] Initialize
[Test_Air] Initialize
[Test_Air] Initialize
[Test_Air] Initialize
[Test_Air] Initialize
[Test_Air] Initialize
[Test_Air] Initialize
[n-62-29-30:20803] 9 more processes have sent help message help-mpi-btl-openib.txt / ib port not selected
[n-62-29-30:20803] Set MCA parameter "orte_base_help_aggregate" to 0 to see all help / error messages
[n-62-29-30:20803] 9 more processes have sent help message help-mpi-btl-openib.txt / error in device init

Finally [Test_Air: 1]. Time: 9 [s] 

Finally [Test_Air: 1]. Time: 9 [s] 
Warning: 2.49957e+06 events were removed in Component[9] psd1=PSD_monitor()
         (negative time, miss next components, rounding errors, Nan, Inf).
Warning: 2.49949e+06 events were removed in Component[9] psd1=PSD_monitor()
         (negative time, miss next components, rounding errors, Nan, Inf).

Finally [Test_Air: 1]. Time: 9 [s] 
Warning: 2.49962e+06 events were removed in Component[9] psd1=PSD_monitor()
         (negative time, miss next components, rounding errors, Nan, Inf).

Finally [Test_Air: 1]. Time: 10 [s] 
Warning: 2.50074e+06 events were removed in Component[9] psd1=PSD_monitor()
         (negative time, miss next components, rounding errors, Nan, Inf).

Save [Test_Air]
Detector: psd0_I=4.97359e-07 psd0_ERR=7.03371e-11 psd0_N=5e+07 "psd0.dat"

Finally [Test_Air: 1]. Time: 10 [s] 
Warning: 2.50077e+06 events were removed in Component[9] psd1=PSD_monitor()
         (negative time, miss next components, rounding errors, Nan, Inf).

Finally [Test_Air: 1]. Time: 10 [s] 
Warning: 2.50128e+06 events were removed in Component[9] psd1=PSD_monitor()
         (negative time, miss next components, rounding errors, Nan, Inf).

Finally [Test_Air: 1]. Time: 10 [s] 
Warning: 2.49904e+06 events were removed in Component[9] psd1=PSD_monitor()
         (negative time, miss next components, rounding errors, Nan, Inf).
Detector: div0_I=4.97359e-07 div0_ERR=7.03371e-11 div0_N=5e+07 "div0.dat"
Detector: fpi_I=4.97103e-07 fpi_ERR=9.94158e-11 fpi_N=5e+07 "fpi.dat"
Detector: fpi_scat_I=7.94415e-15 fpi_scat_ERR=1.76743e-18 fpi_scat_N=2.49976e+07 "fpi_sc.dat"
Detector: fpi_noscat_I=4.97103e-07 fpi_noscat_ERR=9.94158e-11 fpi_noscat_N=2.50024e+07 "fpi_no.dat"

Finally [Test_Air: 1]. Time: 10 [s] 
Warning: 2.50002e+06 events were removed in Component[9] psd1=PSD_monitor()
         (negative time, miss next components, rounding errors, Nan, Inf).
Detector: psd1_I=4.95942e-11 psd1_ERR=9.92917e-13 psd1_N=2.49917e+07 "psd1.dat"
Detector: div1_I=4.9594e-11 div1_ERR=9.92917e-13 div1_N=2.33686e+07 "div1.dat"

Finally [Test_Air: 1]. Time: 10 [s] 
Detector: psd2_I=4.95863e-11 psd2_ERR=9.92938e-13 psd2_N=20667 "psd2.dat"
Warning: 2.49985e+06 events were removed in Component[9] psd1=PSD_monitor()
         (negative time, miss next components, rounding errors, Nan, Inf).
Detector: div2_I=4.95863e-11 div2_ERR=9.92938e-13 div2_N=20667 "div2.dat"

Finally [Test_Air: 1]. Time: 10 [s] 
Warning: 2.49951e+06 events were removed in Component[9] psd1=PSD_monitor()
         (negative time, miss next components, rounding errors, Nan, Inf).
INFO: Placing instr file copy /zhome/89/0/38697/xTESTS/2022-02-01/McXtrace-1.x_CPU_MPICC_5e7/Test_Air/Test_Air.instr in dataset 1
loading system configuration
loading override configuration from /zhome/89/0/38697/mxtest/mctest/../mccodelib/mcxtrace-test/McXtrace-1.x_CPU_MPICC/mccode_config.json