
 ========================   JOB MAP   ========================

 Data for node: Name: cp3622	Num procs: 20
 	Process OMPI jobid: [27493,1] Process rank: 0
 	Process OMPI jobid: [27493,1] Process rank: 1
 	Process OMPI jobid: [27493,1] Process rank: 2
 	Process OMPI jobid: [27493,1] Process rank: 3
 	Process OMPI jobid: [27493,1] Process rank: 4
 	Process OMPI jobid: [27493,1] Process rank: 5
 	Process OMPI jobid: [27493,1] Process rank: 6
 	Process OMPI jobid: [27493,1] Process rank: 7
 	Process OMPI jobid: [27493,1] Process rank: 8
 	Process OMPI jobid: [27493,1] Process rank: 9
 	Process OMPI jobid: [27493,1] Process rank: 10
 	Process OMPI jobid: [27493,1] Process rank: 11
 	Process OMPI jobid: [27493,1] Process rank: 12
 	Process OMPI jobid: [27493,1] Process rank: 13
 	Process OMPI jobid: [27493,1] Process rank: 14
 	Process OMPI jobid: [27493,1] Process rank: 15
 	Process OMPI jobid: [27493,1] Process rank: 16
 	Process OMPI jobid: [27493,1] Process rank: 17
 	Process OMPI jobid: [27493,1] Process rank: 18
 	Process OMPI jobid: [27493,1] Process rank: 19

 Data for node: Name: cp2566	Num procs: 20
 	Process OMPI jobid: [27493,1] Process rank: 20
 	Process OMPI jobid: [27493,1] Process rank: 21
 	Process OMPI jobid: [27493,1] Process rank: 22
 	Process OMPI jobid: [27493,1] Process rank: 23
 	Process OMPI jobid: [27493,1] Process rank: 24
 	Process OMPI jobid: [27493,1] Process rank: 25
 	Process OMPI jobid: [27493,1] Process rank: 26
 	Process OMPI jobid: [27493,1] Process rank: 27
 	Process OMPI jobid: [27493,1] Process rank: 28
 	Process OMPI jobid: [27493,1] Process rank: 29
 	Process OMPI jobid: [27493,1] Process rank: 30
 	Process OMPI jobid: [27493,1] Process rank: 31
 	Process OMPI jobid: [27493,1] Process rank: 32
 	Process OMPI jobid: [27493,1] Process rank: 33
 	Process OMPI jobid: [27493,1] Process rank: 34
 	Process OMPI jobid: [27493,1] Process rank: 35
 	Process OMPI jobid: [27493,1] Process rank: 36
 	Process OMPI jobid: [27493,1] Process rank: 37
 	Process OMPI jobid: [27493,1] Process rank: 38
 	Process OMPI jobid: [27493,1] Process rank: 39

 Data for node: Name: cp2560	Num procs: 20
 	Process OMPI jobid: [27493,1] Process rank: 40
 	Process OMPI jobid: [27493,1] Process rank: 41
 	Process OMPI jobid: [27493,1] Process rank: 42
 	Process OMPI jobid: [27493,1] Process rank: 43
 	Process OMPI jobid: [27493,1] Process rank: 44
 	Process OMPI jobid: [27493,1] Process rank: 45
 	Process OMPI jobid: [27493,1] Process rank: 46
 	Process OMPI jobid: [27493,1] Process rank: 47
 	Process OMPI jobid: [27493,1] Process rank: 48
 	Process OMPI jobid: [27493,1] Process rank: 49
 	Process OMPI jobid: [27493,1] Process rank: 50
 	Process OMPI jobid: [27493,1] Process rank: 51
 	Process OMPI jobid: [27493,1] Process rank: 52
 	Process OMPI jobid: [27493,1] Process rank: 53
 	Process OMPI jobid: [27493,1] Process rank: 54
 	Process OMPI jobid: [27493,1] Process rank: 55
 	Process OMPI jobid: [27493,1] Process rank: 56
 	Process OMPI jobid: [27493,1] Process rank: 57
 	Process OMPI jobid: [27493,1] Process rank: 58
 	Process OMPI jobid: [27493,1] Process rank: 59

 =============================================================
  This is MPPNP: multi-zone post-processing network.
  (c) 2008 Marco Pignatari, Falk Herwig,
      Michael Bennett, Raphael Hirschi and the
      NuGrid collaboration.
 
 Input files read ...
 vital: false species=L   1
 vital: false species=G   1
 vital: false species=G  63
 vital: false species=LI  6
 vital: false species=B  10
 nvar rnetw2007        5210
HDF5-DIAG: Error detected in HDF5 (1.8.3) thread 0:
  #000: H5Adeprec.c line 214 in H5Aopen_name(): can't open attribute
    major: Attribute
    minor: Can't open object
  #001: H5A.c line 873 in H5A_open_by_name(): unable to load attribute info from object header
    major: Attribute
    minor: Unable to initialize object
  #002: H5Oattribute.c line 533 in H5O_attr_open_by_name(): can't locate attribute
    major: Attribute
    minor: Object not found
HDF5-DIAG: Error detected in HDF5 (1.8.3) thread 0:
  #000: H5A.c line 1277 in H5Aget_type(): not an attribute
    major: Invalid arguments to routine
    minor: Inappropriate type
HDF5-DIAG: Error detected in HDF5 (1.8.3) thread 0:
  #000: H5A.c line 2283 in H5Aclose(): not an attribute
    major: Invalid arguments to routine
    minor: Inappropriate type
HDF5-DIAG: Error detected in HDF5 (1.8.3) thread 0:
  #000: H5T.c line 2014 in H5Tis_variable_str(): not a datatype
    major: Invalid arguments to routine
    minor: Inappropriate type
HDF5-DIAG: Error detected in HDF5 (1.8.3) thread 0:
  #000: H5T.c line 1707 in H5Tclose(): not a datatype
    major: Invalid arguments to routine
    minor: Inappropriate type
HDF5-DIAG: Error detected in HDF5 (1.8.3) thread 0:
  #000: H5Adeprec.c line 214 in H5Aopen_name(): can't open attribute
    major: Attribute
    minor: Can't open object
  #001: H5A.c line 873 in H5A_open_by_name(): unable to load attribute info from object header
    major: Attribute
    minor: Unable to initialize object
  #002: H5Oattribute.c line 533 in H5O_attr_open_by_name(): can't locate attribute
    major: Attribute
    minor: Object not found
HDF5-DIAG: Error detected in HDF5 (1.8.3) thread 0:
  #000: H5A.c line 1085 in H5Aread(): not an attribute
    major: Invalid arguments to routine
    minor: Inappropriate type
HDF5-DIAG: Error detected in HDF5 (1.8.3) thread 0:
  #000: H5A.c line 2283 in H5Aclose(): not an attribute
    major: Invalid arguments to routine
    minor: Inappropriate type
forrtl: severe (174): SIGSEGV, segmentation fault occurred
Image              PC                Routine            Line        Source             
libopen-pal.so.0   00002B2D949EA1C3  Unknown               Unknown  Unknown
libopen-pal.so.0   00002B2D949EE57C  Unknown               Unknown  Unknown
libse.so.0         00002B2D91BE5D36  Unknown               Unknown  Unknown
mppnp.exe          0000000000412F53  Unknown               Unknown  Unknown
mppnp.exe          00000000004042EC  Unknown               Unknown  Unknown
libc.so.6          000000325A21ED5D  Unknown               Unknown  Unknown
mppnp.exe          00000000004041E9  Unknown               Unknown  Unknown
mpiexec: killing job...

--------------------------------------------------------------------------
mpiexec noticed that process rank 0 with PID 13597 on node cp3622 exited on signal 0 (Unknown signal 0).
--------------------------------------------------------------------------
mpiexec: abort is already in progress...hit ctrl-c again to forcibly terminate

forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source             
libc.so.6          000000325A2DF0D3  Unknown               Unknown  Unknown
libopen-pal.so.0   00002B906553A0FC  Unknown               Unknown  Unknown
libopen-pal.so.0   00002B9065536E5D  Unknown               Unknown  Unknown
libopen-pal.so.0   00002B906552A37C  Unknown               Unknown  Unknown
libmpi.so.0        00002B9065017118  Unknown               Unknown  Unknown
mca_coll_tuned.so  00002B906B1F2C6A  Unknown               Unknown  Unknown
mca_coll_tuned.so  00002B906B1F21F2  Unknown               Unknown  Unknown
mca_coll_tuned.so  00002B906B1E6B47  Unknown               Unknown  Unknown
mca_coll_sync.so   00002B906AFE12CF  Unknown               Unknown  Unknown
libmpi.so.0        00002B906502F411  Unknown               Unknown  Unknown
libmpi_f77.so.0    00002B9064DCCC0A  Unknown               Unknown  Unknown
mppnp.exe          0000000000405C87  Unknown               Unknown  Unknown
mppnp.exe          00000000004042EC  Unknown               Unknown  Unknown
libc.so.6          000000325A21ED5D  Unknown               Unknown  Unknown
mppnp.exe          00000000004041E9  Unknown               Unknown  Unknown
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source             
mca_btl_openib.so  00002AF5645166BE  Unknown               Unknown  Unknown
libopen-pal.so.0   00002AF55FD4A3A6  Unknown               Unknown  Unknown
libmpi.so.0        00002AF55F837118  Unknown               Unknown  Unknown
mca_coll_tuned.so  00002AF565A12C6A  Unknown               Unknown  Unknown
mca_coll_tuned.so  00002AF565A121F2  Unknown               Unknown  Unknown
mca_coll_tuned.so  00002AF565A06B47  Unknown               Unknown  Unknown
mca_coll_sync.so   00002AF5658012CF  Unknown               Unknown  Unknown
libmpi.so.0        00002AF55F84F411  Unknown               Unknown  Unknown
libmpi_f77.so.0    00002AF55F5ECC0A  Unknown               Unknown  Unknown
mppnp.exe          0000000000405C87  Unknown               Unknown  Unknown
mppnp.exe          00000000004042EC  Unknown               Unknown  Unknown
libc.so.6          000000325A21ED5D  Unknown               Unknown  Unknown
mppnp.exe          00000000004041E9  Unknown               Unknown  Unknown
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source             
libc.so.6          000000325A2DF0D3  Unknown               Unknown  Unknown
libopen-pal.so.0   00002B2B6DA610FC  Unknown               Unknown  Unknown
libopen-pal.so.0   00002B2B6DA5DE5D  Unknown               Unknown  Unknown
libopen-pal.so.0   00002B2B6DA5137C  Unknown               Unknown  Unknown
libmpi.so.0        00002B2B6D53E118  Unknown               Unknown  Unknown
mca_coll_tuned.so  00002B2B73719C6A  Unknown               Unknown  Unknown
mca_coll_tuned.so  00002B2B737191F2  Unknown               Unknown  Unknown
mca_coll_tuned.so  00002B2B7370DB47  Unknown               Unknown  Unknown
mca_coll_sync.so   00002B2B735082CF  Unknown               Unknown  Unknown
libmpi.so.0        00002B2B6D556411  Unknown               Unknown  Unknown
libmpi_f77.so.0    00002B2B6D2F3C0A  Unknown               Unknown  Unknown
mppnp.exe          0000000000405C87  Unknown               Unknown  Unknown
mppnp.exe          00000000004042EC  Unknown               Unknown  Unknown
libc.so.6          000000325A21ED5D  Unknown               Unknown  Unknown
mppnp.exe          00000000004041E9  Unknown               Unknown  Unknown
mpiexec: clean termination accomplished

forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source             
libc.so.6          000000325A2DF0D3  Unknown               Unknown  Unknown
libopen-pal.so.0   00002ACD17EBF0FC  Unknown               Unknown  Unknown
libopen-pal.so.0   00002ACD17EBBE5D  Unknown               Unknown  Unknown
libopen-pal.so.0   00002ACD17EAF37C  Unknown               Unknown  Unknown
libmpi.so.0        00002ACD1799C118  Unknown               Unknown  Unknown
mca_coll_tuned.so  00002ACD1DB77C6A  Unknown               Unknown  Unknown
mca_coll_tuned.so  00002ACD1DB771F2  Unknown               Unknown  Unknown
mca_coll_tuned.so  00002ACD1DB6BB47  Unknown               Unknown  Unknown
mca_coll_sync.so   00002ACD1D9662CF  Unknown               Unknown  Unknown
libmpi.so.0        00002ACD179B4411  Unknown               Unknown  Unknown
libmpi_f77.so.0    00002ACD17751C0A  Unknown               Unknown  Unknown
mppnp.exe          0000000000405C87  Unknown               Unknown  Unknown
mppnp.exe          00000000004042EC  Unknown               Unknown  Unknown
libc.so.6          000000325A21ED5D  Unknown               Unknown  Unknown
mppnp.exe          00000000004041E9  Unknown               Unknown  Unknown
60 total processes killed (some possibly by mpiexec during cleanup)
