Question about higher resolution topography at global scale and MPI interfaces.

[lsawade]

I have been playing around with higher resolution topography and associated smoothing function. When I use anything above ETOPO1 (e.g. ETOPO2, ETOPO1), something weird happens at the MPI interfaces. Since the error is caught, I have to assume that is expected. Are elements deleted/added depending on stretching?

ERROR:

 Error MPI interface rank:            2
 warning            9  flag: missed rank=           6
   flag=           0 missed iglob=     9644753 interface=           3 is_face_edge T

 warning            9  flag: missed rank=           6
   flag=           0 missed iglob=     9644805 interface=           3 is_face_edge T

 warning            9  flag: missed rank=           6
   flag=           0 missed iglob=     9644809 interface=           3 is_face_edge T

 warning            9  flag: missed rank=           6
   flag=           0 missed iglob=     9644813 interface=           3 is_face_edge T

 warning            9  flag: missed rank=           6
   flag=           0 missed iglob=     9644817 interface=           3 is_face_edge T

 warning            9  flag: missed rank=           6
   flag=           0 missed iglob=    10697381 interface=           3 is_face_edge T

 warning            9  flag: missed rank=           6
   flag=           0 missed iglob=    10697397 interface=           3 is_face_edge T

 warning            9  flag: missed rank=           6
   flag=           0 missed iglob=    10697413 interface=           3 is_face_edge T

 warning            9  flag: missed rank=           6
   flag=           0 missed iglob=    10697429 interface=           3 is_face_edge T

 warning            9  flag: missed rank=           7
   flag=           0 missed iglob=     9644817 interface=           1 is_face_edge T

 warning            9  flag: missed rank=           7
   flag=           0 missed iglob=    10697493 interface=           1 is_face_edge T

 warning            9  flag: missed rank=           2
   flag=           0 missed iglob=    10697493 interface=           6 is_face_edge T

 Error MPI interface rank:            9
   work_test_flag min/max :           0          12
 Error: MPI points remain unrecognized, please check mesh interfaces
 Error detected, aborting MPI... proc            2
   work_test_flag min/max :           0           3
 Error: MPI points remain unrecognized, please check mesh interfaces
 Error detected, aborting MPI... proc            9

PS: Happy to move this to issues.

[danielpeter]

hi Lucas, is this for the globe version? maybe adding this as an issue there would be a better place.

in general, if something with the MPI interface is messed up, it might be a numerical precision thing. these interface points get sorted on the different processes and then a match on both sides is found. thus, if the sorting is different due to slightly different positioning, it might fail.

to reproduce this error, it will depend on your topo file, OS and compilers - you would need to add all those infos...

[lsawade]

I'll move it. And provide compiler OS etc.