rzadams multimat_test failure

[bmhan12]

The failing line looks to be this one:

axom/src/axom/multimat/tests/multimat_test.cpp

Line 820 in e5b5707

test_multimat_conversion<double, 3>(layout_from, layout_to, unifiedAllocID);

Fails only for the double data type, int and float are passing.
Test passes on rzvernal/tioga.

Error message:

$ ctest -VV -R "multimat_test"

…
…
…

347: [INFO] Constructing Multimat object with layout Cell-Centric/Sparse
347:
347:    *MultiMat data was valid
347:
347: ***********************************
347: [WARNING in line 1346 of file /usr/WS1/han12/axom/src/axom/multimat/multimat.cpp]
347: MESSAGE=Multimat: cannot convert unowned field "UnownedField" to dense layout. Skipping.
347: ***********************************
347: [INFO] Converted multimat instance to layout Material-Centric/Dense
347: [INFO]
347: --------------------------------------------------
347:  Testing Multimat construction and conversion
347:  Cells: 20 Mats: 10 Data type: f Stride: 3
347: --------------------------------------------------
347:
347: [INFO] Constructing Multimat object with layout Cell-Centric/Sparse
347:
347:    *MultiMat data was valid
347: Memory access fault by GPU node-4 (Agent handle: 0x7ad150) on address (nil). Reason: Unknown.
1/1 Test #347: multimat_test ....................Subprocess aborted***Exception:   1.37 sec

0% tests passed, 1 tests failed out of 1

Total Test time (real) =   1.44 sec

The following tests FAILED:
        347 - multimat_test (Subprocess aborted)

[publixsubfan]

I did a cursory investigation and was able to reproduce the issue in ROCM 6.1.2 but not ROCM 6.2.1. Based on experience with another project, we may be able to add in -mllvm -amdgpu-legacy-sgpr-spill-lowering=true to mitigate this. But I need to figure out how to pass this in for Axom - the flag I was using to pass in that flag (-Xoffload-linker) is being ignored with amdclang.