Pybind11 embed crashing when reloaded within host

[ClosetGeek-Git]

I've been playing with making a plugin for a DJ software using pybind11 and all is going very well. However, I'm having an annoying issue where asyncio seems to be causing fatal errors when I unload and then reload the plugin without restarting the host software. Upon further research I found this issue here (#1925) which states "pybind11 modules can never be unloaded, it's not supported for native libraries in python." I also found the following within the pybind11 docs:

The interpreter can be restarted by calling initialize_interpreter() again. Modules created using pybind11 can be safely re-initialized. However, Python itself cannot completely unload binary extension modules and there are several caveats with regard to interpreter restarting. All the details can be found in the CPython documentation. In short, not all interpreter memory may be freed, either due to reference cycles or user-created global data.

I've been banging my head on my desk trying to fix the issue, should I assume from the above that it's simply not possible?