"Lightining Thunder" pytorch accelerator, could it be integrated somehow?

[TiagoTiago]

I just heard of this right now, and at the moment I don't got the brain juice to look much further into this.

https://github.com/Lightning-AI/lightning-thunder

About

Make PyTorch models up to 40% faster! Thunder is a source to source compiler for PyTorch. It enables using different hardware executors at once; across one or thousands of GPUs.