Support for numpy in Javascript through another serilization like MessagePack

[VigneshVSV]

HTTP can support MessagePack headers for content type.

Numpy arrays are serialized as fast as python's pickle by MessagePack format msgspec.msgpack . However, to unpack it on the javascript side, a suitable deserialization is necessary. MessagePack is also safer than pickle, so currently pickle is not support for HTTP access, but message pack support would be great.

The expected server side code is as follows:

class MyThing(Thing)
    
    _numpy_event = Event() 
    
    @action()
    def numpy_gen(self) -> memoryview:
        return memoryview(self._large_numpy_array)
       
    def event_pub(self) -> None:
         while True:
             self._numpy_event.push(memoryview(self._large_numpy_array)
             time.sleep(1)

if __name__ == '___main__':
     MyThing(instance_name='my-thing', serializer='msgpack').run_with_http_server()

However, a javascript library which can read this memoryview data is not known.

Any suggestions are welcome.

+----------------------------------------------------------------------------------------------------------------------+
| serializer | spectrum | spectrum 1e4 double entries | spectrum 1e5 entries | spectrum 1e6 entries |
+=====================================================================+
| JSONSerializer | 0.05121 | 0.61983 | 6.29486 | 65.279 |
+----------------------------------------------------------------------------------------------------------------------+
| PickleSerializer | 0.01586 | 0.01927 | 0.26054 | 8.31536 |
+----------------------------------------------------------------------------------------------------------------------+
| MsgpackSerializer | 0.01237 | 0.09472 | 1.13373 | 15.2071 |
+----------------------------------------------------------------------------------------------------------------------+