Usage of the Google BigBird model for the Haystack Reader node

[dhruvkud13]

I am trying to integrate google big bird model into my reader for a question answer engine. However, I am not able to integrate this and it is giving some errors. Is it possible to integrate such models into Haystack or not? Can you list all the different models that can be used with the haystack reader node.

[anakin87]

Hello @dhruvkud13!

• If you just want to load a model and use it for Question Answering, you should choose a pretrained Extractive Question Answering model, like these.
  Nowadays there is plenty of good pretrained models, so I would start from them.

• the Reader also allows training base models (such as Big Bird) into Question Answering models, as you can understand in this tutorial.
  It takes a considerable manual effort for annotation, so it would not be my first option.

If you can provide further details and a code example, we can give you more help!