JIGSAWS evaluation

[IsabelFunke]

Hello,

Congratulations on this work, impressive results!
I enjoyed reading the paper very much.

One question:
Are you planning to release the code for the experiments on the JIGSAWS dataset?
So far, I can only find folders for MTL-AQA and FineDiving.

Best wishes,
Isabel

[abrarmajeedi]

Hi Isabel,

Thank you for your interest in our work. Given the complexity of JIGSAWS dataset evaluation (4 fold cross validation across three subtasks) most existing work (e.g. TPT, CoRe) does not release the experiment setup for JIGSAWS, so we were not planning to release the code for it, but given your interest, we will try to add support for JIGSAWS as soon as possible.

[IsabelFunke]

Sounds great, thanks!