How can I use the HHEM model to evaluate my LLM after finetuning?

[zjq0455]

Thank you for your contributions!

I was wondering whether it is possible or how can I use the HHEM model to evaluate a LLM after finetuning using our specific dataset?

[forrestbao]

hi @zjq0455 thanks for your interest in HHEM. Yes, of course. Just note that HHEM's context window is 512 tokens. We are working on a more powerful open source version to remove this restrictions.