You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
self.llm_lingua = PromptCompressor(
model_name="/home/webservice/llm/compressFromNet/llmlingua-2-xlm",
use_llmlingua2=True, # Whether to use llmlingua-2
)
compressed_prompt = self.llm_lingua.compress_prompt(
context, # context is str type
rate=0.33,
force_tokens = ['\n', '?'],
drop_consecutive=True,)
print(compressed_prompt)
err:
compressed_prompt = self.llm_lingua.compress_prompt(
File "/home/webservice/miniconda3/envs/tka/lib/python3.10/site-packages/llmlingua/prompt_compressor.py", line 472, in compress_prompt
return self.compress_prompt_llmlingua2(
File "/home/webservice/miniconda3/envs/tka/lib/python3.10/site-packages/llmlingua/prompt_compressor.py", line 776, in compress_prompt_llmlingua2
context_probs, context_words = self.__get_context_prob(
File "/home/webservice/miniconda3/envs/tka/lib/python3.10/site-packages/llmlingua/prompt_compressor.py", line 2134, in __get_context_prob
) = self.__merge_token_to_word(
File "/home/webservice/miniconda3/envs/tka/lib/python3.10/site-packages/llmlingua/prompt_compressor.py", line 2199, in __merge_token_to_word
elif is_begin_of_new_word(token, self.model_name, force_tokens, token_map):
File "/home/webservice/miniconda3/envs/tka/lib/python3.10/site-packages/llmlingua/utils.py", line 94, in is_begin_of_new_word
raise NotImplementedError()
NotImplementedError
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
-
llmlingua-2 model is downed in hugging facing
code:
err:
I don't know if we have the same problem
Beta Was this translation helpful? Give feedback.
All reactions